00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 1754 00:00:00.001 originally caused by: 00:00:00.002 Started by upstream project "nightly-trigger" build number 3015 00:00:00.002 originally caused by: 00:00:00.002 Started by timer 00:00:00.171 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.171 The recommended git tool is: git 00:00:00.171 using credential 00000000-0000-0000-0000-000000000002 00:00:00.173 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.214 Fetching changes from the remote Git repository 00:00:00.216 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.260 Using shallow fetch with depth 1 00:00:00.260 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.260 > git --version # timeout=10 00:00:00.284 > git --version # 'git version 2.39.2' 00:00:00.284 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.285 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.285 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:06.455 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.469 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.485 Checking out Revision f964f6d3463483adf05cc5c086f2abd292e05f1d (FETCH_HEAD) 00:00:06.485 > git config core.sparsecheckout # timeout=10 00:00:06.497 > git read-tree -mu HEAD # timeout=10 00:00:06.514 > git checkout -f f964f6d3463483adf05cc5c086f2abd292e05f1d # timeout=5 00:00:06.549 Commit message: "ansible/roles/custom_facts: Drop nvme features" 00:00:06.549 > git rev-list --no-walk f964f6d3463483adf05cc5c086f2abd292e05f1d # timeout=10 00:00:06.642 [Pipeline] Start of Pipeline 00:00:06.660 [Pipeline] library 00:00:06.663 Loading library shm_lib@master 00:00:06.663 Library shm_lib@master is cached. Copying from home. 00:00:06.684 [Pipeline] node 00:00:06.697 Running on CYP9 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:06.699 [Pipeline] { 00:00:06.710 [Pipeline] catchError 00:00:06.712 [Pipeline] { 00:00:06.732 [Pipeline] wrap 00:00:06.741 [Pipeline] { 00:00:06.746 [Pipeline] stage 00:00:06.748 [Pipeline] { (Prologue) 00:00:06.994 [Pipeline] sh 00:00:07.279 + logger -p user.info -t JENKINS-CI 00:00:07.385 [Pipeline] echo 00:00:07.387 Node: CYP9 00:00:07.398 [Pipeline] sh 00:00:07.708 [Pipeline] setCustomBuildProperty 00:00:07.720 [Pipeline] echo 00:00:07.722 Cleanup processes 00:00:07.730 [Pipeline] sh 00:00:08.018 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.018 3729217 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.032 [Pipeline] sh 00:00:08.318 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.318 ++ grep -v 'sudo pgrep' 00:00:08.318 ++ awk '{print $1}' 00:00:08.318 + sudo kill -9 00:00:08.318 + true 00:00:08.335 [Pipeline] cleanWs 00:00:08.347 [WS-CLEANUP] Deleting project workspace... 00:00:08.347 [WS-CLEANUP] Deferred wipeout is used... 00:00:08.354 [WS-CLEANUP] done 00:00:08.359 [Pipeline] setCustomBuildProperty 00:00:08.375 [Pipeline] sh 00:00:08.661 + sudo git config --global --replace-all safe.directory '*' 00:00:08.744 [Pipeline] nodesByLabel 00:00:08.745 Found a total of 1 nodes with the 'sorcerer' label 00:00:08.755 [Pipeline] httpRequest 00:00:08.760 HttpMethod: GET 00:00:08.760 URL: http://10.211.164.96/packages/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:08.763 Sending request to url: http://10.211.164.96/packages/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:08.777 Response Code: HTTP/1.1 200 OK 00:00:08.778 Success: Status code 200 is in the accepted range: 200,404 00:00:08.778 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:12.066 [Pipeline] sh 00:00:12.356 + tar --no-same-owner -xf jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:12.373 [Pipeline] httpRequest 00:00:12.377 HttpMethod: GET 00:00:12.378 URL: http://10.211.164.96/packages/spdk_36faa8c312bf9059b86e0f503d7fd6b43c1498e6.tar.gz 00:00:12.378 Sending request to url: http://10.211.164.96/packages/spdk_36faa8c312bf9059b86e0f503d7fd6b43c1498e6.tar.gz 00:00:12.382 Response Code: HTTP/1.1 200 OK 00:00:12.382 Success: Status code 200 is in the accepted range: 200,404 00:00:12.383 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_36faa8c312bf9059b86e0f503d7fd6b43c1498e6.tar.gz 00:00:44.684 [Pipeline] sh 00:00:44.972 + tar --no-same-owner -xf spdk_36faa8c312bf9059b86e0f503d7fd6b43c1498e6.tar.gz 00:00:47.528 [Pipeline] sh 00:00:47.813 + git -C spdk log --oneline -n5 00:00:47.813 36faa8c31 bdev/nvme: Fix the case that namespace was removed during reset 00:00:47.813 e2cb5a5ee bdev/nvme: Factor out nvme_ns active/inactive check into a helper function 00:00:47.813 4b134b4ab bdev/nvme: Delay callbacks when the next operation is a failover 00:00:47.813 d2ea4ecb1 llvm/vfio: Suppress checking leaks for `spdk_nvme_ctrlr_alloc_io_qpair` 00:00:47.813 3b33f4333 test/nvme/cuse: Fix typo 00:00:47.826 [Pipeline] } 00:00:47.842 [Pipeline] // stage 00:00:47.850 [Pipeline] stage 00:00:47.851 [Pipeline] { (Prepare) 00:00:47.869 [Pipeline] writeFile 00:00:47.885 [Pipeline] sh 00:00:48.172 + logger -p user.info -t JENKINS-CI 00:00:48.185 [Pipeline] sh 00:00:48.469 + logger -p user.info -t JENKINS-CI 00:00:48.482 [Pipeline] sh 00:00:48.768 + cat autorun-spdk.conf 00:00:48.768 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:48.768 SPDK_TEST_NVMF=1 00:00:48.768 SPDK_TEST_NVME_CLI=1 00:00:48.768 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:48.768 SPDK_TEST_NVMF_NICS=e810 00:00:48.768 SPDK_RUN_UBSAN=1 00:00:48.768 NET_TYPE=phy 00:00:48.776 RUN_NIGHTLY=1 00:00:48.781 [Pipeline] readFile 00:00:48.806 [Pipeline] withEnv 00:00:48.808 [Pipeline] { 00:00:48.822 [Pipeline] sh 00:00:49.110 + set -ex 00:00:49.110 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:00:49.110 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:49.110 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:49.110 ++ SPDK_TEST_NVMF=1 00:00:49.110 ++ SPDK_TEST_NVME_CLI=1 00:00:49.110 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:49.110 ++ SPDK_TEST_NVMF_NICS=e810 00:00:49.110 ++ SPDK_RUN_UBSAN=1 00:00:49.110 ++ NET_TYPE=phy 00:00:49.110 ++ RUN_NIGHTLY=1 00:00:49.110 + case $SPDK_TEST_NVMF_NICS in 00:00:49.110 + DRIVERS=ice 00:00:49.110 + [[ tcp == \r\d\m\a ]] 00:00:49.110 + [[ -n ice ]] 00:00:49.110 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:49.110 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:49.110 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:00:49.110 rmmod: ERROR: Module irdma is not currently loaded 00:00:49.110 rmmod: ERROR: Module i40iw is not currently loaded 00:00:49.110 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:49.110 + true 00:00:49.110 + for D in $DRIVERS 00:00:49.110 + sudo modprobe ice 00:00:49.110 + exit 0 00:00:49.121 [Pipeline] } 00:00:49.164 [Pipeline] // withEnv 00:00:49.169 [Pipeline] } 00:00:49.187 [Pipeline] // stage 00:00:49.196 [Pipeline] catchError 00:00:49.197 [Pipeline] { 00:00:49.216 [Pipeline] timeout 00:00:49.216 Timeout set to expire in 40 min 00:00:49.218 [Pipeline] { 00:00:49.230 [Pipeline] stage 00:00:49.232 [Pipeline] { (Tests) 00:00:49.249 [Pipeline] sh 00:00:49.537 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:49.537 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:49.537 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:49.538 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:00:49.538 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:49.538 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:49.538 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:00:49.538 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:49.538 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:49.538 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:49.538 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:49.538 + source /etc/os-release 00:00:49.538 ++ NAME='Fedora Linux' 00:00:49.538 ++ VERSION='38 (Cloud Edition)' 00:00:49.538 ++ ID=fedora 00:00:49.538 ++ VERSION_ID=38 00:00:49.538 ++ VERSION_CODENAME= 00:00:49.538 ++ PLATFORM_ID=platform:f38 00:00:49.538 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:00:49.538 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:49.538 ++ LOGO=fedora-logo-icon 00:00:49.538 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:00:49.538 ++ HOME_URL=https://fedoraproject.org/ 00:00:49.538 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:00:49.538 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:49.538 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:49.538 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:49.538 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:00:49.538 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:49.538 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:00:49.538 ++ SUPPORT_END=2024-05-14 00:00:49.538 ++ VARIANT='Cloud Edition' 00:00:49.538 ++ VARIANT_ID=cloud 00:00:49.538 + uname -a 00:00:49.538 Linux spdk-cyp-09 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:00:49.538 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:00:52.085 Hugepages 00:00:52.085 node hugesize free / total 00:00:52.085 node0 1048576kB 0 / 0 00:00:52.085 node0 2048kB 0 / 0 00:00:52.085 node1 1048576kB 0 / 0 00:00:52.085 node1 2048kB 0 / 0 00:00:52.085 00:00:52.085 Type BDF Vendor Device NUMA Driver Device Block devices 00:00:52.085 I/OAT 0000:00:01.0 8086 0b00 0 ioatdma - - 00:00:52.085 I/OAT 0000:00:01.1 8086 0b00 0 ioatdma - - 00:00:52.085 I/OAT 0000:00:01.2 8086 0b00 0 ioatdma - - 00:00:52.085 I/OAT 0000:00:01.3 8086 0b00 0 ioatdma - - 00:00:52.085 I/OAT 0000:00:01.4 8086 0b00 0 ioatdma - - 00:00:52.085 I/OAT 0000:00:01.5 8086 0b00 0 ioatdma - - 00:00:52.085 I/OAT 0000:00:01.6 8086 0b00 0 ioatdma - - 00:00:52.085 I/OAT 0000:00:01.7 8086 0b00 0 ioatdma - - 00:00:52.085 NVMe 0000:65:00.0 144d a80a 0 nvme nvme0 nvme0n1 00:00:52.085 I/OAT 0000:80:01.0 8086 0b00 1 ioatdma - - 00:00:52.085 I/OAT 0000:80:01.1 8086 0b00 1 ioatdma - - 00:00:52.085 I/OAT 0000:80:01.2 8086 0b00 1 ioatdma - - 00:00:52.086 I/OAT 0000:80:01.3 8086 0b00 1 ioatdma - - 00:00:52.086 I/OAT 0000:80:01.4 8086 0b00 1 ioatdma - - 00:00:52.086 I/OAT 0000:80:01.5 8086 0b00 1 ioatdma - - 00:00:52.086 I/OAT 0000:80:01.6 8086 0b00 1 ioatdma - - 00:00:52.086 I/OAT 0000:80:01.7 8086 0b00 1 ioatdma - - 00:00:52.086 + rm -f /tmp/spdk-ld-path 00:00:52.086 + source autorun-spdk.conf 00:00:52.086 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:52.086 ++ SPDK_TEST_NVMF=1 00:00:52.086 ++ SPDK_TEST_NVME_CLI=1 00:00:52.086 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:52.086 ++ SPDK_TEST_NVMF_NICS=e810 00:00:52.086 ++ SPDK_RUN_UBSAN=1 00:00:52.086 ++ NET_TYPE=phy 00:00:52.086 ++ RUN_NIGHTLY=1 00:00:52.086 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:00:52.086 + [[ -n '' ]] 00:00:52.086 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:52.351 + for M in /var/spdk/build-*-manifest.txt 00:00:52.351 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:00:52.351 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:52.351 + for M in /var/spdk/build-*-manifest.txt 00:00:52.351 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:00:52.351 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:52.351 ++ uname 00:00:52.351 + [[ Linux == \L\i\n\u\x ]] 00:00:52.351 + sudo dmesg -T 00:00:52.351 + sudo dmesg --clear 00:00:52.351 + dmesg_pid=3730713 00:00:52.351 + [[ Fedora Linux == FreeBSD ]] 00:00:52.351 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:52.351 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:52.351 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:00:52.351 + export VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:00:52.351 + VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:00:52.351 + [[ -x /usr/src/fio-static/fio ]] 00:00:52.351 + export FIO_BIN=/usr/src/fio-static/fio 00:00:52.351 + FIO_BIN=/usr/src/fio-static/fio 00:00:52.351 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:00:52.351 + sudo dmesg -Tw 00:00:52.351 + [[ ! -v VFIO_QEMU_BIN ]] 00:00:52.351 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:00:52.351 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:52.352 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:52.352 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:00:52.352 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:52.352 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:52.352 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:52.352 Test configuration: 00:00:52.352 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:52.352 SPDK_TEST_NVMF=1 00:00:52.352 SPDK_TEST_NVME_CLI=1 00:00:52.352 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:52.352 SPDK_TEST_NVMF_NICS=e810 00:00:52.352 SPDK_RUN_UBSAN=1 00:00:52.352 NET_TYPE=phy 00:00:52.352 RUN_NIGHTLY=1 20:18:10 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:00:52.352 20:18:10 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:00:52.352 20:18:10 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:00:52.352 20:18:10 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:00:52.352 20:18:10 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:52.352 20:18:10 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:52.352 20:18:10 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:52.352 20:18:10 -- paths/export.sh@5 -- $ export PATH 00:00:52.352 20:18:10 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:52.352 20:18:10 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:00:52.352 20:18:10 -- common/autobuild_common.sh@435 -- $ date +%s 00:00:52.352 20:18:10 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714155490.XXXXXX 00:00:52.352 20:18:10 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714155490.Xw9JjQ 00:00:52.352 20:18:10 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:00:52.352 20:18:10 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:00:52.352 20:18:10 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:00:52.352 20:18:10 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:00:52.352 20:18:10 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:00:52.352 20:18:10 -- common/autobuild_common.sh@451 -- $ get_config_params 00:00:52.352 20:18:10 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:00:52.352 20:18:10 -- common/autotest_common.sh@10 -- $ set +x 00:00:52.352 20:18:10 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:00:52.352 20:18:10 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:00:52.352 20:18:10 -- spdk/autobuild.sh@12 -- $ umask 022 00:00:52.352 20:18:10 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:52.352 20:18:10 -- spdk/autobuild.sh@16 -- $ date -u 00:00:52.352 Fri Apr 26 06:18:10 PM UTC 2024 00:00:52.352 20:18:10 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:00:52.352 LTS-24-g36faa8c31 00:00:52.352 20:18:10 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:00:52.352 20:18:10 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:00:52.352 20:18:10 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:00:52.352 20:18:10 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:00:52.352 20:18:10 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:00:52.352 20:18:10 -- common/autotest_common.sh@10 -- $ set +x 00:00:52.352 ************************************ 00:00:52.352 START TEST ubsan 00:00:52.352 ************************************ 00:00:52.352 20:18:10 -- common/autotest_common.sh@1104 -- $ echo 'using ubsan' 00:00:52.352 using ubsan 00:00:52.352 00:00:52.352 real 0m0.001s 00:00:52.352 user 0m0.000s 00:00:52.352 sys 0m0.000s 00:00:52.352 20:18:10 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:00:52.352 20:18:10 -- common/autotest_common.sh@10 -- $ set +x 00:00:52.352 ************************************ 00:00:52.352 END TEST ubsan 00:00:52.352 ************************************ 00:00:52.613 20:18:10 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:00:52.613 20:18:10 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:00:52.613 20:18:10 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:00:52.613 20:18:10 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:00:52.613 20:18:10 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:00:52.613 20:18:10 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:00:52.613 20:18:10 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:00:52.613 20:18:10 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:00:52.613 20:18:10 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:00:52.613 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:00:52.613 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:00:52.875 Using 'verbs' RDMA provider 00:01:08.353 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:20.594 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:20.594 Creating mk/config.mk...done. 00:01:20.594 Creating mk/cc.flags.mk...done. 00:01:20.594 Type 'make' to build. 00:01:20.594 20:18:37 -- spdk/autobuild.sh@69 -- $ run_test make make -j144 00:01:20.594 20:18:37 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:01:20.594 20:18:37 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:20.594 20:18:37 -- common/autotest_common.sh@10 -- $ set +x 00:01:20.594 ************************************ 00:01:20.594 START TEST make 00:01:20.594 ************************************ 00:01:20.594 20:18:37 -- common/autotest_common.sh@1104 -- $ make -j144 00:01:20.594 make[1]: Nothing to be done for 'all'. 00:01:28.734 The Meson build system 00:01:28.734 Version: 1.3.1 00:01:28.734 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:28.734 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:28.734 Build type: native build 00:01:28.734 Program cat found: YES (/usr/bin/cat) 00:01:28.734 Project name: DPDK 00:01:28.734 Project version: 23.11.0 00:01:28.734 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:28.734 C linker for the host machine: cc ld.bfd 2.39-16 00:01:28.734 Host machine cpu family: x86_64 00:01:28.734 Host machine cpu: x86_64 00:01:28.734 Message: ## Building in Developer Mode ## 00:01:28.734 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:28.734 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:28.734 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:28.734 Program python3 found: YES (/usr/bin/python3) 00:01:28.734 Program cat found: YES (/usr/bin/cat) 00:01:28.734 Compiler for C supports arguments -march=native: YES 00:01:28.734 Checking for size of "void *" : 8 00:01:28.734 Checking for size of "void *" : 8 (cached) 00:01:28.734 Library m found: YES 00:01:28.734 Library numa found: YES 00:01:28.734 Has header "numaif.h" : YES 00:01:28.734 Library fdt found: NO 00:01:28.734 Library execinfo found: NO 00:01:28.734 Has header "execinfo.h" : YES 00:01:28.734 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:28.734 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:28.734 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:28.734 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:28.734 Run-time dependency openssl found: YES 3.0.9 00:01:28.734 Run-time dependency libpcap found: YES 1.10.4 00:01:28.734 Has header "pcap.h" with dependency libpcap: YES 00:01:28.734 Compiler for C supports arguments -Wcast-qual: YES 00:01:28.734 Compiler for C supports arguments -Wdeprecated: YES 00:01:28.734 Compiler for C supports arguments -Wformat: YES 00:01:28.734 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:28.734 Compiler for C supports arguments -Wformat-security: NO 00:01:28.734 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:28.734 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:28.734 Compiler for C supports arguments -Wnested-externs: YES 00:01:28.734 Compiler for C supports arguments -Wold-style-definition: YES 00:01:28.734 Compiler for C supports arguments -Wpointer-arith: YES 00:01:28.734 Compiler for C supports arguments -Wsign-compare: YES 00:01:28.734 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:28.734 Compiler for C supports arguments -Wundef: YES 00:01:28.734 Compiler for C supports arguments -Wwrite-strings: YES 00:01:28.734 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:28.734 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:28.734 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:28.734 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:28.734 Program objdump found: YES (/usr/bin/objdump) 00:01:28.734 Compiler for C supports arguments -mavx512f: YES 00:01:28.734 Checking if "AVX512 checking" compiles: YES 00:01:28.734 Fetching value of define "__SSE4_2__" : 1 00:01:28.734 Fetching value of define "__AES__" : 1 00:01:28.734 Fetching value of define "__AVX__" : 1 00:01:28.734 Fetching value of define "__AVX2__" : 1 00:01:28.734 Fetching value of define "__AVX512BW__" : 1 00:01:28.734 Fetching value of define "__AVX512CD__" : 1 00:01:28.734 Fetching value of define "__AVX512DQ__" : 1 00:01:28.734 Fetching value of define "__AVX512F__" : 1 00:01:28.734 Fetching value of define "__AVX512VL__" : 1 00:01:28.734 Fetching value of define "__PCLMUL__" : 1 00:01:28.734 Fetching value of define "__RDRND__" : 1 00:01:28.734 Fetching value of define "__RDSEED__" : 1 00:01:28.734 Fetching value of define "__VPCLMULQDQ__" : 1 00:01:28.734 Fetching value of define "__znver1__" : (undefined) 00:01:28.734 Fetching value of define "__znver2__" : (undefined) 00:01:28.734 Fetching value of define "__znver3__" : (undefined) 00:01:28.734 Fetching value of define "__znver4__" : (undefined) 00:01:28.734 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:28.735 Message: lib/log: Defining dependency "log" 00:01:28.735 Message: lib/kvargs: Defining dependency "kvargs" 00:01:28.735 Message: lib/telemetry: Defining dependency "telemetry" 00:01:28.735 Checking for function "getentropy" : NO 00:01:28.735 Message: lib/eal: Defining dependency "eal" 00:01:28.735 Message: lib/ring: Defining dependency "ring" 00:01:28.735 Message: lib/rcu: Defining dependency "rcu" 00:01:28.735 Message: lib/mempool: Defining dependency "mempool" 00:01:28.735 Message: lib/mbuf: Defining dependency "mbuf" 00:01:28.735 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:28.735 Fetching value of define "__AVX512F__" : 1 (cached) 00:01:28.735 Fetching value of define "__AVX512BW__" : 1 (cached) 00:01:28.735 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:01:28.735 Fetching value of define "__AVX512VL__" : 1 (cached) 00:01:28.735 Fetching value of define "__VPCLMULQDQ__" : 1 (cached) 00:01:28.735 Compiler for C supports arguments -mpclmul: YES 00:01:28.735 Compiler for C supports arguments -maes: YES 00:01:28.735 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:28.735 Compiler for C supports arguments -mavx512bw: YES 00:01:28.735 Compiler for C supports arguments -mavx512dq: YES 00:01:28.735 Compiler for C supports arguments -mavx512vl: YES 00:01:28.735 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:28.735 Compiler for C supports arguments -mavx2: YES 00:01:28.735 Compiler for C supports arguments -mavx: YES 00:01:28.735 Message: lib/net: Defining dependency "net" 00:01:28.735 Message: lib/meter: Defining dependency "meter" 00:01:28.735 Message: lib/ethdev: Defining dependency "ethdev" 00:01:28.735 Message: lib/pci: Defining dependency "pci" 00:01:28.735 Message: lib/cmdline: Defining dependency "cmdline" 00:01:28.735 Message: lib/hash: Defining dependency "hash" 00:01:28.735 Message: lib/timer: Defining dependency "timer" 00:01:28.735 Message: lib/compressdev: Defining dependency "compressdev" 00:01:28.735 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:28.735 Message: lib/dmadev: Defining dependency "dmadev" 00:01:28.735 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:28.735 Message: lib/power: Defining dependency "power" 00:01:28.735 Message: lib/reorder: Defining dependency "reorder" 00:01:28.735 Message: lib/security: Defining dependency "security" 00:01:28.735 Has header "linux/userfaultfd.h" : YES 00:01:28.735 Has header "linux/vduse.h" : YES 00:01:28.735 Message: lib/vhost: Defining dependency "vhost" 00:01:28.735 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:28.735 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:28.735 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:28.735 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:28.735 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:28.735 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:28.735 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:28.735 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:28.735 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:28.735 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:28.735 Program doxygen found: YES (/usr/bin/doxygen) 00:01:28.735 Configuring doxy-api-html.conf using configuration 00:01:28.735 Configuring doxy-api-man.conf using configuration 00:01:28.735 Program mandb found: YES (/usr/bin/mandb) 00:01:28.735 Program sphinx-build found: NO 00:01:28.735 Configuring rte_build_config.h using configuration 00:01:28.735 Message: 00:01:28.735 ================= 00:01:28.735 Applications Enabled 00:01:28.735 ================= 00:01:28.735 00:01:28.735 apps: 00:01:28.735 00:01:28.735 00:01:28.735 Message: 00:01:28.735 ================= 00:01:28.735 Libraries Enabled 00:01:28.735 ================= 00:01:28.735 00:01:28.735 libs: 00:01:28.735 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:28.735 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:28.735 cryptodev, dmadev, power, reorder, security, vhost, 00:01:28.735 00:01:28.735 Message: 00:01:28.735 =============== 00:01:28.735 Drivers Enabled 00:01:28.735 =============== 00:01:28.735 00:01:28.735 common: 00:01:28.735 00:01:28.735 bus: 00:01:28.735 pci, vdev, 00:01:28.735 mempool: 00:01:28.735 ring, 00:01:28.735 dma: 00:01:28.735 00:01:28.735 net: 00:01:28.735 00:01:28.735 crypto: 00:01:28.735 00:01:28.735 compress: 00:01:28.735 00:01:28.735 vdpa: 00:01:28.735 00:01:28.735 00:01:28.735 Message: 00:01:28.735 ================= 00:01:28.735 Content Skipped 00:01:28.735 ================= 00:01:28.735 00:01:28.735 apps: 00:01:28.735 dumpcap: explicitly disabled via build config 00:01:28.735 graph: explicitly disabled via build config 00:01:28.735 pdump: explicitly disabled via build config 00:01:28.735 proc-info: explicitly disabled via build config 00:01:28.735 test-acl: explicitly disabled via build config 00:01:28.735 test-bbdev: explicitly disabled via build config 00:01:28.735 test-cmdline: explicitly disabled via build config 00:01:28.735 test-compress-perf: explicitly disabled via build config 00:01:28.735 test-crypto-perf: explicitly disabled via build config 00:01:28.735 test-dma-perf: explicitly disabled via build config 00:01:28.735 test-eventdev: explicitly disabled via build config 00:01:28.735 test-fib: explicitly disabled via build config 00:01:28.735 test-flow-perf: explicitly disabled via build config 00:01:28.735 test-gpudev: explicitly disabled via build config 00:01:28.735 test-mldev: explicitly disabled via build config 00:01:28.735 test-pipeline: explicitly disabled via build config 00:01:28.735 test-pmd: explicitly disabled via build config 00:01:28.735 test-regex: explicitly disabled via build config 00:01:28.735 test-sad: explicitly disabled via build config 00:01:28.735 test-security-perf: explicitly disabled via build config 00:01:28.735 00:01:28.735 libs: 00:01:28.735 metrics: explicitly disabled via build config 00:01:28.735 acl: explicitly disabled via build config 00:01:28.735 bbdev: explicitly disabled via build config 00:01:28.735 bitratestats: explicitly disabled via build config 00:01:28.735 bpf: explicitly disabled via build config 00:01:28.735 cfgfile: explicitly disabled via build config 00:01:28.735 distributor: explicitly disabled via build config 00:01:28.735 efd: explicitly disabled via build config 00:01:28.735 eventdev: explicitly disabled via build config 00:01:28.735 dispatcher: explicitly disabled via build config 00:01:28.735 gpudev: explicitly disabled via build config 00:01:28.735 gro: explicitly disabled via build config 00:01:28.735 gso: explicitly disabled via build config 00:01:28.735 ip_frag: explicitly disabled via build config 00:01:28.735 jobstats: explicitly disabled via build config 00:01:28.735 latencystats: explicitly disabled via build config 00:01:28.735 lpm: explicitly disabled via build config 00:01:28.735 member: explicitly disabled via build config 00:01:28.735 pcapng: explicitly disabled via build config 00:01:28.735 rawdev: explicitly disabled via build config 00:01:28.735 regexdev: explicitly disabled via build config 00:01:28.735 mldev: explicitly disabled via build config 00:01:28.735 rib: explicitly disabled via build config 00:01:28.735 sched: explicitly disabled via build config 00:01:28.735 stack: explicitly disabled via build config 00:01:28.735 ipsec: explicitly disabled via build config 00:01:28.735 pdcp: explicitly disabled via build config 00:01:28.735 fib: explicitly disabled via build config 00:01:28.735 port: explicitly disabled via build config 00:01:28.735 pdump: explicitly disabled via build config 00:01:28.735 table: explicitly disabled via build config 00:01:28.735 pipeline: explicitly disabled via build config 00:01:28.735 graph: explicitly disabled via build config 00:01:28.735 node: explicitly disabled via build config 00:01:28.735 00:01:28.735 drivers: 00:01:28.735 common/cpt: not in enabled drivers build config 00:01:28.735 common/dpaax: not in enabled drivers build config 00:01:28.735 common/iavf: not in enabled drivers build config 00:01:28.735 common/idpf: not in enabled drivers build config 00:01:28.735 common/mvep: not in enabled drivers build config 00:01:28.735 common/octeontx: not in enabled drivers build config 00:01:28.735 bus/auxiliary: not in enabled drivers build config 00:01:28.735 bus/cdx: not in enabled drivers build config 00:01:28.735 bus/dpaa: not in enabled drivers build config 00:01:28.735 bus/fslmc: not in enabled drivers build config 00:01:28.735 bus/ifpga: not in enabled drivers build config 00:01:28.735 bus/platform: not in enabled drivers build config 00:01:28.735 bus/vmbus: not in enabled drivers build config 00:01:28.735 common/cnxk: not in enabled drivers build config 00:01:28.735 common/mlx5: not in enabled drivers build config 00:01:28.735 common/nfp: not in enabled drivers build config 00:01:28.735 common/qat: not in enabled drivers build config 00:01:28.735 common/sfc_efx: not in enabled drivers build config 00:01:28.735 mempool/bucket: not in enabled drivers build config 00:01:28.735 mempool/cnxk: not in enabled drivers build config 00:01:28.735 mempool/dpaa: not in enabled drivers build config 00:01:28.735 mempool/dpaa2: not in enabled drivers build config 00:01:28.735 mempool/octeontx: not in enabled drivers build config 00:01:28.735 mempool/stack: not in enabled drivers build config 00:01:28.735 dma/cnxk: not in enabled drivers build config 00:01:28.735 dma/dpaa: not in enabled drivers build config 00:01:28.735 dma/dpaa2: not in enabled drivers build config 00:01:28.735 dma/hisilicon: not in enabled drivers build config 00:01:28.735 dma/idxd: not in enabled drivers build config 00:01:28.735 dma/ioat: not in enabled drivers build config 00:01:28.735 dma/skeleton: not in enabled drivers build config 00:01:28.735 net/af_packet: not in enabled drivers build config 00:01:28.735 net/af_xdp: not in enabled drivers build config 00:01:28.735 net/ark: not in enabled drivers build config 00:01:28.735 net/atlantic: not in enabled drivers build config 00:01:28.735 net/avp: not in enabled drivers build config 00:01:28.735 net/axgbe: not in enabled drivers build config 00:01:28.735 net/bnx2x: not in enabled drivers build config 00:01:28.735 net/bnxt: not in enabled drivers build config 00:01:28.735 net/bonding: not in enabled drivers build config 00:01:28.735 net/cnxk: not in enabled drivers build config 00:01:28.735 net/cpfl: not in enabled drivers build config 00:01:28.735 net/cxgbe: not in enabled drivers build config 00:01:28.735 net/dpaa: not in enabled drivers build config 00:01:28.735 net/dpaa2: not in enabled drivers build config 00:01:28.736 net/e1000: not in enabled drivers build config 00:01:28.736 net/ena: not in enabled drivers build config 00:01:28.736 net/enetc: not in enabled drivers build config 00:01:28.736 net/enetfec: not in enabled drivers build config 00:01:28.736 net/enic: not in enabled drivers build config 00:01:28.736 net/failsafe: not in enabled drivers build config 00:01:28.736 net/fm10k: not in enabled drivers build config 00:01:28.736 net/gve: not in enabled drivers build config 00:01:28.736 net/hinic: not in enabled drivers build config 00:01:28.736 net/hns3: not in enabled drivers build config 00:01:28.736 net/i40e: not in enabled drivers build config 00:01:28.736 net/iavf: not in enabled drivers build config 00:01:28.736 net/ice: not in enabled drivers build config 00:01:28.736 net/idpf: not in enabled drivers build config 00:01:28.736 net/igc: not in enabled drivers build config 00:01:28.736 net/ionic: not in enabled drivers build config 00:01:28.736 net/ipn3ke: not in enabled drivers build config 00:01:28.736 net/ixgbe: not in enabled drivers build config 00:01:28.736 net/mana: not in enabled drivers build config 00:01:28.736 net/memif: not in enabled drivers build config 00:01:28.736 net/mlx4: not in enabled drivers build config 00:01:28.736 net/mlx5: not in enabled drivers build config 00:01:28.736 net/mvneta: not in enabled drivers build config 00:01:28.736 net/mvpp2: not in enabled drivers build config 00:01:28.736 net/netvsc: not in enabled drivers build config 00:01:28.736 net/nfb: not in enabled drivers build config 00:01:28.736 net/nfp: not in enabled drivers build config 00:01:28.736 net/ngbe: not in enabled drivers build config 00:01:28.736 net/null: not in enabled drivers build config 00:01:28.736 net/octeontx: not in enabled drivers build config 00:01:28.736 net/octeon_ep: not in enabled drivers build config 00:01:28.736 net/pcap: not in enabled drivers build config 00:01:28.736 net/pfe: not in enabled drivers build config 00:01:28.736 net/qede: not in enabled drivers build config 00:01:28.736 net/ring: not in enabled drivers build config 00:01:28.736 net/sfc: not in enabled drivers build config 00:01:28.736 net/softnic: not in enabled drivers build config 00:01:28.736 net/tap: not in enabled drivers build config 00:01:28.736 net/thunderx: not in enabled drivers build config 00:01:28.736 net/txgbe: not in enabled drivers build config 00:01:28.736 net/vdev_netvsc: not in enabled drivers build config 00:01:28.736 net/vhost: not in enabled drivers build config 00:01:28.736 net/virtio: not in enabled drivers build config 00:01:28.736 net/vmxnet3: not in enabled drivers build config 00:01:28.736 raw/*: missing internal dependency, "rawdev" 00:01:28.736 crypto/armv8: not in enabled drivers build config 00:01:28.736 crypto/bcmfs: not in enabled drivers build config 00:01:28.736 crypto/caam_jr: not in enabled drivers build config 00:01:28.736 crypto/ccp: not in enabled drivers build config 00:01:28.736 crypto/cnxk: not in enabled drivers build config 00:01:28.736 crypto/dpaa_sec: not in enabled drivers build config 00:01:28.736 crypto/dpaa2_sec: not in enabled drivers build config 00:01:28.736 crypto/ipsec_mb: not in enabled drivers build config 00:01:28.736 crypto/mlx5: not in enabled drivers build config 00:01:28.736 crypto/mvsam: not in enabled drivers build config 00:01:28.736 crypto/nitrox: not in enabled drivers build config 00:01:28.736 crypto/null: not in enabled drivers build config 00:01:28.736 crypto/octeontx: not in enabled drivers build config 00:01:28.736 crypto/openssl: not in enabled drivers build config 00:01:28.736 crypto/scheduler: not in enabled drivers build config 00:01:28.736 crypto/uadk: not in enabled drivers build config 00:01:28.736 crypto/virtio: not in enabled drivers build config 00:01:28.736 compress/isal: not in enabled drivers build config 00:01:28.736 compress/mlx5: not in enabled drivers build config 00:01:28.736 compress/octeontx: not in enabled drivers build config 00:01:28.736 compress/zlib: not in enabled drivers build config 00:01:28.736 regex/*: missing internal dependency, "regexdev" 00:01:28.736 ml/*: missing internal dependency, "mldev" 00:01:28.736 vdpa/ifc: not in enabled drivers build config 00:01:28.736 vdpa/mlx5: not in enabled drivers build config 00:01:28.736 vdpa/nfp: not in enabled drivers build config 00:01:28.736 vdpa/sfc: not in enabled drivers build config 00:01:28.736 event/*: missing internal dependency, "eventdev" 00:01:28.736 baseband/*: missing internal dependency, "bbdev" 00:01:28.736 gpu/*: missing internal dependency, "gpudev" 00:01:28.736 00:01:28.736 00:01:28.736 Build targets in project: 84 00:01:28.736 00:01:28.736 DPDK 23.11.0 00:01:28.736 00:01:28.736 User defined options 00:01:28.736 buildtype : debug 00:01:28.736 default_library : shared 00:01:28.736 libdir : lib 00:01:28.736 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:28.736 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:28.736 c_link_args : 00:01:28.736 cpu_instruction_set: native 00:01:28.736 disable_apps : dumpcap,graph,pdump,proc-info,test-acl,test-bbdev,test-cmdline,test-compress-perf,test-crypto-perf,test-dma-perf,test-eventdev,test-fib,test-flow-perf,test-gpudev,test-mldev,test-pipeline,test-pmd,test-regex,test-sad,test-security-perf,test 00:01:28.736 disable_libs : acl,bbdev,bitratestats,bpf,cfgfile,dispatcher,distributor,efd,eventdev,fib,gpudev,graph,gro,gso,ip_frag,ipsec,jobstats,latencystats,lpm,member,metrics,mldev,node,pcapng,pdcp,pdump,pipeline,port,rawdev,regexdev,rib,sched,stack,table 00:01:28.736 enable_docs : false 00:01:28.736 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:28.736 enable_kmods : false 00:01:28.736 tests : false 00:01:28.736 00:01:28.736 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:28.736 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:28.736 [1/264] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:28.736 [2/264] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:28.736 [3/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:28.736 [4/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:28.736 [5/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:28.736 [6/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:28.736 [7/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:28.736 [8/264] Linking static target lib/librte_kvargs.a 00:01:28.736 [9/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:28.736 [10/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:28.736 [11/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:28.736 [12/264] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:28.736 [13/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:28.736 [14/264] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:28.736 [15/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:28.736 [16/264] Linking static target lib/librte_log.a 00:01:28.736 [17/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:28.736 [18/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:28.736 [19/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:28.736 [20/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:28.736 [21/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:28.736 [22/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:28.736 [23/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:28.736 [24/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:28.736 [25/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:28.736 [26/264] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:28.736 [27/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:28.736 [28/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:28.736 [29/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:28.736 [30/264] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:28.736 [31/264] Linking static target lib/librte_pci.a 00:01:28.736 [32/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:28.736 [33/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:28.736 [34/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:28.736 [35/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:28.736 [36/264] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:28.736 [37/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:28.736 [38/264] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:28.736 [39/264] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:28.736 [40/264] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:28.736 [41/264] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:28.736 [42/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:28.996 [43/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:28.996 [44/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:28.996 [45/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:28.996 [46/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:28.996 [47/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:28.996 [48/264] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:28.996 [49/264] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.996 [50/264] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:28.996 [51/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:28.996 [52/264] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.996 [53/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:28.996 [54/264] Compiling C object lib/librte_net.a.p/net_net_crc_avx512.c.o 00:01:28.996 [55/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:28.996 [56/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:28.996 [57/264] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:28.996 [58/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:28.996 [59/264] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:28.996 [60/264] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:28.996 [61/264] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:28.996 [62/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:28.996 [63/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:28.996 [64/264] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:28.996 [65/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:28.997 [66/264] Linking static target lib/librte_ring.a 00:01:28.997 [67/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:28.997 [68/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:28.997 [69/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:28.997 [70/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:28.997 [71/264] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:28.997 [72/264] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:28.997 [73/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:28.997 [74/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:28.997 [75/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:28.997 [76/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:28.997 [77/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:28.997 [78/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:28.997 [79/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:28.997 [80/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:28.997 [81/264] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:28.997 [82/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:28.997 [83/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:28.997 [84/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:28.997 [85/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:28.997 [86/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:29.258 [87/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:29.258 [88/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:29.258 [89/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:29.258 [90/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:29.258 [91/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:29.258 [92/264] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:29.258 [93/264] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:29.258 [94/264] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:29.258 [95/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:29.258 [96/264] Linking static target lib/librte_meter.a 00:01:29.259 [97/264] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:29.259 [98/264] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:29.259 [99/264] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:29.259 [100/264] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:29.259 [101/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:29.259 [102/264] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:29.259 [103/264] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:29.259 [104/264] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:29.259 [105/264] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:29.259 [106/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:29.259 [107/264] Linking static target lib/librte_timer.a 00:01:29.259 [108/264] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:29.259 [109/264] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:29.259 [110/264] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:29.259 [111/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:29.259 [112/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:29.259 [113/264] Linking static target lib/librte_telemetry.a 00:01:29.259 [114/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:29.259 [115/264] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:29.259 [116/264] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:29.259 [117/264] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:29.259 [118/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:29.259 [119/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:29.259 [120/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:29.259 [121/264] Linking static target lib/librte_dmadev.a 00:01:29.259 [122/264] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:29.259 [123/264] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:29.259 [124/264] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:29.259 [125/264] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:29.259 [126/264] Linking static target lib/librte_cmdline.a 00:01:29.259 [127/264] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:29.259 [128/264] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:29.259 [129/264] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:29.259 [130/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:29.259 [131/264] Linking static target lib/librte_net.a 00:01:29.259 [132/264] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:29.259 [133/264] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:29.259 [134/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:29.259 [135/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:29.259 [136/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:29.259 [137/264] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:29.259 [138/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:29.259 [139/264] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:29.259 [140/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:29.259 [141/264] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.259 [142/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:29.259 [143/264] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:29.259 [144/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:29.259 [145/264] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:29.259 [146/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:29.259 [147/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:29.259 [148/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:29.259 [149/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:29.259 [150/264] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:29.259 [151/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:29.259 [152/264] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:29.259 [153/264] Linking static target lib/librte_mempool.a 00:01:29.259 [154/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:29.259 [155/264] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:29.259 [156/264] Linking target lib/librte_log.so.24.0 00:01:29.259 [157/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:29.259 [158/264] Linking static target lib/librte_power.a 00:01:29.259 [159/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:29.259 [160/264] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:29.259 [161/264] Linking static target lib/librte_compressdev.a 00:01:29.259 [162/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:29.259 [163/264] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:29.259 [164/264] Linking static target lib/librte_rcu.a 00:01:29.259 [165/264] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:29.259 [166/264] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:29.259 [167/264] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:29.259 [168/264] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:29.259 [169/264] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:29.259 [170/264] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:29.259 [171/264] Linking static target lib/librte_eal.a 00:01:29.259 [172/264] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:29.259 [173/264] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:29.259 [174/264] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:29.259 [175/264] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:29.259 [176/264] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:29.259 [177/264] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:29.259 [178/264] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:29.259 [179/264] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:29.259 [180/264] Linking static target lib/librte_reorder.a 00:01:29.259 [181/264] Linking static target lib/librte_security.a 00:01:29.521 [182/264] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.521 [183/264] Linking static target drivers/librte_bus_vdev.a 00:01:29.521 [184/264] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.521 [185/264] Linking target lib/librte_kvargs.so.24.0 00:01:29.521 [186/264] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:29.521 [187/264] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:29.521 [188/264] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:29.521 [189/264] Linking static target lib/librte_mbuf.a 00:01:29.521 [190/264] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:29.521 [191/264] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:29.521 [192/264] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:29.521 [193/264] Linking static target lib/librte_hash.a 00:01:29.521 [194/264] Linking static target drivers/librte_bus_pci.a 00:01:29.521 [195/264] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:29.521 [196/264] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.521 [197/264] Linking static target drivers/librte_mempool_ring.a 00:01:29.521 [198/264] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:29.521 [199/264] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:29.521 [200/264] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:29.521 [201/264] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:29.521 [202/264] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.521 [203/264] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:29.521 [204/264] Linking static target lib/librte_cryptodev.a 00:01:29.782 [205/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:29.782 [206/264] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.782 [207/264] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.782 [208/264] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.782 [209/264] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.782 [210/264] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:29.782 [211/264] Linking target lib/librte_telemetry.so.24.0 00:01:29.782 [212/264] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.043 [213/264] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:30.043 [214/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:30.043 [215/264] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.043 [216/264] Linking static target lib/librte_ethdev.a 00:01:30.043 [217/264] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.304 [218/264] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.304 [219/264] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.304 [220/264] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.304 [221/264] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.304 [222/264] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.565 [223/264] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.826 [224/264] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:30.826 [225/264] Linking static target lib/librte_vhost.a 00:01:31.767 [226/264] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.191 [227/264] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.555 [228/264] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.101 [229/264] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.101 [230/264] Linking target lib/librte_eal.so.24.0 00:01:41.101 [231/264] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:41.101 [232/264] Linking target lib/librte_ring.so.24.0 00:01:41.101 [233/264] Linking target lib/librte_meter.so.24.0 00:01:41.101 [234/264] Linking target lib/librte_timer.so.24.0 00:01:41.101 [235/264] Linking target lib/librte_pci.so.24.0 00:01:41.101 [236/264] Linking target lib/librte_dmadev.so.24.0 00:01:41.101 [237/264] Linking target drivers/librte_bus_vdev.so.24.0 00:01:41.101 [238/264] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:41.101 [239/264] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:41.101 [240/264] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:41.101 [241/264] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:41.101 [242/264] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:41.101 [243/264] Linking target lib/librte_rcu.so.24.0 00:01:41.101 [244/264] Linking target lib/librte_mempool.so.24.0 00:01:41.101 [245/264] Linking target drivers/librte_bus_pci.so.24.0 00:01:41.363 [246/264] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:41.363 [247/264] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:41.363 [248/264] Linking target lib/librte_mbuf.so.24.0 00:01:41.363 [249/264] Linking target drivers/librte_mempool_ring.so.24.0 00:01:41.624 [250/264] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:41.624 [251/264] Linking target lib/librte_compressdev.so.24.0 00:01:41.624 [252/264] Linking target lib/librte_reorder.so.24.0 00:01:41.624 [253/264] Linking target lib/librte_net.so.24.0 00:01:41.624 [254/264] Linking target lib/librte_cryptodev.so.24.0 00:01:41.624 [255/264] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:41.624 [256/264] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:41.885 [257/264] Linking target lib/librte_hash.so.24.0 00:01:41.885 [258/264] Linking target lib/librte_cmdline.so.24.0 00:01:41.885 [259/264] Linking target lib/librte_ethdev.so.24.0 00:01:41.885 [260/264] Linking target lib/librte_security.so.24.0 00:01:41.885 [261/264] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:41.885 [262/264] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:41.886 [263/264] Linking target lib/librte_power.so.24.0 00:01:42.147 [264/264] Linking target lib/librte_vhost.so.24.0 00:01:42.147 INFO: autodetecting backend as ninja 00:01:42.147 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 144 00:01:43.091 CC lib/ut_mock/mock.o 00:01:43.091 CC lib/ut/ut.o 00:01:43.091 CC lib/log/log.o 00:01:43.091 CC lib/log/log_flags.o 00:01:43.091 CC lib/log/log_deprecated.o 00:01:43.091 LIB libspdk_ut_mock.a 00:01:43.091 SO libspdk_ut_mock.so.5.0 00:01:43.091 LIB libspdk_ut.a 00:01:43.091 LIB libspdk_log.a 00:01:43.091 SO libspdk_ut.so.1.0 00:01:43.091 SO libspdk_log.so.6.1 00:01:43.091 SYMLINK libspdk_ut_mock.so 00:01:43.091 SYMLINK libspdk_ut.so 00:01:43.353 SYMLINK libspdk_log.so 00:01:43.353 CC lib/util/base64.o 00:01:43.353 CC lib/util/bit_array.o 00:01:43.353 CC lib/util/cpuset.o 00:01:43.353 CC lib/util/crc32.o 00:01:43.353 CC lib/util/crc16.o 00:01:43.353 CC lib/util/crc64.o 00:01:43.353 CC lib/ioat/ioat.o 00:01:43.353 CC lib/util/crc32c.o 00:01:43.353 CC lib/util/crc32_ieee.o 00:01:43.353 CC lib/util/dif.o 00:01:43.353 CC lib/util/fd.o 00:01:43.353 CC lib/util/file.o 00:01:43.353 CC lib/util/hexlify.o 00:01:43.353 CC lib/util/iov.o 00:01:43.353 CC lib/util/math.o 00:01:43.353 CC lib/util/pipe.o 00:01:43.353 CC lib/util/strerror_tls.o 00:01:43.353 CC lib/util/string.o 00:01:43.353 CC lib/util/uuid.o 00:01:43.353 CC lib/util/fd_group.o 00:01:43.353 CC lib/util/xor.o 00:01:43.353 CC lib/dma/dma.o 00:01:43.353 CC lib/util/zipf.o 00:01:43.353 CXX lib/trace_parser/trace.o 00:01:43.614 CC lib/vfio_user/host/vfio_user_pci.o 00:01:43.614 CC lib/vfio_user/host/vfio_user.o 00:01:43.614 LIB libspdk_dma.a 00:01:43.614 SO libspdk_dma.so.3.0 00:01:43.614 LIB libspdk_ioat.a 00:01:43.614 SYMLINK libspdk_dma.so 00:01:43.875 SO libspdk_ioat.so.6.0 00:01:43.875 LIB libspdk_vfio_user.a 00:01:43.875 SYMLINK libspdk_ioat.so 00:01:43.875 SO libspdk_vfio_user.so.4.0 00:01:43.875 LIB libspdk_util.a 00:01:43.875 SYMLINK libspdk_vfio_user.so 00:01:43.875 SO libspdk_util.so.8.0 00:01:44.135 SYMLINK libspdk_util.so 00:01:44.135 LIB libspdk_trace_parser.a 00:01:44.135 SO libspdk_trace_parser.so.4.0 00:01:44.135 CC lib/conf/conf.o 00:01:44.396 CC lib/json/json_util.o 00:01:44.396 CC lib/json/json_parse.o 00:01:44.396 CC lib/json/json_write.o 00:01:44.396 CC lib/vmd/vmd.o 00:01:44.396 CC lib/vmd/led.o 00:01:44.396 CC lib/env_dpdk/env.o 00:01:44.396 CC lib/env_dpdk/memory.o 00:01:44.396 CC lib/env_dpdk/pci.o 00:01:44.396 CC lib/env_dpdk/init.o 00:01:44.396 CC lib/rdma/common.o 00:01:44.396 CC lib/env_dpdk/threads.o 00:01:44.396 CC lib/idxd/idxd.o 00:01:44.396 CC lib/rdma/rdma_verbs.o 00:01:44.397 CC lib/env_dpdk/pci_ioat.o 00:01:44.397 CC lib/idxd/idxd_user.o 00:01:44.397 CC lib/env_dpdk/pci_virtio.o 00:01:44.397 CC lib/env_dpdk/pci_idxd.o 00:01:44.397 CC lib/env_dpdk/pci_vmd.o 00:01:44.397 CC lib/env_dpdk/pci_event.o 00:01:44.397 CC lib/env_dpdk/sigbus_handler.o 00:01:44.397 CC lib/env_dpdk/pci_dpdk.o 00:01:44.397 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:44.397 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:44.397 SYMLINK libspdk_trace_parser.so 00:01:44.397 LIB libspdk_conf.a 00:01:44.397 SO libspdk_conf.so.5.0 00:01:44.397 SYMLINK libspdk_conf.so 00:01:44.657 LIB libspdk_json.a 00:01:44.657 LIB libspdk_rdma.a 00:01:44.657 SO libspdk_json.so.5.1 00:01:44.657 SO libspdk_rdma.so.5.0 00:01:44.657 SYMLINK libspdk_json.so 00:01:44.657 SYMLINK libspdk_rdma.so 00:01:44.657 LIB libspdk_idxd.a 00:01:44.919 SO libspdk_idxd.so.11.0 00:01:44.919 LIB libspdk_vmd.a 00:01:44.919 CC lib/jsonrpc/jsonrpc_server.o 00:01:44.919 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:44.919 CC lib/jsonrpc/jsonrpc_client.o 00:01:44.919 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:44.919 SYMLINK libspdk_idxd.so 00:01:44.919 SO libspdk_vmd.so.5.0 00:01:44.919 SYMLINK libspdk_vmd.so 00:01:45.179 LIB libspdk_jsonrpc.a 00:01:45.179 SO libspdk_jsonrpc.so.5.1 00:01:45.179 SYMLINK libspdk_jsonrpc.so 00:01:45.440 CC lib/rpc/rpc.o 00:01:45.440 LIB libspdk_env_dpdk.a 00:01:45.440 SO libspdk_env_dpdk.so.13.0 00:01:45.701 LIB libspdk_rpc.a 00:01:45.701 SYMLINK libspdk_env_dpdk.so 00:01:45.701 SO libspdk_rpc.so.5.0 00:01:45.701 SYMLINK libspdk_rpc.so 00:01:45.962 CC lib/sock/sock.o 00:01:45.962 CC lib/sock/sock_rpc.o 00:01:45.962 CC lib/notify/notify.o 00:01:45.962 CC lib/notify/notify_rpc.o 00:01:45.962 CC lib/trace/trace_rpc.o 00:01:45.962 CC lib/trace/trace.o 00:01:45.962 CC lib/trace/trace_flags.o 00:01:46.223 LIB libspdk_notify.a 00:01:46.223 SO libspdk_notify.so.5.0 00:01:46.223 LIB libspdk_trace.a 00:01:46.223 SO libspdk_trace.so.9.0 00:01:46.223 SYMLINK libspdk_notify.so 00:01:46.223 LIB libspdk_sock.a 00:01:46.223 SYMLINK libspdk_trace.so 00:01:46.223 SO libspdk_sock.so.8.0 00:01:46.483 SYMLINK libspdk_sock.so 00:01:46.483 CC lib/thread/iobuf.o 00:01:46.483 CC lib/thread/thread.o 00:01:46.483 CC lib/nvme/nvme_ctrlr_cmd.o 00:01:46.483 CC lib/nvme/nvme_ctrlr.o 00:01:46.483 CC lib/nvme/nvme_ns.o 00:01:46.483 CC lib/nvme/nvme_fabric.o 00:01:46.483 CC lib/nvme/nvme_ns_cmd.o 00:01:46.483 CC lib/nvme/nvme_pcie_common.o 00:01:46.483 CC lib/nvme/nvme.o 00:01:46.483 CC lib/nvme/nvme_pcie.o 00:01:46.483 CC lib/nvme/nvme_qpair.o 00:01:46.483 CC lib/nvme/nvme_quirks.o 00:01:46.483 CC lib/nvme/nvme_transport.o 00:01:46.744 CC lib/nvme/nvme_discovery.o 00:01:46.744 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:01:46.744 CC lib/nvme/nvme_tcp.o 00:01:46.744 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:01:46.744 CC lib/nvme/nvme_opal.o 00:01:46.744 CC lib/nvme/nvme_io_msg.o 00:01:46.744 CC lib/nvme/nvme_poll_group.o 00:01:46.744 CC lib/nvme/nvme_zns.o 00:01:46.744 CC lib/nvme/nvme_cuse.o 00:01:46.744 CC lib/nvme/nvme_vfio_user.o 00:01:46.744 CC lib/nvme/nvme_rdma.o 00:01:47.687 LIB libspdk_thread.a 00:01:47.687 SO libspdk_thread.so.9.0 00:01:47.948 SYMLINK libspdk_thread.so 00:01:47.948 CC lib/virtio/virtio.o 00:01:47.948 CC lib/virtio/virtio_vhost_user.o 00:01:47.948 CC lib/blob/blobstore.o 00:01:47.948 CC lib/virtio/virtio_vfio_user.o 00:01:47.948 CC lib/blob/request.o 00:01:47.948 CC lib/virtio/virtio_pci.o 00:01:47.948 CC lib/blob/zeroes.o 00:01:47.948 CC lib/blob/blob_bs_dev.o 00:01:48.210 CC lib/accel/accel.o 00:01:48.210 CC lib/accel/accel_rpc.o 00:01:48.210 CC lib/init/json_config.o 00:01:48.210 CC lib/accel/accel_sw.o 00:01:48.210 CC lib/init/subsystem.o 00:01:48.210 CC lib/init/subsystem_rpc.o 00:01:48.210 CC lib/init/rpc.o 00:01:48.210 LIB libspdk_init.a 00:01:48.472 LIB libspdk_nvme.a 00:01:48.472 SO libspdk_init.so.4.0 00:01:48.472 LIB libspdk_virtio.a 00:01:48.472 SO libspdk_virtio.so.6.0 00:01:48.472 SYMLINK libspdk_init.so 00:01:48.472 SO libspdk_nvme.so.12.0 00:01:48.472 SYMLINK libspdk_virtio.so 00:01:48.733 CC lib/event/app.o 00:01:48.733 CC lib/event/reactor.o 00:01:48.733 CC lib/event/log_rpc.o 00:01:48.733 CC lib/event/app_rpc.o 00:01:48.733 CC lib/event/scheduler_static.o 00:01:48.733 SYMLINK libspdk_nvme.so 00:01:48.995 LIB libspdk_accel.a 00:01:48.995 SO libspdk_accel.so.14.0 00:01:48.995 LIB libspdk_event.a 00:01:48.995 SYMLINK libspdk_accel.so 00:01:48.995 SO libspdk_event.so.12.0 00:01:49.257 SYMLINK libspdk_event.so 00:01:49.257 CC lib/bdev/bdev.o 00:01:49.257 CC lib/bdev/bdev_rpc.o 00:01:49.257 CC lib/bdev/bdev_zone.o 00:01:49.257 CC lib/bdev/part.o 00:01:49.257 CC lib/bdev/scsi_nvme.o 00:01:50.645 LIB libspdk_blob.a 00:01:50.645 SO libspdk_blob.so.10.1 00:01:50.645 SYMLINK libspdk_blob.so 00:01:50.645 CC lib/lvol/lvol.o 00:01:50.645 CC lib/blobfs/blobfs.o 00:01:50.645 CC lib/blobfs/tree.o 00:01:51.587 LIB libspdk_blobfs.a 00:01:51.587 LIB libspdk_bdev.a 00:01:51.587 SO libspdk_blobfs.so.9.0 00:01:51.587 LIB libspdk_lvol.a 00:01:51.587 SO libspdk_bdev.so.14.0 00:01:51.587 SO libspdk_lvol.so.9.1 00:01:51.587 SYMLINK libspdk_blobfs.so 00:01:51.587 SYMLINK libspdk_bdev.so 00:01:51.587 SYMLINK libspdk_lvol.so 00:01:51.848 CC lib/ftl/ftl_core.o 00:01:51.848 CC lib/ftl/ftl_init.o 00:01:51.848 CC lib/ftl/ftl_layout.o 00:01:51.848 CC lib/ftl/ftl_debug.o 00:01:51.848 CC lib/ftl/ftl_io.o 00:01:51.848 CC lib/ftl/ftl_l2p.o 00:01:51.848 CC lib/ftl/ftl_sb.o 00:01:51.848 CC lib/ftl/ftl_l2p_flat.o 00:01:51.848 CC lib/ftl/ftl_nv_cache.o 00:01:51.848 CC lib/ftl/ftl_band.o 00:01:51.848 CC lib/ftl/ftl_band_ops.o 00:01:51.848 CC lib/ftl/ftl_writer.o 00:01:51.848 CC lib/nvmf/ctrlr.o 00:01:51.848 CC lib/nvmf/ctrlr_bdev.o 00:01:51.848 CC lib/ftl/ftl_reloc.o 00:01:51.848 CC lib/ftl/ftl_rq.o 00:01:51.848 CC lib/nvmf/ctrlr_discovery.o 00:01:51.848 CC lib/ftl/ftl_p2l.o 00:01:51.848 CC lib/nvmf/subsystem.o 00:01:51.848 CC lib/ftl/ftl_l2p_cache.o 00:01:51.848 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:01:51.848 CC lib/nvmf/nvmf.o 00:01:51.848 CC lib/ftl/mngt/ftl_mngt.o 00:01:51.848 CC lib/nbd/nbd.o 00:01:51.848 CC lib/nvmf/nvmf_rpc.o 00:01:51.848 CC lib/scsi/dev.o 00:01:51.848 CC lib/nvmf/tcp.o 00:01:51.848 CC lib/nvmf/transport.o 00:01:51.848 CC lib/nbd/nbd_rpc.o 00:01:51.848 CC lib/scsi/lun.o 00:01:51.848 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:01:51.848 CC lib/scsi/scsi.o 00:01:51.848 CC lib/ublk/ublk.o 00:01:51.848 CC lib/scsi/port.o 00:01:51.848 CC lib/ftl/mngt/ftl_mngt_startup.o 00:01:51.848 CC lib/nvmf/rdma.o 00:01:51.848 CC lib/ublk/ublk_rpc.o 00:01:51.848 CC lib/ftl/mngt/ftl_mngt_md.o 00:01:51.848 CC lib/scsi/scsi_rpc.o 00:01:51.848 CC lib/scsi/scsi_bdev.o 00:01:51.848 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:01:51.848 CC lib/ftl/mngt/ftl_mngt_misc.o 00:01:51.848 CC lib/scsi/scsi_pr.o 00:01:51.848 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:01:51.848 CC lib/scsi/task.o 00:01:51.848 CC lib/ftl/mngt/ftl_mngt_band.o 00:01:51.848 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:01:51.848 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:01:51.848 CC lib/ftl/utils/ftl_conf.o 00:01:51.848 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:01:51.848 CC lib/ftl/utils/ftl_md.o 00:01:51.848 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:01:51.848 CC lib/ftl/utils/ftl_mempool.o 00:01:51.848 CC lib/ftl/utils/ftl_property.o 00:01:51.848 CC lib/ftl/utils/ftl_bitmap.o 00:01:51.848 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:01:51.848 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:01:51.848 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:01:51.848 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:01:51.848 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:01:51.848 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:01:51.848 CC lib/ftl/upgrade/ftl_sb_v3.o 00:01:51.848 CC lib/ftl/upgrade/ftl_sb_v5.o 00:01:51.848 CC lib/ftl/nvc/ftl_nvc_dev.o 00:01:51.848 CC lib/ftl/base/ftl_base_dev.o 00:01:51.848 CC lib/ftl/base/ftl_base_bdev.o 00:01:51.848 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:01:51.848 CC lib/ftl/ftl_trace.o 00:01:52.418 LIB libspdk_nbd.a 00:01:52.418 SO libspdk_nbd.so.6.0 00:01:52.418 LIB libspdk_scsi.a 00:01:52.418 SYMLINK libspdk_nbd.so 00:01:52.418 SO libspdk_scsi.so.8.0 00:01:52.418 LIB libspdk_ublk.a 00:01:52.418 SYMLINK libspdk_scsi.so 00:01:52.418 SO libspdk_ublk.so.2.0 00:01:52.679 SYMLINK libspdk_ublk.so 00:01:52.679 LIB libspdk_ftl.a 00:01:52.679 CC lib/vhost/vhost.o 00:01:52.679 CC lib/vhost/vhost_rpc.o 00:01:52.679 CC lib/vhost/vhost_scsi.o 00:01:52.679 CC lib/vhost/vhost_blk.o 00:01:52.679 CC lib/vhost/rte_vhost_user.o 00:01:52.679 CC lib/iscsi/conn.o 00:01:52.679 CC lib/iscsi/init_grp.o 00:01:52.679 CC lib/iscsi/iscsi.o 00:01:52.679 CC lib/iscsi/md5.o 00:01:52.679 CC lib/iscsi/param.o 00:01:52.679 CC lib/iscsi/portal_grp.o 00:01:52.679 CC lib/iscsi/tgt_node.o 00:01:52.679 CC lib/iscsi/iscsi_subsystem.o 00:01:52.679 CC lib/iscsi/iscsi_rpc.o 00:01:52.679 CC lib/iscsi/task.o 00:01:52.941 SO libspdk_ftl.so.8.0 00:01:53.202 SYMLINK libspdk_ftl.so 00:01:53.464 LIB libspdk_nvmf.a 00:01:53.725 SO libspdk_nvmf.so.17.0 00:01:53.725 LIB libspdk_vhost.a 00:01:53.725 SO libspdk_vhost.so.7.1 00:01:53.725 SYMLINK libspdk_nvmf.so 00:01:53.725 SYMLINK libspdk_vhost.so 00:01:53.986 LIB libspdk_iscsi.a 00:01:53.986 SO libspdk_iscsi.so.7.0 00:01:54.247 SYMLINK libspdk_iscsi.so 00:01:54.509 CC module/env_dpdk/env_dpdk_rpc.o 00:01:54.509 CC module/accel/iaa/accel_iaa.o 00:01:54.509 CC module/blob/bdev/blob_bdev.o 00:01:54.509 CC module/accel/iaa/accel_iaa_rpc.o 00:01:54.509 CC module/accel/dsa/accel_dsa.o 00:01:54.509 CC module/accel/dsa/accel_dsa_rpc.o 00:01:54.509 CC module/accel/ioat/accel_ioat_rpc.o 00:01:54.509 CC module/accel/error/accel_error.o 00:01:54.509 CC module/accel/ioat/accel_ioat.o 00:01:54.509 CC module/accel/error/accel_error_rpc.o 00:01:54.509 CC module/scheduler/gscheduler/gscheduler.o 00:01:54.509 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:01:54.509 CC module/scheduler/dynamic/scheduler_dynamic.o 00:01:54.509 CC module/sock/posix/posix.o 00:01:54.509 LIB libspdk_env_dpdk_rpc.a 00:01:54.770 SO libspdk_env_dpdk_rpc.so.5.0 00:01:54.770 LIB libspdk_scheduler_gscheduler.a 00:01:54.770 LIB libspdk_scheduler_dpdk_governor.a 00:01:54.770 SYMLINK libspdk_env_dpdk_rpc.so 00:01:54.770 SO libspdk_scheduler_gscheduler.so.3.0 00:01:54.770 LIB libspdk_accel_iaa.a 00:01:54.770 LIB libspdk_accel_ioat.a 00:01:54.770 LIB libspdk_blob_bdev.a 00:01:54.770 SO libspdk_scheduler_dpdk_governor.so.3.0 00:01:54.770 LIB libspdk_accel_error.a 00:01:54.770 LIB libspdk_scheduler_dynamic.a 00:01:54.770 LIB libspdk_accel_dsa.a 00:01:54.770 SO libspdk_accel_iaa.so.2.0 00:01:54.770 SO libspdk_blob_bdev.so.10.1 00:01:54.770 SYMLINK libspdk_scheduler_gscheduler.so 00:01:54.770 SO libspdk_accel_ioat.so.5.0 00:01:54.770 SO libspdk_scheduler_dynamic.so.3.0 00:01:54.770 SO libspdk_accel_error.so.1.0 00:01:54.770 SO libspdk_accel_dsa.so.4.0 00:01:54.770 SYMLINK libspdk_scheduler_dpdk_governor.so 00:01:54.770 SYMLINK libspdk_accel_ioat.so 00:01:54.770 SYMLINK libspdk_accel_dsa.so 00:01:54.770 SYMLINK libspdk_blob_bdev.so 00:01:54.770 SYMLINK libspdk_accel_iaa.so 00:01:54.770 SYMLINK libspdk_scheduler_dynamic.so 00:01:54.770 SYMLINK libspdk_accel_error.so 00:01:55.343 CC module/bdev/delay/vbdev_delay.o 00:01:55.343 CC module/bdev/delay/vbdev_delay_rpc.o 00:01:55.343 CC module/bdev/zone_block/vbdev_zone_block.o 00:01:55.343 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:01:55.343 CC module/bdev/null/bdev_null.o 00:01:55.343 LIB libspdk_sock_posix.a 00:01:55.343 CC module/bdev/null/bdev_null_rpc.o 00:01:55.343 CC module/bdev/error/vbdev_error_rpc.o 00:01:55.343 CC module/bdev/error/vbdev_error.o 00:01:55.343 CC module/blobfs/bdev/blobfs_bdev.o 00:01:55.343 CC module/bdev/passthru/vbdev_passthru.o 00:01:55.343 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:01:55.343 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:01:55.343 CC module/bdev/virtio/bdev_virtio_scsi.o 00:01:55.343 CC module/bdev/virtio/bdev_virtio_blk.o 00:01:55.343 CC module/bdev/virtio/bdev_virtio_rpc.o 00:01:55.343 CC module/bdev/aio/bdev_aio.o 00:01:55.343 CC module/bdev/aio/bdev_aio_rpc.o 00:01:55.343 CC module/bdev/gpt/gpt.o 00:01:55.343 CC module/bdev/gpt/vbdev_gpt.o 00:01:55.343 CC module/bdev/split/vbdev_split.o 00:01:55.343 CC module/bdev/ftl/bdev_ftl.o 00:01:55.343 CC module/bdev/nvme/bdev_nvme.o 00:01:55.343 CC module/bdev/split/vbdev_split_rpc.o 00:01:55.343 CC module/bdev/malloc/bdev_malloc.o 00:01:55.343 CC module/bdev/malloc/bdev_malloc_rpc.o 00:01:55.343 CC module/bdev/ftl/bdev_ftl_rpc.o 00:01:55.343 CC module/bdev/nvme/bdev_nvme_rpc.o 00:01:55.343 CC module/bdev/nvme/nvme_rpc.o 00:01:55.343 CC module/bdev/nvme/vbdev_opal.o 00:01:55.343 CC module/bdev/nvme/bdev_mdns_client.o 00:01:55.343 CC module/bdev/nvme/vbdev_opal_rpc.o 00:01:55.343 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:01:55.343 CC module/bdev/raid/bdev_raid.o 00:01:55.343 CC module/bdev/lvol/vbdev_lvol.o 00:01:55.343 CC module/bdev/raid/bdev_raid_rpc.o 00:01:55.343 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:01:55.343 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:01:55.343 CC module/bdev/iscsi/bdev_iscsi.o 00:01:55.343 CC module/bdev/raid/bdev_raid_sb.o 00:01:55.343 CC module/bdev/raid/raid0.o 00:01:55.343 CC module/bdev/raid/raid1.o 00:01:55.343 CC module/bdev/raid/concat.o 00:01:55.343 SO libspdk_sock_posix.so.5.0 00:01:55.343 SYMLINK libspdk_sock_posix.so 00:01:55.343 LIB libspdk_blobfs_bdev.a 00:01:55.343 SO libspdk_blobfs_bdev.so.5.0 00:01:55.343 LIB libspdk_bdev_error.a 00:01:55.343 LIB libspdk_bdev_null.a 00:01:55.601 LIB libspdk_bdev_split.a 00:01:55.601 LIB libspdk_bdev_gpt.a 00:01:55.601 SYMLINK libspdk_blobfs_bdev.so 00:01:55.601 SO libspdk_bdev_error.so.5.0 00:01:55.601 LIB libspdk_bdev_ftl.a 00:01:55.601 LIB libspdk_bdev_passthru.a 00:01:55.601 LIB libspdk_bdev_zone_block.a 00:01:55.601 SO libspdk_bdev_null.so.5.0 00:01:55.601 SO libspdk_bdev_split.so.5.0 00:01:55.601 SO libspdk_bdev_ftl.so.5.0 00:01:55.601 SO libspdk_bdev_gpt.so.5.0 00:01:55.601 LIB libspdk_bdev_aio.a 00:01:55.601 LIB libspdk_bdev_delay.a 00:01:55.601 SO libspdk_bdev_zone_block.so.5.0 00:01:55.601 SO libspdk_bdev_passthru.so.5.0 00:01:55.601 LIB libspdk_bdev_malloc.a 00:01:55.601 SYMLINK libspdk_bdev_error.so 00:01:55.601 SYMLINK libspdk_bdev_null.so 00:01:55.601 LIB libspdk_bdev_iscsi.a 00:01:55.601 SO libspdk_bdev_aio.so.5.0 00:01:55.601 SO libspdk_bdev_delay.so.5.0 00:01:55.601 SYMLINK libspdk_bdev_ftl.so 00:01:55.601 SYMLINK libspdk_bdev_split.so 00:01:55.601 SO libspdk_bdev_malloc.so.5.0 00:01:55.601 SYMLINK libspdk_bdev_gpt.so 00:01:55.601 SO libspdk_bdev_iscsi.so.5.0 00:01:55.601 SYMLINK libspdk_bdev_zone_block.so 00:01:55.601 SYMLINK libspdk_bdev_passthru.so 00:01:55.601 SYMLINK libspdk_bdev_delay.so 00:01:55.601 SYMLINK libspdk_bdev_aio.so 00:01:55.601 SYMLINK libspdk_bdev_malloc.so 00:01:55.601 SYMLINK libspdk_bdev_iscsi.so 00:01:55.601 LIB libspdk_bdev_virtio.a 00:01:55.601 LIB libspdk_bdev_lvol.a 00:01:55.601 SO libspdk_bdev_virtio.so.5.0 00:01:55.601 SO libspdk_bdev_lvol.so.5.0 00:01:55.861 SYMLINK libspdk_bdev_virtio.so 00:01:55.861 SYMLINK libspdk_bdev_lvol.so 00:01:55.861 LIB libspdk_bdev_raid.a 00:01:56.121 SO libspdk_bdev_raid.so.5.0 00:01:56.121 SYMLINK libspdk_bdev_raid.so 00:01:56.381 LIB libspdk_bdev_nvme.a 00:01:56.641 SO libspdk_bdev_nvme.so.6.0 00:01:56.641 SYMLINK libspdk_bdev_nvme.so 00:01:57.213 CC module/event/subsystems/iobuf/iobuf.o 00:01:57.213 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:01:57.213 CC module/event/subsystems/vmd/vmd.o 00:01:57.213 CC module/event/subsystems/scheduler/scheduler.o 00:01:57.213 CC module/event/subsystems/vmd/vmd_rpc.o 00:01:57.213 CC module/event/subsystems/sock/sock.o 00:01:57.213 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:01:57.213 LIB libspdk_event_scheduler.a 00:01:57.213 LIB libspdk_event_iobuf.a 00:01:57.213 LIB libspdk_event_vmd.a 00:01:57.213 LIB libspdk_event_sock.a 00:01:57.213 LIB libspdk_event_vhost_blk.a 00:01:57.213 SO libspdk_event_scheduler.so.3.0 00:01:57.213 SO libspdk_event_vmd.so.5.0 00:01:57.213 SO libspdk_event_iobuf.so.2.0 00:01:57.213 SO libspdk_event_sock.so.4.0 00:01:57.213 SO libspdk_event_vhost_blk.so.2.0 00:01:57.474 SYMLINK libspdk_event_scheduler.so 00:01:57.474 SYMLINK libspdk_event_vmd.so 00:01:57.474 SYMLINK libspdk_event_sock.so 00:01:57.474 SYMLINK libspdk_event_vhost_blk.so 00:01:57.474 SYMLINK libspdk_event_iobuf.so 00:01:57.736 CC module/event/subsystems/accel/accel.o 00:01:57.736 LIB libspdk_event_accel.a 00:01:57.736 SO libspdk_event_accel.so.5.0 00:01:57.996 SYMLINK libspdk_event_accel.so 00:01:57.996 CC module/event/subsystems/bdev/bdev.o 00:01:58.257 LIB libspdk_event_bdev.a 00:01:58.257 SO libspdk_event_bdev.so.5.0 00:01:58.519 SYMLINK libspdk_event_bdev.so 00:01:58.519 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:01:58.519 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:01:58.519 CC module/event/subsystems/ublk/ublk.o 00:01:58.519 CC module/event/subsystems/scsi/scsi.o 00:01:58.519 CC module/event/subsystems/nbd/nbd.o 00:01:58.780 LIB libspdk_event_ublk.a 00:01:58.780 LIB libspdk_event_nbd.a 00:01:58.780 LIB libspdk_event_scsi.a 00:01:58.780 SO libspdk_event_ublk.so.2.0 00:01:58.780 SO libspdk_event_nbd.so.5.0 00:01:58.780 SO libspdk_event_scsi.so.5.0 00:01:58.780 LIB libspdk_event_nvmf.a 00:01:58.780 SO libspdk_event_nvmf.so.5.0 00:01:58.780 SYMLINK libspdk_event_ublk.so 00:01:58.780 SYMLINK libspdk_event_nbd.so 00:01:59.042 SYMLINK libspdk_event_scsi.so 00:01:59.042 SYMLINK libspdk_event_nvmf.so 00:01:59.042 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:01:59.042 CC module/event/subsystems/iscsi/iscsi.o 00:01:59.303 LIB libspdk_event_vhost_scsi.a 00:01:59.303 LIB libspdk_event_iscsi.a 00:01:59.303 SO libspdk_event_vhost_scsi.so.2.0 00:01:59.303 SO libspdk_event_iscsi.so.5.0 00:01:59.303 SYMLINK libspdk_event_vhost_scsi.so 00:01:59.563 SYMLINK libspdk_event_iscsi.so 00:01:59.563 SO libspdk.so.5.0 00:01:59.563 SYMLINK libspdk.so 00:01:59.823 CXX app/trace/trace.o 00:01:59.823 CC app/spdk_nvme_discover/discovery_aer.o 00:01:59.823 CC app/spdk_nvme_identify/identify.o 00:01:59.823 CC app/trace_record/trace_record.o 00:01:59.823 TEST_HEADER include/spdk/accel.h 00:01:59.823 CC app/spdk_top/spdk_top.o 00:01:59.823 TEST_HEADER include/spdk/assert.h 00:01:59.823 CC app/spdk_nvme_perf/perf.o 00:01:59.823 TEST_HEADER include/spdk/barrier.h 00:01:59.823 TEST_HEADER include/spdk/accel_module.h 00:01:59.823 TEST_HEADER include/spdk/base64.h 00:01:59.823 CC app/spdk_lspci/spdk_lspci.o 00:01:59.823 CC app/spdk_dd/spdk_dd.o 00:01:59.823 CC test/rpc_client/rpc_client_test.o 00:01:59.823 TEST_HEADER include/spdk/bdev.h 00:01:59.823 TEST_HEADER include/spdk/bdev_module.h 00:01:59.823 TEST_HEADER include/spdk/bit_array.h 00:01:59.823 TEST_HEADER include/spdk/bdev_zone.h 00:01:59.823 TEST_HEADER include/spdk/bit_pool.h 00:01:59.823 TEST_HEADER include/spdk/blob_bdev.h 00:01:59.823 TEST_HEADER include/spdk/blobfs_bdev.h 00:01:59.823 TEST_HEADER include/spdk/blob.h 00:01:59.823 TEST_HEADER include/spdk/conf.h 00:01:59.823 TEST_HEADER include/spdk/blobfs.h 00:01:59.823 CC app/iscsi_tgt/iscsi_tgt.o 00:01:59.823 TEST_HEADER include/spdk/config.h 00:01:59.823 TEST_HEADER include/spdk/cpuset.h 00:01:59.823 TEST_HEADER include/spdk/crc32.h 00:01:59.823 TEST_HEADER include/spdk/crc16.h 00:01:59.823 CC app/vhost/vhost.o 00:01:59.823 CC examples/interrupt_tgt/interrupt_tgt.o 00:01:59.823 TEST_HEADER include/spdk/dif.h 00:01:59.823 TEST_HEADER include/spdk/crc64.h 00:01:59.823 TEST_HEADER include/spdk/endian.h 00:01:59.823 TEST_HEADER include/spdk/dma.h 00:01:59.823 TEST_HEADER include/spdk/env_dpdk.h 00:01:59.823 TEST_HEADER include/spdk/event.h 00:01:59.823 TEST_HEADER include/spdk/env.h 00:01:59.823 TEST_HEADER include/spdk/file.h 00:01:59.823 TEST_HEADER include/spdk/fd.h 00:01:59.823 TEST_HEADER include/spdk/ftl.h 00:01:59.823 TEST_HEADER include/spdk/gpt_spec.h 00:01:59.823 TEST_HEADER include/spdk/fd_group.h 00:01:59.823 CC app/nvmf_tgt/nvmf_main.o 00:01:59.823 TEST_HEADER include/spdk/histogram_data.h 00:01:59.823 TEST_HEADER include/spdk/hexlify.h 00:01:59.823 CC app/spdk_tgt/spdk_tgt.o 00:01:59.823 TEST_HEADER include/spdk/idxd.h 00:01:59.823 TEST_HEADER include/spdk/idxd_spec.h 00:01:59.823 TEST_HEADER include/spdk/init.h 00:01:59.823 TEST_HEADER include/spdk/ioat.h 00:01:59.823 TEST_HEADER include/spdk/ioat_spec.h 00:01:59.823 TEST_HEADER include/spdk/iscsi_spec.h 00:01:59.823 TEST_HEADER include/spdk/json.h 00:01:59.823 TEST_HEADER include/spdk/log.h 00:01:59.823 TEST_HEADER include/spdk/likely.h 00:01:59.823 TEST_HEADER include/spdk/jsonrpc.h 00:01:59.823 TEST_HEADER include/spdk/memory.h 00:01:59.823 TEST_HEADER include/spdk/lvol.h 00:01:59.823 TEST_HEADER include/spdk/mmio.h 00:02:00.088 TEST_HEADER include/spdk/nbd.h 00:02:00.088 TEST_HEADER include/spdk/notify.h 00:02:00.088 TEST_HEADER include/spdk/nvme.h 00:02:00.088 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:00.088 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:00.088 TEST_HEADER include/spdk/nvme_intel.h 00:02:00.088 TEST_HEADER include/spdk/nvme_spec.h 00:02:00.088 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:00.088 TEST_HEADER include/spdk/nvme_zns.h 00:02:00.088 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:00.088 TEST_HEADER include/spdk/nvmf.h 00:02:00.088 TEST_HEADER include/spdk/nvmf_spec.h 00:02:00.088 TEST_HEADER include/spdk/nvmf_transport.h 00:02:00.088 TEST_HEADER include/spdk/opal.h 00:02:00.088 TEST_HEADER include/spdk/opal_spec.h 00:02:00.088 TEST_HEADER include/spdk/pci_ids.h 00:02:00.088 TEST_HEADER include/spdk/pipe.h 00:02:00.088 TEST_HEADER include/spdk/queue.h 00:02:00.088 TEST_HEADER include/spdk/reduce.h 00:02:00.088 TEST_HEADER include/spdk/rpc.h 00:02:00.088 TEST_HEADER include/spdk/scheduler.h 00:02:00.088 TEST_HEADER include/spdk/scsi.h 00:02:00.088 TEST_HEADER include/spdk/sock.h 00:02:00.088 TEST_HEADER include/spdk/scsi_spec.h 00:02:00.088 TEST_HEADER include/spdk/stdinc.h 00:02:00.088 TEST_HEADER include/spdk/string.h 00:02:00.088 TEST_HEADER include/spdk/thread.h 00:02:00.089 TEST_HEADER include/spdk/trace.h 00:02:00.089 TEST_HEADER include/spdk/tree.h 00:02:00.089 TEST_HEADER include/spdk/trace_parser.h 00:02:00.089 TEST_HEADER include/spdk/util.h 00:02:00.089 TEST_HEADER include/spdk/ublk.h 00:02:00.089 TEST_HEADER include/spdk/uuid.h 00:02:00.089 TEST_HEADER include/spdk/version.h 00:02:00.089 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:00.089 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:00.089 TEST_HEADER include/spdk/vhost.h 00:02:00.089 TEST_HEADER include/spdk/vmd.h 00:02:00.089 TEST_HEADER include/spdk/xor.h 00:02:00.089 TEST_HEADER include/spdk/zipf.h 00:02:00.089 CXX test/cpp_headers/accel.o 00:02:00.089 CXX test/cpp_headers/accel_module.o 00:02:00.089 CXX test/cpp_headers/barrier.o 00:02:00.089 CXX test/cpp_headers/assert.o 00:02:00.089 CC test/app/histogram_perf/histogram_perf.o 00:02:00.089 CXX test/cpp_headers/base64.o 00:02:00.089 CXX test/cpp_headers/bdev_module.o 00:02:00.089 CXX test/cpp_headers/bdev.o 00:02:00.089 CXX test/cpp_headers/bdev_zone.o 00:02:00.089 CXX test/cpp_headers/bit_pool.o 00:02:00.089 CXX test/cpp_headers/bit_array.o 00:02:00.089 CXX test/cpp_headers/blob_bdev.o 00:02:00.089 CXX test/cpp_headers/blobfs.o 00:02:00.089 CXX test/cpp_headers/blobfs_bdev.o 00:02:00.089 CC test/app/jsoncat/jsoncat.o 00:02:00.089 CC examples/idxd/perf/perf.o 00:02:00.089 CC test/nvme/err_injection/err_injection.o 00:02:00.089 CXX test/cpp_headers/conf.o 00:02:00.089 CXX test/cpp_headers/blob.o 00:02:00.089 CC examples/nvme/abort/abort.o 00:02:00.089 CXX test/cpp_headers/config.o 00:02:00.089 CXX test/cpp_headers/cpuset.o 00:02:00.089 CXX test/cpp_headers/crc16.o 00:02:00.089 CC examples/util/zipf/zipf.o 00:02:00.089 CXX test/cpp_headers/crc64.o 00:02:00.089 CXX test/cpp_headers/crc32.o 00:02:00.089 CC examples/vmd/led/led.o 00:02:00.089 CC examples/nvme/reconnect/reconnect.o 00:02:00.089 CXX test/cpp_headers/dif.o 00:02:00.089 CC examples/vmd/lsvmd/lsvmd.o 00:02:00.089 CXX test/cpp_headers/env_dpdk.o 00:02:00.089 CXX test/cpp_headers/endian.o 00:02:00.089 CXX test/cpp_headers/dma.o 00:02:00.089 CC examples/ioat/perf/perf.o 00:02:00.089 CC test/nvme/boot_partition/boot_partition.o 00:02:00.089 CXX test/cpp_headers/env.o 00:02:00.089 CXX test/cpp_headers/event.o 00:02:00.089 CXX test/cpp_headers/fd_group.o 00:02:00.089 CC test/env/memory/memory_ut.o 00:02:00.089 CXX test/cpp_headers/file.o 00:02:00.089 CC test/nvme/reset/reset.o 00:02:00.089 CXX test/cpp_headers/fd.o 00:02:00.089 CC examples/ioat/verify/verify.o 00:02:00.089 CC examples/sock/hello_world/hello_sock.o 00:02:00.089 CC test/nvme/e2edp/nvme_dp.o 00:02:00.089 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:00.089 CXX test/cpp_headers/gpt_spec.o 00:02:00.089 CC test/app/bdev_svc/bdev_svc.o 00:02:00.089 CC test/nvme/overhead/overhead.o 00:02:00.089 CXX test/cpp_headers/idxd.o 00:02:00.089 CXX test/cpp_headers/ftl.o 00:02:00.089 CC test/app/stub/stub.o 00:02:00.089 CXX test/cpp_headers/hexlify.o 00:02:00.089 CC examples/accel/perf/accel_perf.o 00:02:00.089 CC test/env/vtophys/vtophys.o 00:02:00.089 CXX test/cpp_headers/histogram_data.o 00:02:00.089 CC examples/nvme/arbitration/arbitration.o 00:02:00.089 CC test/thread/poller_perf/poller_perf.o 00:02:00.089 CXX test/cpp_headers/idxd_spec.o 00:02:00.089 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:00.089 CXX test/cpp_headers/init.o 00:02:00.089 CXX test/cpp_headers/ioat.o 00:02:00.089 CC test/nvme/sgl/sgl.o 00:02:00.089 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:00.089 CC examples/nvme/hello_world/hello_world.o 00:02:00.089 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:00.089 CXX test/cpp_headers/iscsi_spec.o 00:02:00.089 CC examples/blob/hello_world/hello_blob.o 00:02:00.089 CXX test/cpp_headers/ioat_spec.o 00:02:00.089 CXX test/cpp_headers/jsonrpc.o 00:02:00.089 CC test/nvme/aer/aer.o 00:02:00.089 CXX test/cpp_headers/json.o 00:02:00.089 CC test/env/pci/pci_ut.o 00:02:00.089 CC test/nvme/reserve/reserve.o 00:02:00.089 CXX test/cpp_headers/likely.o 00:02:00.089 CXX test/cpp_headers/log.o 00:02:00.089 CC test/nvme/compliance/nvme_compliance.o 00:02:00.089 CXX test/cpp_headers/lvol.o 00:02:00.089 CXX test/cpp_headers/memory.o 00:02:00.089 CXX test/cpp_headers/nbd.o 00:02:00.089 CXX test/cpp_headers/mmio.o 00:02:00.089 CC test/event/reactor/reactor.o 00:02:00.089 CC app/fio/nvme/fio_plugin.o 00:02:00.089 CC test/nvme/fused_ordering/fused_ordering.o 00:02:00.089 CC test/nvme/cuse/cuse.o 00:02:00.089 CC test/nvme/connect_stress/connect_stress.o 00:02:00.089 CXX test/cpp_headers/notify.o 00:02:00.089 CC examples/nvme/hotplug/hotplug.o 00:02:00.089 CC examples/blob/cli/blobcli.o 00:02:00.089 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:00.089 CXX test/cpp_headers/nvme_intel.o 00:02:00.089 CXX test/cpp_headers/nvme.o 00:02:00.089 CXX test/cpp_headers/nvme_ocssd.o 00:02:00.089 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:00.089 CXX test/cpp_headers/nvme_spec.o 00:02:00.089 CC test/event/reactor_perf/reactor_perf.o 00:02:00.089 CXX test/cpp_headers/nvme_zns.o 00:02:00.089 CC test/event/event_perf/event_perf.o 00:02:00.089 CC test/nvme/simple_copy/simple_copy.o 00:02:00.089 CC test/nvme/fdp/fdp.o 00:02:00.089 CXX test/cpp_headers/nvmf_cmd.o 00:02:00.089 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:00.089 CC test/nvme/startup/startup.o 00:02:00.089 CXX test/cpp_headers/nvmf.o 00:02:00.089 CXX test/cpp_headers/nvmf_transport.o 00:02:00.089 CC test/dma/test_dma/test_dma.o 00:02:00.089 CXX test/cpp_headers/nvmf_spec.o 00:02:00.089 CXX test/cpp_headers/opal.o 00:02:00.089 CXX test/cpp_headers/opal_spec.o 00:02:00.089 CXX test/cpp_headers/pci_ids.o 00:02:00.089 CC test/bdev/bdevio/bdevio.o 00:02:00.089 CXX test/cpp_headers/pipe.o 00:02:00.089 CC test/blobfs/mkfs/mkfs.o 00:02:00.089 CXX test/cpp_headers/queue.o 00:02:00.089 CXX test/cpp_headers/reduce.o 00:02:00.089 CC test/event/app_repeat/app_repeat.o 00:02:00.089 CXX test/cpp_headers/rpc.o 00:02:00.089 CC examples/bdev/hello_world/hello_bdev.o 00:02:00.089 CXX test/cpp_headers/scheduler.o 00:02:00.089 CC app/fio/bdev/fio_plugin.o 00:02:00.089 CC examples/thread/thread/thread_ex.o 00:02:00.089 CXX test/cpp_headers/scsi.o 00:02:00.089 CC examples/bdev/bdevperf/bdevperf.o 00:02:00.089 CC test/accel/dif/dif.o 00:02:00.089 CC examples/nvmf/nvmf/nvmf.o 00:02:00.089 CXX test/cpp_headers/scsi_spec.o 00:02:00.089 CC test/event/scheduler/scheduler.o 00:02:00.358 CXX test/cpp_headers/sock.o 00:02:00.358 LINK spdk_lspci 00:02:00.358 CC test/lvol/esnap/esnap.o 00:02:00.358 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:00.358 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:00.358 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:00.358 CC test/env/mem_callbacks/mem_callbacks.o 00:02:00.358 LINK spdk_nvme_discover 00:02:00.358 LINK interrupt_tgt 00:02:00.358 LINK nvmf_tgt 00:02:00.623 LINK spdk_tgt 00:02:00.623 LINK rpc_client_test 00:02:00.623 LINK vhost 00:02:00.623 LINK histogram_perf 00:02:00.623 LINK spdk_trace_record 00:02:00.623 LINK jsoncat 00:02:00.623 LINK iscsi_tgt 00:02:00.623 LINK vtophys 00:02:00.623 LINK boot_partition 00:02:00.623 LINK reactor_perf 00:02:00.623 LINK led 00:02:00.623 LINK lsvmd 00:02:00.623 LINK poller_perf 00:02:00.623 LINK zipf 00:02:00.623 LINK fused_ordering 00:02:00.623 LINK err_injection 00:02:00.623 LINK app_repeat 00:02:00.623 LINK reactor 00:02:00.623 LINK event_perf 00:02:00.623 LINK startup 00:02:00.881 LINK bdev_svc 00:02:00.881 LINK env_dpdk_post_init 00:02:00.881 LINK stub 00:02:00.881 LINK cmb_copy 00:02:00.881 CXX test/cpp_headers/stdinc.o 00:02:00.881 LINK reserve 00:02:00.881 LINK connect_stress 00:02:00.881 LINK doorbell_aers 00:02:00.881 LINK ioat_perf 00:02:00.881 LINK verify 00:02:00.881 LINK pmr_persistence 00:02:00.881 LINK sgl 00:02:00.881 LINK hotplug 00:02:00.881 LINK mkfs 00:02:00.881 LINK hello_sock 00:02:00.881 CXX test/cpp_headers/string.o 00:02:00.881 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:00.881 LINK hello_world 00:02:00.881 LINK hello_bdev 00:02:00.881 CXX test/cpp_headers/thread.o 00:02:00.881 LINK reset 00:02:00.881 LINK spdk_dd 00:02:00.881 CXX test/cpp_headers/trace.o 00:02:00.881 CXX test/cpp_headers/trace_parser.o 00:02:00.881 LINK nvme_dp 00:02:00.881 CXX test/cpp_headers/tree.o 00:02:00.881 CXX test/cpp_headers/ublk.o 00:02:00.881 CXX test/cpp_headers/util.o 00:02:00.881 CXX test/cpp_headers/uuid.o 00:02:00.881 CXX test/cpp_headers/version.o 00:02:00.881 CXX test/cpp_headers/vfio_user_pci.o 00:02:00.881 CXX test/cpp_headers/vfio_user_spec.o 00:02:00.881 LINK hello_blob 00:02:00.881 CXX test/cpp_headers/vhost.o 00:02:00.881 CXX test/cpp_headers/vmd.o 00:02:00.881 CXX test/cpp_headers/xor.o 00:02:00.881 CXX test/cpp_headers/zipf.o 00:02:00.881 LINK simple_copy 00:02:00.881 LINK reconnect 00:02:00.881 LINK overhead 00:02:00.881 LINK aer 00:02:00.881 LINK fdp 00:02:00.881 LINK thread 00:02:00.881 LINK scheduler 00:02:00.881 LINK idxd_perf 00:02:00.881 LINK arbitration 00:02:01.140 LINK nvme_compliance 00:02:01.140 LINK dif 00:02:01.140 LINK test_dma 00:02:01.140 LINK abort 00:02:01.140 LINK bdevio 00:02:01.140 LINK nvmf 00:02:01.140 LINK spdk_trace 00:02:01.140 LINK spdk_bdev 00:02:01.140 LINK pci_ut 00:02:01.140 LINK nvme_fuzz 00:02:01.140 LINK accel_perf 00:02:01.140 LINK spdk_nvme_perf 00:02:01.140 LINK spdk_nvme 00:02:01.140 LINK blobcli 00:02:01.140 LINK nvme_manage 00:02:01.401 LINK vhost_fuzz 00:02:01.401 LINK spdk_nvme_identify 00:02:01.401 LINK mem_callbacks 00:02:01.401 LINK bdevperf 00:02:01.401 LINK memory_ut 00:02:01.401 LINK spdk_top 00:02:01.666 LINK cuse 00:02:02.330 LINK iscsi_fuzz 00:02:04.243 LINK esnap 00:02:04.505 00:02:04.505 real 0m45.019s 00:02:04.505 user 6m13.036s 00:02:04.505 sys 4m18.245s 00:02:04.505 20:19:22 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:02:04.505 20:19:22 -- common/autotest_common.sh@10 -- $ set +x 00:02:04.505 ************************************ 00:02:04.505 END TEST make 00:02:04.505 ************************************ 00:02:04.768 20:19:22 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:04.768 20:19:22 -- nvmf/common.sh@7 -- # uname -s 00:02:04.768 20:19:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:04.768 20:19:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:04.768 20:19:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:04.768 20:19:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:04.768 20:19:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:04.768 20:19:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:04.768 20:19:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:04.768 20:19:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:04.768 20:19:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:04.768 20:19:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:04.768 20:19:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:02:04.768 20:19:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:02:04.768 20:19:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:04.768 20:19:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:04.768 20:19:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:04.768 20:19:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:04.768 20:19:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:04.768 20:19:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:04.768 20:19:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:04.768 20:19:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:04.768 20:19:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:04.768 20:19:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:04.768 20:19:22 -- paths/export.sh@5 -- # export PATH 00:02:04.768 20:19:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:04.768 20:19:22 -- nvmf/common.sh@46 -- # : 0 00:02:04.768 20:19:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:04.768 20:19:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:04.768 20:19:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:04.768 20:19:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:04.768 20:19:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:04.768 20:19:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:04.768 20:19:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:04.768 20:19:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:04.768 20:19:22 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:04.768 20:19:22 -- spdk/autotest.sh@32 -- # uname -s 00:02:04.768 20:19:22 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:04.768 20:19:22 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:04.768 20:19:22 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:04.768 20:19:22 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:04.768 20:19:22 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:04.768 20:19:22 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:04.768 20:19:22 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:04.768 20:19:22 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:04.768 20:19:22 -- spdk/autotest.sh@48 -- # udevadm_pid=3773032 00:02:04.768 20:19:22 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:04.768 20:19:22 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:04.768 20:19:22 -- spdk/autotest.sh@54 -- # echo 3773034 00:02:04.768 20:19:22 -- spdk/autotest.sh@56 -- # echo 3773035 00:02:04.768 20:19:22 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:04.768 20:19:22 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:04.768 20:19:22 -- spdk/autotest.sh@60 -- # echo 3773036 00:02:04.768 20:19:22 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:04.768 20:19:22 -- spdk/autotest.sh@62 -- # echo 3773037 00:02:04.768 20:19:22 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:04.768 20:19:22 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:04.768 20:19:22 -- common/autotest_common.sh@712 -- # xtrace_disable 00:02:04.768 20:19:22 -- common/autotest_common.sh@10 -- # set +x 00:02:04.768 20:19:22 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:04.768 20:19:22 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:04.768 20:19:22 -- spdk/autotest.sh@70 -- # create_test_list 00:02:04.768 20:19:22 -- common/autotest_common.sh@736 -- # xtrace_disable 00:02:04.768 20:19:22 -- common/autotest_common.sh@10 -- # set +x 00:02:04.768 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:04.768 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:04.768 20:19:22 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:04.768 20:19:22 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:04.768 20:19:22 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:04.768 20:19:22 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:04.768 20:19:22 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:04.768 20:19:22 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:04.768 20:19:22 -- common/autotest_common.sh@1440 -- # uname 00:02:04.768 20:19:22 -- common/autotest_common.sh@1440 -- # '[' Linux = FreeBSD ']' 00:02:04.768 20:19:22 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:04.768 20:19:22 -- common/autotest_common.sh@1460 -- # uname 00:02:04.768 20:19:22 -- common/autotest_common.sh@1460 -- # [[ Linux = FreeBSD ]] 00:02:04.768 20:19:22 -- spdk/autotest.sh@82 -- # grep CC_TYPE mk/cc.mk 00:02:04.768 20:19:22 -- spdk/autotest.sh@82 -- # CC_TYPE=CC_TYPE=gcc 00:02:04.768 20:19:22 -- spdk/autotest.sh@83 -- # hash lcov 00:02:04.768 20:19:22 -- spdk/autotest.sh@83 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:02:04.768 20:19:22 -- spdk/autotest.sh@91 -- # export 'LCOV_OPTS= 00:02:04.768 --rc lcov_branch_coverage=1 00:02:04.768 --rc lcov_function_coverage=1 00:02:04.768 --rc genhtml_branch_coverage=1 00:02:04.768 --rc genhtml_function_coverage=1 00:02:04.768 --rc genhtml_legend=1 00:02:04.768 --rc geninfo_all_blocks=1 00:02:04.768 ' 00:02:04.768 20:19:22 -- spdk/autotest.sh@91 -- # LCOV_OPTS=' 00:02:04.768 --rc lcov_branch_coverage=1 00:02:04.768 --rc lcov_function_coverage=1 00:02:04.768 --rc genhtml_branch_coverage=1 00:02:04.768 --rc genhtml_function_coverage=1 00:02:04.768 --rc genhtml_legend=1 00:02:04.768 --rc geninfo_all_blocks=1 00:02:04.768 ' 00:02:04.768 20:19:22 -- spdk/autotest.sh@92 -- # export 'LCOV=lcov 00:02:04.768 --rc lcov_branch_coverage=1 00:02:04.768 --rc lcov_function_coverage=1 00:02:04.768 --rc genhtml_branch_coverage=1 00:02:04.768 --rc genhtml_function_coverage=1 00:02:04.768 --rc genhtml_legend=1 00:02:04.768 --rc geninfo_all_blocks=1 00:02:04.768 --no-external' 00:02:04.768 20:19:22 -- spdk/autotest.sh@92 -- # LCOV='lcov 00:02:04.768 --rc lcov_branch_coverage=1 00:02:04.768 --rc lcov_function_coverage=1 00:02:04.768 --rc genhtml_branch_coverage=1 00:02:04.768 --rc genhtml_function_coverage=1 00:02:04.768 --rc genhtml_legend=1 00:02:04.768 --rc geninfo_all_blocks=1 00:02:04.768 --no-external' 00:02:04.768 20:19:22 -- spdk/autotest.sh@94 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:02:04.768 lcov: LCOV version 1.14 00:02:04.768 20:19:23 -- spdk/autotest.sh@96 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:12.902 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:12.902 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:12.902 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:12.902 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:12.902 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:12.902 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:27.815 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:27.815 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:28.076 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:28.076 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:28.076 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:28.076 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:28.076 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:28.076 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:28.076 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:28.076 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:28.076 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:28.076 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:28.076 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:28.076 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:28.076 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:28.076 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:28.077 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:28.077 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:28.338 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:28.338 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:28.599 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:28.599 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:28.599 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:28.599 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:28.599 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:28.599 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:28.599 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:28.599 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:28.599 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:28.599 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:28.599 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:28.599 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:28.599 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:28.599 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:28.599 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:28.599 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:28.599 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:28.599 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:28.599 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:28.599 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:28.599 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:28.599 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:02:31.901 20:19:49 -- spdk/autotest.sh@100 -- # timing_enter pre_cleanup 00:02:31.901 20:19:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:02:31.901 20:19:49 -- common/autotest_common.sh@10 -- # set +x 00:02:31.901 20:19:49 -- spdk/autotest.sh@102 -- # rm -f 00:02:31.901 20:19:49 -- spdk/autotest.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:35.204 0000:80:01.6 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:80:01.7 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:80:01.4 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:80:01.5 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:80:01.2 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:80:01.3 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:80:01.0 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:80:01.1 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:65:00.0 (144d a80a): Already using the nvme driver 00:02:35.204 0000:00:01.6 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:00:01.7 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:00:01.4 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:00:01.5 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:00:01.2 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:00:01.3 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:00:01.0 (8086 0b00): Already using the ioatdma driver 00:02:35.204 0000:00:01.1 (8086 0b00): Already using the ioatdma driver 00:02:35.204 20:19:53 -- spdk/autotest.sh@107 -- # get_zoned_devs 00:02:35.204 20:19:53 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:02:35.204 20:19:53 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:02:35.204 20:19:53 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:02:35.204 20:19:53 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:02:35.204 20:19:53 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:02:35.204 20:19:53 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:02:35.204 20:19:53 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:35.204 20:19:53 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:02:35.204 20:19:53 -- spdk/autotest.sh@109 -- # (( 0 > 0 )) 00:02:35.204 20:19:53 -- spdk/autotest.sh@121 -- # grep -v p 00:02:35.204 20:19:53 -- spdk/autotest.sh@121 -- # ls /dev/nvme0n1 00:02:35.204 20:19:53 -- spdk/autotest.sh@121 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:02:35.204 20:19:53 -- spdk/autotest.sh@123 -- # [[ -z '' ]] 00:02:35.204 20:19:53 -- spdk/autotest.sh@124 -- # block_in_use /dev/nvme0n1 00:02:35.204 20:19:53 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:02:35.204 20:19:53 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:35.204 No valid GPT data, bailing 00:02:35.204 20:19:53 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:35.204 20:19:53 -- scripts/common.sh@393 -- # pt= 00:02:35.204 20:19:53 -- scripts/common.sh@394 -- # return 1 00:02:35.204 20:19:53 -- spdk/autotest.sh@125 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:35.204 1+0 records in 00:02:35.204 1+0 records out 00:02:35.204 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00511044 s, 205 MB/s 00:02:35.204 20:19:53 -- spdk/autotest.sh@129 -- # sync 00:02:35.204 20:19:53 -- spdk/autotest.sh@131 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:35.204 20:19:53 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:35.204 20:19:53 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:43.338 20:20:01 -- spdk/autotest.sh@135 -- # uname -s 00:02:43.338 20:20:01 -- spdk/autotest.sh@135 -- # '[' Linux = Linux ']' 00:02:43.338 20:20:01 -- spdk/autotest.sh@136 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:43.338 20:20:01 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:43.338 20:20:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:43.338 20:20:01 -- common/autotest_common.sh@10 -- # set +x 00:02:43.338 ************************************ 00:02:43.338 START TEST setup.sh 00:02:43.338 ************************************ 00:02:43.338 20:20:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:43.338 * Looking for test storage... 00:02:43.338 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:43.338 20:20:01 -- setup/test-setup.sh@10 -- # uname -s 00:02:43.338 20:20:01 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:43.338 20:20:01 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:43.338 20:20:01 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:43.338 20:20:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:43.338 20:20:01 -- common/autotest_common.sh@10 -- # set +x 00:02:43.338 ************************************ 00:02:43.338 START TEST acl 00:02:43.338 ************************************ 00:02:43.338 20:20:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:43.338 * Looking for test storage... 00:02:43.338 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:43.338 20:20:01 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:43.338 20:20:01 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:02:43.338 20:20:01 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:02:43.338 20:20:01 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:02:43.338 20:20:01 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:02:43.338 20:20:01 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:02:43.338 20:20:01 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:02:43.338 20:20:01 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:43.338 20:20:01 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:02:43.338 20:20:01 -- setup/acl.sh@12 -- # devs=() 00:02:43.338 20:20:01 -- setup/acl.sh@12 -- # declare -a devs 00:02:43.338 20:20:01 -- setup/acl.sh@13 -- # drivers=() 00:02:43.338 20:20:01 -- setup/acl.sh@13 -- # declare -A drivers 00:02:43.338 20:20:01 -- setup/acl.sh@51 -- # setup reset 00:02:43.338 20:20:01 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:43.338 20:20:01 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:46.641 20:20:04 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:46.641 20:20:04 -- setup/acl.sh@16 -- # local dev driver 00:02:46.641 20:20:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:46.641 20:20:04 -- setup/acl.sh@15 -- # setup output status 00:02:46.641 20:20:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:46.641 20:20:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:02:49.947 Hugepages 00:02:49.947 node hugesize free / total 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 00:02:49.947 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:00:01.0 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:00:01.1 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:00:01.2 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:00:01.3 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:00:01.4 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:00:01.5 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:00:01.6 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:00:01.7 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:65:00.0 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\6\5\:\0\0\.\0* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:49.947 20:20:08 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:80:01.0 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:80:01.1 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:80:01.2 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:80:01.3 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:80:01.4 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:49.947 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:49.947 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:80:01.5 == *:*:*.* ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:49.947 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:50.209 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:50.209 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:80:01.6 == *:*:*.* ]] 00:02:50.209 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:50.209 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:50.209 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:50.209 20:20:08 -- setup/acl.sh@19 -- # [[ 0000:80:01.7 == *:*:*.* ]] 00:02:50.209 20:20:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:50.209 20:20:08 -- setup/acl.sh@20 -- # continue 00:02:50.209 20:20:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:50.209 20:20:08 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:50.209 20:20:08 -- setup/acl.sh@54 -- # run_test denied denied 00:02:50.209 20:20:08 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:50.209 20:20:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:50.209 20:20:08 -- common/autotest_common.sh@10 -- # set +x 00:02:50.209 ************************************ 00:02:50.209 START TEST denied 00:02:50.209 ************************************ 00:02:50.209 20:20:08 -- common/autotest_common.sh@1104 -- # denied 00:02:50.209 20:20:08 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:65:00.0' 00:02:50.209 20:20:08 -- setup/acl.sh@38 -- # setup output config 00:02:50.209 20:20:08 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:65:00.0' 00:02:50.209 20:20:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:50.209 20:20:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:53.516 0000:65:00.0 (144d a80a): Skipping denied controller at 0000:65:00.0 00:02:53.516 20:20:11 -- setup/acl.sh@40 -- # verify 0000:65:00.0 00:02:53.516 20:20:11 -- setup/acl.sh@28 -- # local dev driver 00:02:53.516 20:20:11 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:53.516 20:20:11 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:65:00.0 ]] 00:02:53.516 20:20:11 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:65:00.0/driver 00:02:53.516 20:20:11 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:53.516 20:20:11 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:53.516 20:20:11 -- setup/acl.sh@41 -- # setup reset 00:02:53.516 20:20:11 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:53.516 20:20:11 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:58.807 00:02:58.807 real 0m8.081s 00:02:58.807 user 0m2.653s 00:02:58.807 sys 0m4.759s 00:02:58.807 20:20:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:02:58.807 20:20:16 -- common/autotest_common.sh@10 -- # set +x 00:02:58.807 ************************************ 00:02:58.807 END TEST denied 00:02:58.807 ************************************ 00:02:58.807 20:20:16 -- setup/acl.sh@55 -- # run_test allowed allowed 00:02:58.807 20:20:16 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:58.807 20:20:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:58.807 20:20:16 -- common/autotest_common.sh@10 -- # set +x 00:02:58.807 ************************************ 00:02:58.807 START TEST allowed 00:02:58.807 ************************************ 00:02:58.807 20:20:16 -- common/autotest_common.sh@1104 -- # allowed 00:02:58.807 20:20:16 -- setup/acl.sh@46 -- # grep -E '0000:65:00.0 .*: nvme -> .*' 00:02:58.807 20:20:16 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:65:00.0 00:02:58.807 20:20:16 -- setup/acl.sh@45 -- # setup output config 00:02:58.807 20:20:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:58.807 20:20:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:04.153 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:03:04.153 20:20:21 -- setup/acl.sh@47 -- # verify 00:03:04.153 20:20:21 -- setup/acl.sh@28 -- # local dev driver 00:03:04.153 20:20:21 -- setup/acl.sh@48 -- # setup reset 00:03:04.153 20:20:21 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:04.153 20:20:21 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:07.482 00:03:07.482 real 0m8.945s 00:03:07.482 user 0m2.614s 00:03:07.482 sys 0m4.646s 00:03:07.482 20:20:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:07.482 20:20:25 -- common/autotest_common.sh@10 -- # set +x 00:03:07.482 ************************************ 00:03:07.482 END TEST allowed 00:03:07.482 ************************************ 00:03:07.482 00:03:07.482 real 0m24.106s 00:03:07.482 user 0m7.936s 00:03:07.482 sys 0m14.001s 00:03:07.482 20:20:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:07.482 20:20:25 -- common/autotest_common.sh@10 -- # set +x 00:03:07.482 ************************************ 00:03:07.482 END TEST acl 00:03:07.482 ************************************ 00:03:07.482 20:20:25 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:07.482 20:20:25 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:07.482 20:20:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:07.482 20:20:25 -- common/autotest_common.sh@10 -- # set +x 00:03:07.482 ************************************ 00:03:07.482 START TEST hugepages 00:03:07.482 ************************************ 00:03:07.482 20:20:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:07.482 * Looking for test storage... 00:03:07.482 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:07.482 20:20:25 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:07.482 20:20:25 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:07.483 20:20:25 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:07.483 20:20:25 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:07.483 20:20:25 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:07.483 20:20:25 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:07.483 20:20:25 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:07.483 20:20:25 -- setup/common.sh@18 -- # local node= 00:03:07.483 20:20:25 -- setup/common.sh@19 -- # local var val 00:03:07.483 20:20:25 -- setup/common.sh@20 -- # local mem_f mem 00:03:07.483 20:20:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:07.483 20:20:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:07.483 20:20:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:07.483 20:20:25 -- setup/common.sh@28 -- # mapfile -t mem 00:03:07.483 20:20:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 99145084 kB' 'MemAvailable: 103453164 kB' 'Buffers: 2696 kB' 'Cached: 18086052 kB' 'SwapCached: 0 kB' 'Active: 15015760 kB' 'Inactive: 3667940 kB' 'Active(anon): 13891816 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 598336 kB' 'Mapped: 196288 kB' 'Shmem: 13296864 kB' 'KReclaimable: 557140 kB' 'Slab: 1430036 kB' 'SReclaimable: 557140 kB' 'SUnreclaim: 872896 kB' 'KernelStack: 27632 kB' 'PageTables: 9836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69460904 kB' 'Committed_AS: 15404188 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235800 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.483 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.483 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # continue 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.484 20:20:25 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.484 20:20:25 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.484 20:20:25 -- setup/common.sh@33 -- # echo 2048 00:03:07.484 20:20:25 -- setup/common.sh@33 -- # return 0 00:03:07.484 20:20:25 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:07.484 20:20:25 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:07.484 20:20:25 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:07.484 20:20:25 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:07.484 20:20:25 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:07.484 20:20:25 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:07.484 20:20:25 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:07.484 20:20:25 -- setup/hugepages.sh@207 -- # get_nodes 00:03:07.484 20:20:25 -- setup/hugepages.sh@27 -- # local node 00:03:07.484 20:20:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:07.484 20:20:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:07.484 20:20:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:07.484 20:20:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:07.484 20:20:25 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:07.484 20:20:25 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:07.484 20:20:25 -- setup/hugepages.sh@208 -- # clear_hp 00:03:07.484 20:20:25 -- setup/hugepages.sh@37 -- # local node hp 00:03:07.484 20:20:25 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:07.484 20:20:25 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:07.484 20:20:25 -- setup/hugepages.sh@41 -- # echo 0 00:03:07.484 20:20:25 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:07.484 20:20:25 -- setup/hugepages.sh@41 -- # echo 0 00:03:07.484 20:20:25 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:07.484 20:20:25 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:07.484 20:20:25 -- setup/hugepages.sh@41 -- # echo 0 00:03:07.484 20:20:25 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:07.484 20:20:25 -- setup/hugepages.sh@41 -- # echo 0 00:03:07.484 20:20:25 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:07.484 20:20:25 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:07.484 20:20:25 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:07.484 20:20:25 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:07.484 20:20:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:07.484 20:20:25 -- common/autotest_common.sh@10 -- # set +x 00:03:07.484 ************************************ 00:03:07.484 START TEST default_setup 00:03:07.484 ************************************ 00:03:07.484 20:20:25 -- common/autotest_common.sh@1104 -- # default_setup 00:03:07.484 20:20:25 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:07.484 20:20:25 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:07.484 20:20:25 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:07.484 20:20:25 -- setup/hugepages.sh@51 -- # shift 00:03:07.484 20:20:25 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:07.484 20:20:25 -- setup/hugepages.sh@52 -- # local node_ids 00:03:07.484 20:20:25 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:07.484 20:20:25 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:07.484 20:20:25 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:07.484 20:20:25 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:07.484 20:20:25 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:07.484 20:20:25 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:07.484 20:20:25 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:07.484 20:20:25 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:07.484 20:20:25 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:07.484 20:20:25 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:07.484 20:20:25 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:07.484 20:20:25 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:07.484 20:20:25 -- setup/hugepages.sh@73 -- # return 0 00:03:07.484 20:20:25 -- setup/hugepages.sh@137 -- # setup output 00:03:07.484 20:20:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:07.484 20:20:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:10.792 0000:80:01.6 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:80:01.7 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:80:01.4 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:80:01.5 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:80:01.2 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:80:01.3 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:80:01.0 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:80:01.1 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:00:01.6 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:00:01.7 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:00:01.4 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:00:01.5 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:00:01.2 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:00:01.3 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:00:01.0 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:00:01.1 (8086 0b00): ioatdma -> vfio-pci 00:03:10.792 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:03:10.792 20:20:28 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:10.792 20:20:28 -- setup/hugepages.sh@89 -- # local node 00:03:10.792 20:20:28 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:10.792 20:20:28 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:10.792 20:20:28 -- setup/hugepages.sh@92 -- # local surp 00:03:10.792 20:20:28 -- setup/hugepages.sh@93 -- # local resv 00:03:10.792 20:20:28 -- setup/hugepages.sh@94 -- # local anon 00:03:10.792 20:20:28 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:10.792 20:20:28 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:10.792 20:20:28 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:10.792 20:20:28 -- setup/common.sh@18 -- # local node= 00:03:10.792 20:20:28 -- setup/common.sh@19 -- # local var val 00:03:10.792 20:20:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.792 20:20:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.792 20:20:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.792 20:20:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.792 20:20:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.792 20:20:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.792 20:20:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101310360 kB' 'MemAvailable: 105618408 kB' 'Buffers: 2696 kB' 'Cached: 18086176 kB' 'SwapCached: 0 kB' 'Active: 15030680 kB' 'Inactive: 3667940 kB' 'Active(anon): 13906736 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 613216 kB' 'Mapped: 196592 kB' 'Shmem: 13296988 kB' 'KReclaimable: 557108 kB' 'Slab: 1427704 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 870596 kB' 'KernelStack: 27600 kB' 'PageTables: 9796 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15423220 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235752 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.792 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.792 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.793 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.793 20:20:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.793 20:20:28 -- setup/common.sh@33 -- # echo 0 00:03:10.793 20:20:28 -- setup/common.sh@33 -- # return 0 00:03:10.793 20:20:28 -- setup/hugepages.sh@97 -- # anon=0 00:03:10.793 20:20:28 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:10.793 20:20:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:10.793 20:20:28 -- setup/common.sh@18 -- # local node= 00:03:10.794 20:20:28 -- setup/common.sh@19 -- # local var val 00:03:10.794 20:20:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.794 20:20:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.794 20:20:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.794 20:20:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.794 20:20:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.794 20:20:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101311304 kB' 'MemAvailable: 105619352 kB' 'Buffers: 2696 kB' 'Cached: 18086176 kB' 'SwapCached: 0 kB' 'Active: 15031580 kB' 'Inactive: 3667940 kB' 'Active(anon): 13907636 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 614228 kB' 'Mapped: 196592 kB' 'Shmem: 13296988 kB' 'KReclaimable: 557108 kB' 'Slab: 1427704 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 870596 kB' 'KernelStack: 27616 kB' 'PageTables: 10220 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15421716 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235768 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.794 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.794 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.795 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.795 20:20:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.796 20:20:28 -- setup/common.sh@33 -- # echo 0 00:03:10.796 20:20:28 -- setup/common.sh@33 -- # return 0 00:03:10.796 20:20:28 -- setup/hugepages.sh@99 -- # surp=0 00:03:10.796 20:20:28 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:10.796 20:20:28 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:10.796 20:20:28 -- setup/common.sh@18 -- # local node= 00:03:10.796 20:20:28 -- setup/common.sh@19 -- # local var val 00:03:10.796 20:20:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.796 20:20:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.796 20:20:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.796 20:20:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.796 20:20:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.796 20:20:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101311224 kB' 'MemAvailable: 105619272 kB' 'Buffers: 2696 kB' 'Cached: 18086188 kB' 'SwapCached: 0 kB' 'Active: 15030780 kB' 'Inactive: 3667940 kB' 'Active(anon): 13906836 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 613304 kB' 'Mapped: 196480 kB' 'Shmem: 13297000 kB' 'KReclaimable: 557108 kB' 'Slab: 1427624 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 870516 kB' 'KernelStack: 27616 kB' 'PageTables: 10088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15423248 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235784 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.796 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.796 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.797 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.797 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.798 20:20:28 -- setup/common.sh@33 -- # echo 0 00:03:10.798 20:20:28 -- setup/common.sh@33 -- # return 0 00:03:10.798 20:20:28 -- setup/hugepages.sh@100 -- # resv=0 00:03:10.798 20:20:28 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:10.798 nr_hugepages=1024 00:03:10.798 20:20:28 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:10.798 resv_hugepages=0 00:03:10.798 20:20:28 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:10.798 surplus_hugepages=0 00:03:10.798 20:20:28 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:10.798 anon_hugepages=0 00:03:10.798 20:20:28 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:10.798 20:20:28 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:10.798 20:20:28 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:10.798 20:20:28 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:10.798 20:20:28 -- setup/common.sh@18 -- # local node= 00:03:10.798 20:20:28 -- setup/common.sh@19 -- # local var val 00:03:10.798 20:20:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.798 20:20:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.798 20:20:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.798 20:20:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.798 20:20:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.798 20:20:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.798 20:20:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101310468 kB' 'MemAvailable: 105618516 kB' 'Buffers: 2696 kB' 'Cached: 18086200 kB' 'SwapCached: 0 kB' 'Active: 15030544 kB' 'Inactive: 3667940 kB' 'Active(anon): 13906600 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 612984 kB' 'Mapped: 196480 kB' 'Shmem: 13297012 kB' 'KReclaimable: 557108 kB' 'Slab: 1427616 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 870508 kB' 'KernelStack: 27600 kB' 'PageTables: 9840 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15421748 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235784 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.798 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.798 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.799 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.799 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.800 20:20:28 -- setup/common.sh@33 -- # echo 1024 00:03:10.800 20:20:28 -- setup/common.sh@33 -- # return 0 00:03:10.800 20:20:28 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:10.800 20:20:28 -- setup/hugepages.sh@112 -- # get_nodes 00:03:10.800 20:20:28 -- setup/hugepages.sh@27 -- # local node 00:03:10.800 20:20:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:10.800 20:20:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:10.800 20:20:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:10.800 20:20:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:10.800 20:20:28 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:10.800 20:20:28 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:10.800 20:20:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:10.800 20:20:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:10.800 20:20:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:10.800 20:20:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:10.800 20:20:28 -- setup/common.sh@18 -- # local node=0 00:03:10.800 20:20:28 -- setup/common.sh@19 -- # local var val 00:03:10.800 20:20:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.800 20:20:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.800 20:20:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:10.800 20:20:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:10.800 20:20:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.800 20:20:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 54575572 kB' 'MemUsed: 11083436 kB' 'SwapCached: 0 kB' 'Active: 6654040 kB' 'Inactive: 283868 kB' 'Active(anon): 5958112 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283868 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6841624 kB' 'Mapped: 56324 kB' 'AnonPages: 99576 kB' 'Shmem: 5861828 kB' 'KernelStack: 14008 kB' 'PageTables: 3936 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 187320 kB' 'Slab: 682644 kB' 'SReclaimable: 187320 kB' 'SUnreclaim: 495324 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.800 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.800 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.801 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.801 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.802 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.802 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.802 20:20:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.802 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.802 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.802 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.802 20:20:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.802 20:20:28 -- setup/common.sh@32 -- # continue 00:03:10.802 20:20:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.802 20:20:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.802 20:20:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.802 20:20:28 -- setup/common.sh@33 -- # echo 0 00:03:10.802 20:20:28 -- setup/common.sh@33 -- # return 0 00:03:10.802 20:20:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:10.802 20:20:28 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:10.802 20:20:28 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:10.802 20:20:28 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:10.802 20:20:28 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:10.802 node0=1024 expecting 1024 00:03:10.802 20:20:28 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:10.802 00:03:10.802 real 0m3.279s 00:03:10.802 user 0m1.161s 00:03:10.802 sys 0m2.002s 00:03:10.802 20:20:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:10.802 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:03:10.802 ************************************ 00:03:10.802 END TEST default_setup 00:03:10.802 ************************************ 00:03:10.802 20:20:28 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:10.802 20:20:28 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:10.802 20:20:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:10.802 20:20:28 -- common/autotest_common.sh@10 -- # set +x 00:03:10.802 ************************************ 00:03:10.802 START TEST per_node_1G_alloc 00:03:10.802 ************************************ 00:03:10.802 20:20:28 -- common/autotest_common.sh@1104 -- # per_node_1G_alloc 00:03:10.802 20:20:28 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:10.802 20:20:28 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:10.802 20:20:28 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:10.802 20:20:28 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:10.802 20:20:28 -- setup/hugepages.sh@51 -- # shift 00:03:10.802 20:20:28 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:10.802 20:20:28 -- setup/hugepages.sh@52 -- # local node_ids 00:03:10.802 20:20:28 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:10.802 20:20:28 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:10.802 20:20:28 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:10.802 20:20:28 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:10.802 20:20:28 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:10.802 20:20:28 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:10.802 20:20:28 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:10.802 20:20:28 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:10.802 20:20:28 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:10.802 20:20:28 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:10.802 20:20:28 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:10.802 20:20:28 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:10.802 20:20:28 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:10.802 20:20:28 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:10.802 20:20:28 -- setup/hugepages.sh@73 -- # return 0 00:03:10.802 20:20:28 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:10.802 20:20:28 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:10.802 20:20:28 -- setup/hugepages.sh@146 -- # setup output 00:03:10.802 20:20:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.802 20:20:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:14.110 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:14.110 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:14.110 20:20:32 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:14.110 20:20:32 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:14.110 20:20:32 -- setup/hugepages.sh@89 -- # local node 00:03:14.110 20:20:32 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:14.110 20:20:32 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:14.110 20:20:32 -- setup/hugepages.sh@92 -- # local surp 00:03:14.110 20:20:32 -- setup/hugepages.sh@93 -- # local resv 00:03:14.110 20:20:32 -- setup/hugepages.sh@94 -- # local anon 00:03:14.110 20:20:32 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:14.110 20:20:32 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:14.110 20:20:32 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:14.110 20:20:32 -- setup/common.sh@18 -- # local node= 00:03:14.110 20:20:32 -- setup/common.sh@19 -- # local var val 00:03:14.110 20:20:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.110 20:20:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.110 20:20:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.110 20:20:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.110 20:20:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.110 20:20:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.110 20:20:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101300428 kB' 'MemAvailable: 105608476 kB' 'Buffers: 2696 kB' 'Cached: 18086308 kB' 'SwapCached: 0 kB' 'Active: 15032264 kB' 'Inactive: 3667940 kB' 'Active(anon): 13908320 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 614656 kB' 'Mapped: 196496 kB' 'Shmem: 13297120 kB' 'KReclaimable: 557108 kB' 'Slab: 1427020 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869912 kB' 'KernelStack: 27920 kB' 'PageTables: 10592 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15423640 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235768 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.110 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.110 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.111 20:20:32 -- setup/common.sh@33 -- # echo 0 00:03:14.111 20:20:32 -- setup/common.sh@33 -- # return 0 00:03:14.111 20:20:32 -- setup/hugepages.sh@97 -- # anon=0 00:03:14.111 20:20:32 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:14.111 20:20:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.111 20:20:32 -- setup/common.sh@18 -- # local node= 00:03:14.111 20:20:32 -- setup/common.sh@19 -- # local var val 00:03:14.111 20:20:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.111 20:20:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.111 20:20:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.111 20:20:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.111 20:20:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.111 20:20:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.111 20:20:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101314336 kB' 'MemAvailable: 105622384 kB' 'Buffers: 2696 kB' 'Cached: 18086308 kB' 'SwapCached: 0 kB' 'Active: 15031832 kB' 'Inactive: 3667940 kB' 'Active(anon): 13907888 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 614176 kB' 'Mapped: 196496 kB' 'Shmem: 13297120 kB' 'KReclaimable: 557108 kB' 'Slab: 1426796 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869688 kB' 'KernelStack: 27536 kB' 'PageTables: 9332 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15422136 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235640 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.111 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.111 20:20:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.112 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.112 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.112 20:20:32 -- setup/common.sh@33 -- # echo 0 00:03:14.112 20:20:32 -- setup/common.sh@33 -- # return 0 00:03:14.112 20:20:32 -- setup/hugepages.sh@99 -- # surp=0 00:03:14.112 20:20:32 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:14.112 20:20:32 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:14.112 20:20:32 -- setup/common.sh@18 -- # local node= 00:03:14.113 20:20:32 -- setup/common.sh@19 -- # local var val 00:03:14.113 20:20:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.113 20:20:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.113 20:20:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.113 20:20:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.113 20:20:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.113 20:20:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101314680 kB' 'MemAvailable: 105622728 kB' 'Buffers: 2696 kB' 'Cached: 18086324 kB' 'SwapCached: 0 kB' 'Active: 15031180 kB' 'Inactive: 3667940 kB' 'Active(anon): 13907236 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 613492 kB' 'Mapped: 196496 kB' 'Shmem: 13297136 kB' 'KReclaimable: 557108 kB' 'Slab: 1426904 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869796 kB' 'KernelStack: 27504 kB' 'PageTables: 9852 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15424036 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235736 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.113 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.113 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.114 20:20:32 -- setup/common.sh@33 -- # echo 0 00:03:14.114 20:20:32 -- setup/common.sh@33 -- # return 0 00:03:14.114 20:20:32 -- setup/hugepages.sh@100 -- # resv=0 00:03:14.114 20:20:32 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:14.114 nr_hugepages=1024 00:03:14.114 20:20:32 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:14.114 resv_hugepages=0 00:03:14.114 20:20:32 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:14.114 surplus_hugepages=0 00:03:14.114 20:20:32 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:14.114 anon_hugepages=0 00:03:14.114 20:20:32 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:14.114 20:20:32 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:14.114 20:20:32 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:14.114 20:20:32 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:14.114 20:20:32 -- setup/common.sh@18 -- # local node= 00:03:14.114 20:20:32 -- setup/common.sh@19 -- # local var val 00:03:14.114 20:20:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.114 20:20:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.114 20:20:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.114 20:20:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.114 20:20:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.114 20:20:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101313924 kB' 'MemAvailable: 105621972 kB' 'Buffers: 2696 kB' 'Cached: 18086324 kB' 'SwapCached: 0 kB' 'Active: 15032132 kB' 'Inactive: 3667940 kB' 'Active(anon): 13908188 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 614476 kB' 'Mapped: 196496 kB' 'Shmem: 13297136 kB' 'KReclaimable: 557108 kB' 'Slab: 1426904 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869796 kB' 'KernelStack: 27552 kB' 'PageTables: 10152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15424052 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235752 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.114 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.114 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.115 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.115 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.116 20:20:32 -- setup/common.sh@33 -- # echo 1024 00:03:14.116 20:20:32 -- setup/common.sh@33 -- # return 0 00:03:14.116 20:20:32 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:14.116 20:20:32 -- setup/hugepages.sh@112 -- # get_nodes 00:03:14.116 20:20:32 -- setup/hugepages.sh@27 -- # local node 00:03:14.116 20:20:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.116 20:20:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:14.116 20:20:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.116 20:20:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:14.116 20:20:32 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:14.116 20:20:32 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:14.116 20:20:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.116 20:20:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.116 20:20:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:14.116 20:20:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.116 20:20:32 -- setup/common.sh@18 -- # local node=0 00:03:14.116 20:20:32 -- setup/common.sh@19 -- # local var val 00:03:14.116 20:20:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.116 20:20:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.116 20:20:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:14.116 20:20:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:14.116 20:20:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.116 20:20:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.116 20:20:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 55619644 kB' 'MemUsed: 10039364 kB' 'SwapCached: 0 kB' 'Active: 6654992 kB' 'Inactive: 283868 kB' 'Active(anon): 5959064 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283868 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6841696 kB' 'Mapped: 56324 kB' 'AnonPages: 100392 kB' 'Shmem: 5861900 kB' 'KernelStack: 14072 kB' 'PageTables: 4048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 187320 kB' 'Slab: 682064 kB' 'SReclaimable: 187320 kB' 'SUnreclaim: 494744 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.116 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.116 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@33 -- # echo 0 00:03:14.117 20:20:32 -- setup/common.sh@33 -- # return 0 00:03:14.117 20:20:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:14.117 20:20:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.117 20:20:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.117 20:20:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:14.117 20:20:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.117 20:20:32 -- setup/common.sh@18 -- # local node=1 00:03:14.117 20:20:32 -- setup/common.sh@19 -- # local var val 00:03:14.117 20:20:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.117 20:20:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.117 20:20:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:14.117 20:20:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:14.117 20:20:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.117 20:20:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.117 20:20:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60679896 kB' 'MemFree: 45694708 kB' 'MemUsed: 14985188 kB' 'SwapCached: 0 kB' 'Active: 8377148 kB' 'Inactive: 3384072 kB' 'Active(anon): 7949132 kB' 'Inactive(anon): 0 kB' 'Active(file): 428016 kB' 'Inactive(file): 3384072 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 11247356 kB' 'Mapped: 140180 kB' 'AnonPages: 513772 kB' 'Shmem: 7435268 kB' 'KernelStack: 13544 kB' 'PageTables: 5824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 369788 kB' 'Slab: 744840 kB' 'SReclaimable: 369788 kB' 'SUnreclaim: 375052 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.117 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.117 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # continue 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.118 20:20:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.118 20:20:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.118 20:20:32 -- setup/common.sh@33 -- # echo 0 00:03:14.118 20:20:32 -- setup/common.sh@33 -- # return 0 00:03:14.118 20:20:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:14.118 20:20:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:14.118 20:20:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:14.118 20:20:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:14.118 20:20:32 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:14.118 node0=512 expecting 512 00:03:14.118 20:20:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:14.118 20:20:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:14.118 20:20:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:14.118 20:20:32 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:14.118 node1=512 expecting 512 00:03:14.118 20:20:32 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:14.118 00:03:14.118 real 0m3.382s 00:03:14.118 user 0m1.349s 00:03:14.118 sys 0m2.082s 00:03:14.118 20:20:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:14.118 20:20:32 -- common/autotest_common.sh@10 -- # set +x 00:03:14.118 ************************************ 00:03:14.118 END TEST per_node_1G_alloc 00:03:14.118 ************************************ 00:03:14.118 20:20:32 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:14.118 20:20:32 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:14.118 20:20:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:14.118 20:20:32 -- common/autotest_common.sh@10 -- # set +x 00:03:14.118 ************************************ 00:03:14.118 START TEST even_2G_alloc 00:03:14.118 ************************************ 00:03:14.118 20:20:32 -- common/autotest_common.sh@1104 -- # even_2G_alloc 00:03:14.118 20:20:32 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:14.118 20:20:32 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:14.118 20:20:32 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:14.118 20:20:32 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:14.118 20:20:32 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:14.118 20:20:32 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:14.118 20:20:32 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:14.118 20:20:32 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:14.118 20:20:32 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:14.118 20:20:32 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:14.118 20:20:32 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:14.118 20:20:32 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:14.118 20:20:32 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:14.118 20:20:32 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:14.118 20:20:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:14.118 20:20:32 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:14.118 20:20:32 -- setup/hugepages.sh@83 -- # : 512 00:03:14.118 20:20:32 -- setup/hugepages.sh@84 -- # : 1 00:03:14.118 20:20:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:14.118 20:20:32 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:14.118 20:20:32 -- setup/hugepages.sh@83 -- # : 0 00:03:14.118 20:20:32 -- setup/hugepages.sh@84 -- # : 0 00:03:14.118 20:20:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:14.118 20:20:32 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:14.118 20:20:32 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:14.118 20:20:32 -- setup/hugepages.sh@153 -- # setup output 00:03:14.118 20:20:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:14.118 20:20:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:17.427 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:17.427 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:17.427 20:20:35 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:17.427 20:20:35 -- setup/hugepages.sh@89 -- # local node 00:03:17.427 20:20:35 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:17.427 20:20:35 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:17.427 20:20:35 -- setup/hugepages.sh@92 -- # local surp 00:03:17.427 20:20:35 -- setup/hugepages.sh@93 -- # local resv 00:03:17.427 20:20:35 -- setup/hugepages.sh@94 -- # local anon 00:03:17.427 20:20:35 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:17.427 20:20:35 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:17.427 20:20:35 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:17.427 20:20:35 -- setup/common.sh@18 -- # local node= 00:03:17.427 20:20:35 -- setup/common.sh@19 -- # local var val 00:03:17.427 20:20:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.427 20:20:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.427 20:20:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.427 20:20:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.427 20:20:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.427 20:20:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101319180 kB' 'MemAvailable: 105627228 kB' 'Buffers: 2696 kB' 'Cached: 18086432 kB' 'SwapCached: 0 kB' 'Active: 15029264 kB' 'Inactive: 3667940 kB' 'Active(anon): 13905320 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 611368 kB' 'Mapped: 195424 kB' 'Shmem: 13297244 kB' 'KReclaimable: 557108 kB' 'Slab: 1426656 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869548 kB' 'KernelStack: 27664 kB' 'PageTables: 9792 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15408412 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235864 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.427 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.427 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.428 20:20:35 -- setup/common.sh@33 -- # echo 0 00:03:17.428 20:20:35 -- setup/common.sh@33 -- # return 0 00:03:17.428 20:20:35 -- setup/hugepages.sh@97 -- # anon=0 00:03:17.428 20:20:35 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:17.428 20:20:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.428 20:20:35 -- setup/common.sh@18 -- # local node= 00:03:17.428 20:20:35 -- setup/common.sh@19 -- # local var val 00:03:17.428 20:20:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.428 20:20:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.428 20:20:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.428 20:20:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.428 20:20:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.428 20:20:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101319428 kB' 'MemAvailable: 105627476 kB' 'Buffers: 2696 kB' 'Cached: 18086432 kB' 'SwapCached: 0 kB' 'Active: 15029608 kB' 'Inactive: 3667940 kB' 'Active(anon): 13905664 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 611764 kB' 'Mapped: 195500 kB' 'Shmem: 13297244 kB' 'KReclaimable: 557108 kB' 'Slab: 1426728 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869620 kB' 'KernelStack: 27520 kB' 'PageTables: 9696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15406540 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235688 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.428 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.428 20:20:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.429 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.429 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.429 20:20:35 -- setup/common.sh@33 -- # echo 0 00:03:17.429 20:20:35 -- setup/common.sh@33 -- # return 0 00:03:17.429 20:20:35 -- setup/hugepages.sh@99 -- # surp=0 00:03:17.429 20:20:35 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:17.429 20:20:35 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:17.429 20:20:35 -- setup/common.sh@18 -- # local node= 00:03:17.429 20:20:35 -- setup/common.sh@19 -- # local var val 00:03:17.429 20:20:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.429 20:20:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.429 20:20:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.429 20:20:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.430 20:20:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.430 20:20:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101320976 kB' 'MemAvailable: 105629024 kB' 'Buffers: 2696 kB' 'Cached: 18086440 kB' 'SwapCached: 0 kB' 'Active: 15029900 kB' 'Inactive: 3667940 kB' 'Active(anon): 13905956 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 611964 kB' 'Mapped: 195500 kB' 'Shmem: 13297252 kB' 'KReclaimable: 557108 kB' 'Slab: 1426728 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869620 kB' 'KernelStack: 27488 kB' 'PageTables: 9200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15406560 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235768 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.430 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.430 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.431 20:20:35 -- setup/common.sh@33 -- # echo 0 00:03:17.431 20:20:35 -- setup/common.sh@33 -- # return 0 00:03:17.431 20:20:35 -- setup/hugepages.sh@100 -- # resv=0 00:03:17.431 20:20:35 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:17.431 nr_hugepages=1024 00:03:17.431 20:20:35 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:17.431 resv_hugepages=0 00:03:17.431 20:20:35 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:17.431 surplus_hugepages=0 00:03:17.431 20:20:35 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:17.431 anon_hugepages=0 00:03:17.431 20:20:35 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.431 20:20:35 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:17.431 20:20:35 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:17.431 20:20:35 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:17.431 20:20:35 -- setup/common.sh@18 -- # local node= 00:03:17.431 20:20:35 -- setup/common.sh@19 -- # local var val 00:03:17.431 20:20:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.431 20:20:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.431 20:20:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.431 20:20:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.431 20:20:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.431 20:20:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101320632 kB' 'MemAvailable: 105628680 kB' 'Buffers: 2696 kB' 'Cached: 18086464 kB' 'SwapCached: 0 kB' 'Active: 15029228 kB' 'Inactive: 3667940 kB' 'Active(anon): 13905284 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 611252 kB' 'Mapped: 195424 kB' 'Shmem: 13297276 kB' 'KReclaimable: 557108 kB' 'Slab: 1426688 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869580 kB' 'KernelStack: 27456 kB' 'PageTables: 9196 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15406576 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235752 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.431 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.431 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.432 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.432 20:20:35 -- setup/common.sh@33 -- # echo 1024 00:03:17.432 20:20:35 -- setup/common.sh@33 -- # return 0 00:03:17.432 20:20:35 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.432 20:20:35 -- setup/hugepages.sh@112 -- # get_nodes 00:03:17.432 20:20:35 -- setup/hugepages.sh@27 -- # local node 00:03:17.432 20:20:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.432 20:20:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:17.432 20:20:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.432 20:20:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:17.432 20:20:35 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:17.432 20:20:35 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:17.432 20:20:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.432 20:20:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.432 20:20:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:17.432 20:20:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.432 20:20:35 -- setup/common.sh@18 -- # local node=0 00:03:17.432 20:20:35 -- setup/common.sh@19 -- # local var val 00:03:17.432 20:20:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.432 20:20:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.432 20:20:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:17.432 20:20:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:17.432 20:20:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.432 20:20:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.432 20:20:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 55619708 kB' 'MemUsed: 10039300 kB' 'SwapCached: 0 kB' 'Active: 6652580 kB' 'Inactive: 283868 kB' 'Active(anon): 5956652 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283868 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6841772 kB' 'Mapped: 55240 kB' 'AnonPages: 97832 kB' 'Shmem: 5861976 kB' 'KernelStack: 13960 kB' 'PageTables: 3472 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 187320 kB' 'Slab: 681788 kB' 'SReclaimable: 187320 kB' 'SUnreclaim: 494468 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:17.432 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.433 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.433 20:20:35 -- setup/common.sh@33 -- # echo 0 00:03:17.433 20:20:35 -- setup/common.sh@33 -- # return 0 00:03:17.433 20:20:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.433 20:20:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.433 20:20:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.433 20:20:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:17.433 20:20:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.433 20:20:35 -- setup/common.sh@18 -- # local node=1 00:03:17.433 20:20:35 -- setup/common.sh@19 -- # local var val 00:03:17.433 20:20:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.433 20:20:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.433 20:20:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:17.433 20:20:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:17.433 20:20:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.433 20:20:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.433 20:20:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60679896 kB' 'MemFree: 45700752 kB' 'MemUsed: 14979144 kB' 'SwapCached: 0 kB' 'Active: 8377200 kB' 'Inactive: 3384072 kB' 'Active(anon): 7949184 kB' 'Inactive(anon): 0 kB' 'Active(file): 428016 kB' 'Inactive(file): 3384072 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 11247404 kB' 'Mapped: 140184 kB' 'AnonPages: 513968 kB' 'Shmem: 7435316 kB' 'KernelStack: 13480 kB' 'PageTables: 5632 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 369788 kB' 'Slab: 744900 kB' 'SReclaimable: 369788 kB' 'SUnreclaim: 375112 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:17.433 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # continue 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.434 20:20:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.434 20:20:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.434 20:20:35 -- setup/common.sh@33 -- # echo 0 00:03:17.434 20:20:35 -- setup/common.sh@33 -- # return 0 00:03:17.434 20:20:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.434 20:20:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.434 20:20:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.434 20:20:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.434 20:20:35 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:17.434 node0=512 expecting 512 00:03:17.434 20:20:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.434 20:20:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.434 20:20:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.434 20:20:35 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:17.434 node1=512 expecting 512 00:03:17.434 20:20:35 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:17.434 00:03:17.434 real 0m3.419s 00:03:17.434 user 0m1.375s 00:03:17.434 sys 0m2.107s 00:03:17.434 20:20:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:17.434 20:20:35 -- common/autotest_common.sh@10 -- # set +x 00:03:17.434 ************************************ 00:03:17.434 END TEST even_2G_alloc 00:03:17.434 ************************************ 00:03:17.696 20:20:35 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:17.696 20:20:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:17.696 20:20:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:17.696 20:20:35 -- common/autotest_common.sh@10 -- # set +x 00:03:17.696 ************************************ 00:03:17.696 START TEST odd_alloc 00:03:17.696 ************************************ 00:03:17.696 20:20:35 -- common/autotest_common.sh@1104 -- # odd_alloc 00:03:17.696 20:20:35 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:17.696 20:20:35 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:17.696 20:20:35 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:17.696 20:20:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:17.696 20:20:35 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:17.696 20:20:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:17.696 20:20:35 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:17.696 20:20:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:17.696 20:20:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:17.696 20:20:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:17.696 20:20:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:17.696 20:20:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:17.696 20:20:35 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:17.696 20:20:35 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:17.696 20:20:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.696 20:20:35 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:17.696 20:20:35 -- setup/hugepages.sh@83 -- # : 513 00:03:17.696 20:20:35 -- setup/hugepages.sh@84 -- # : 1 00:03:17.696 20:20:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.696 20:20:35 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:17.696 20:20:35 -- setup/hugepages.sh@83 -- # : 0 00:03:17.696 20:20:35 -- setup/hugepages.sh@84 -- # : 0 00:03:17.696 20:20:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.696 20:20:35 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:17.696 20:20:35 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:17.696 20:20:35 -- setup/hugepages.sh@160 -- # setup output 00:03:17.696 20:20:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:17.696 20:20:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:21.001 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:21.001 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:21.001 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:21.001 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:21.001 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:21.001 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:21.001 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:21.002 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:21.002 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:21.002 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:21.002 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:21.002 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:21.002 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:21.002 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:21.002 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:21.002 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:21.002 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:21.002 20:20:39 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:21.002 20:20:39 -- setup/hugepages.sh@89 -- # local node 00:03:21.002 20:20:39 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:21.002 20:20:39 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:21.002 20:20:39 -- setup/hugepages.sh@92 -- # local surp 00:03:21.002 20:20:39 -- setup/hugepages.sh@93 -- # local resv 00:03:21.002 20:20:39 -- setup/hugepages.sh@94 -- # local anon 00:03:21.002 20:20:39 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:21.002 20:20:39 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:21.002 20:20:39 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:21.002 20:20:39 -- setup/common.sh@18 -- # local node= 00:03:21.002 20:20:39 -- setup/common.sh@19 -- # local var val 00:03:21.002 20:20:39 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.002 20:20:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.002 20:20:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.002 20:20:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.002 20:20:39 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.002 20:20:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101334544 kB' 'MemAvailable: 105642592 kB' 'Buffers: 2696 kB' 'Cached: 18086584 kB' 'SwapCached: 0 kB' 'Active: 15030460 kB' 'Inactive: 3667940 kB' 'Active(anon): 13906516 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 612444 kB' 'Mapped: 195504 kB' 'Shmem: 13297396 kB' 'KReclaimable: 557108 kB' 'Slab: 1426500 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869392 kB' 'KernelStack: 27664 kB' 'PageTables: 10036 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70508456 kB' 'Committed_AS: 15409048 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235768 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.002 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.002 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.003 20:20:39 -- setup/common.sh@33 -- # echo 0 00:03:21.003 20:20:39 -- setup/common.sh@33 -- # return 0 00:03:21.003 20:20:39 -- setup/hugepages.sh@97 -- # anon=0 00:03:21.003 20:20:39 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:21.003 20:20:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.003 20:20:39 -- setup/common.sh@18 -- # local node= 00:03:21.003 20:20:39 -- setup/common.sh@19 -- # local var val 00:03:21.003 20:20:39 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.003 20:20:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.003 20:20:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.003 20:20:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.003 20:20:39 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.003 20:20:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.003 20:20:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101333540 kB' 'MemAvailable: 105641588 kB' 'Buffers: 2696 kB' 'Cached: 18086592 kB' 'SwapCached: 0 kB' 'Active: 15030636 kB' 'Inactive: 3667940 kB' 'Active(anon): 13906692 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 612616 kB' 'Mapped: 195600 kB' 'Shmem: 13297404 kB' 'KReclaimable: 557108 kB' 'Slab: 1426492 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869384 kB' 'KernelStack: 27632 kB' 'PageTables: 9796 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70508456 kB' 'Committed_AS: 15409064 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235704 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.003 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.003 20:20:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.004 20:20:39 -- setup/common.sh@33 -- # echo 0 00:03:21.004 20:20:39 -- setup/common.sh@33 -- # return 0 00:03:21.004 20:20:39 -- setup/hugepages.sh@99 -- # surp=0 00:03:21.004 20:20:39 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:21.004 20:20:39 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:21.004 20:20:39 -- setup/common.sh@18 -- # local node= 00:03:21.004 20:20:39 -- setup/common.sh@19 -- # local var val 00:03:21.004 20:20:39 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.004 20:20:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.004 20:20:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.004 20:20:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.004 20:20:39 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.004 20:20:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.004 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.004 20:20:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101335792 kB' 'MemAvailable: 105643840 kB' 'Buffers: 2696 kB' 'Cached: 18086612 kB' 'SwapCached: 0 kB' 'Active: 15029924 kB' 'Inactive: 3667940 kB' 'Active(anon): 13905980 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 611864 kB' 'Mapped: 195504 kB' 'Shmem: 13297424 kB' 'KReclaimable: 557108 kB' 'Slab: 1426740 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869632 kB' 'KernelStack: 27584 kB' 'PageTables: 9496 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70508456 kB' 'Committed_AS: 15409220 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235704 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:21.004 20:20:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.005 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.005 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.006 20:20:39 -- setup/common.sh@33 -- # echo 0 00:03:21.006 20:20:39 -- setup/common.sh@33 -- # return 0 00:03:21.006 20:20:39 -- setup/hugepages.sh@100 -- # resv=0 00:03:21.006 20:20:39 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:21.006 nr_hugepages=1025 00:03:21.006 20:20:39 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:21.006 resv_hugepages=0 00:03:21.006 20:20:39 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:21.006 surplus_hugepages=0 00:03:21.006 20:20:39 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:21.006 anon_hugepages=0 00:03:21.006 20:20:39 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:21.006 20:20:39 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:21.006 20:20:39 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:21.006 20:20:39 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:21.006 20:20:39 -- setup/common.sh@18 -- # local node= 00:03:21.006 20:20:39 -- setup/common.sh@19 -- # local var val 00:03:21.006 20:20:39 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.006 20:20:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.006 20:20:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.006 20:20:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.006 20:20:39 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.006 20:20:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.006 20:20:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101335900 kB' 'MemAvailable: 105643948 kB' 'Buffers: 2696 kB' 'Cached: 18086624 kB' 'SwapCached: 0 kB' 'Active: 15029804 kB' 'Inactive: 3667940 kB' 'Active(anon): 13905860 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 611728 kB' 'Mapped: 195504 kB' 'Shmem: 13297436 kB' 'KReclaimable: 557108 kB' 'Slab: 1426740 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869632 kB' 'KernelStack: 27472 kB' 'PageTables: 9340 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70508456 kB' 'Committed_AS: 15404488 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235640 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.006 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.006 20:20:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.271 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.271 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.272 20:20:39 -- setup/common.sh@33 -- # echo 1025 00:03:21.272 20:20:39 -- setup/common.sh@33 -- # return 0 00:03:21.272 20:20:39 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:21.272 20:20:39 -- setup/hugepages.sh@112 -- # get_nodes 00:03:21.272 20:20:39 -- setup/hugepages.sh@27 -- # local node 00:03:21.272 20:20:39 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.272 20:20:39 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:21.272 20:20:39 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.272 20:20:39 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:21.272 20:20:39 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:21.272 20:20:39 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:21.272 20:20:39 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:21.272 20:20:39 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:21.272 20:20:39 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:21.272 20:20:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.272 20:20:39 -- setup/common.sh@18 -- # local node=0 00:03:21.272 20:20:39 -- setup/common.sh@19 -- # local var val 00:03:21.272 20:20:39 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.272 20:20:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.272 20:20:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:21.272 20:20:39 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:21.272 20:20:39 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.272 20:20:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 55626428 kB' 'MemUsed: 10032580 kB' 'SwapCached: 0 kB' 'Active: 6652276 kB' 'Inactive: 283868 kB' 'Active(anon): 5956348 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283868 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6841880 kB' 'Mapped: 55300 kB' 'AnonPages: 97484 kB' 'Shmem: 5862084 kB' 'KernelStack: 14040 kB' 'PageTables: 3876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 187320 kB' 'Slab: 681636 kB' 'SReclaimable: 187320 kB' 'SUnreclaim: 494316 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.272 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.272 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@33 -- # echo 0 00:03:21.273 20:20:39 -- setup/common.sh@33 -- # return 0 00:03:21.273 20:20:39 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:21.273 20:20:39 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:21.273 20:20:39 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:21.273 20:20:39 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:21.273 20:20:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.273 20:20:39 -- setup/common.sh@18 -- # local node=1 00:03:21.273 20:20:39 -- setup/common.sh@19 -- # local var val 00:03:21.273 20:20:39 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.273 20:20:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.273 20:20:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:21.273 20:20:39 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:21.273 20:20:39 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.273 20:20:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.273 20:20:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60679896 kB' 'MemFree: 45708492 kB' 'MemUsed: 14971404 kB' 'SwapCached: 0 kB' 'Active: 8377700 kB' 'Inactive: 3384072 kB' 'Active(anon): 7949684 kB' 'Inactive(anon): 0 kB' 'Active(file): 428016 kB' 'Inactive(file): 3384072 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 11247476 kB' 'Mapped: 140204 kB' 'AnonPages: 514336 kB' 'Shmem: 7435388 kB' 'KernelStack: 13432 kB' 'PageTables: 5760 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 369788 kB' 'Slab: 745104 kB' 'SReclaimable: 369788 kB' 'SUnreclaim: 375316 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.273 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.273 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # continue 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.274 20:20:39 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.274 20:20:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.274 20:20:39 -- setup/common.sh@33 -- # echo 0 00:03:21.274 20:20:39 -- setup/common.sh@33 -- # return 0 00:03:21.274 20:20:39 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:21.274 20:20:39 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:21.274 20:20:39 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:21.274 20:20:39 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:21.274 20:20:39 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:21.274 node0=512 expecting 513 00:03:21.274 20:20:39 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:21.274 20:20:39 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:21.274 20:20:39 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:21.274 20:20:39 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:21.274 node1=513 expecting 512 00:03:21.274 20:20:39 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:21.274 00:03:21.274 real 0m3.623s 00:03:21.274 user 0m1.457s 00:03:21.274 sys 0m2.224s 00:03:21.274 20:20:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:21.274 20:20:39 -- common/autotest_common.sh@10 -- # set +x 00:03:21.274 ************************************ 00:03:21.274 END TEST odd_alloc 00:03:21.274 ************************************ 00:03:21.274 20:20:39 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:21.274 20:20:39 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:21.274 20:20:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:21.275 20:20:39 -- common/autotest_common.sh@10 -- # set +x 00:03:21.275 ************************************ 00:03:21.275 START TEST custom_alloc 00:03:21.275 ************************************ 00:03:21.275 20:20:39 -- common/autotest_common.sh@1104 -- # custom_alloc 00:03:21.275 20:20:39 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:21.275 20:20:39 -- setup/hugepages.sh@169 -- # local node 00:03:21.275 20:20:39 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:21.275 20:20:39 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:21.275 20:20:39 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:21.275 20:20:39 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:21.275 20:20:39 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:21.275 20:20:39 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:21.275 20:20:39 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:21.275 20:20:39 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:21.275 20:20:39 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:21.275 20:20:39 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:21.275 20:20:39 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:21.275 20:20:39 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:21.275 20:20:39 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:21.275 20:20:39 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:21.275 20:20:39 -- setup/hugepages.sh@83 -- # : 256 00:03:21.275 20:20:39 -- setup/hugepages.sh@84 -- # : 1 00:03:21.275 20:20:39 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:21.275 20:20:39 -- setup/hugepages.sh@83 -- # : 0 00:03:21.275 20:20:39 -- setup/hugepages.sh@84 -- # : 0 00:03:21.275 20:20:39 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:21.275 20:20:39 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:21.275 20:20:39 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:21.275 20:20:39 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:21.275 20:20:39 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:21.275 20:20:39 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:21.275 20:20:39 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:21.275 20:20:39 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:21.275 20:20:39 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:21.275 20:20:39 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:21.275 20:20:39 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:21.275 20:20:39 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:21.275 20:20:39 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:21.275 20:20:39 -- setup/hugepages.sh@78 -- # return 0 00:03:21.275 20:20:39 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:21.275 20:20:39 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:21.275 20:20:39 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:21.275 20:20:39 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:21.275 20:20:39 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:21.275 20:20:39 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:21.275 20:20:39 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:21.275 20:20:39 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:21.275 20:20:39 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:21.275 20:20:39 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:21.275 20:20:39 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:21.275 20:20:39 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:21.275 20:20:39 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:21.275 20:20:39 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:21.275 20:20:39 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:21.275 20:20:39 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:21.275 20:20:39 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:21.275 20:20:39 -- setup/hugepages.sh@78 -- # return 0 00:03:21.275 20:20:39 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:21.275 20:20:39 -- setup/hugepages.sh@187 -- # setup output 00:03:21.275 20:20:39 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:21.275 20:20:39 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:24.584 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:24.584 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:24.584 20:20:42 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:24.584 20:20:42 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:24.584 20:20:42 -- setup/hugepages.sh@89 -- # local node 00:03:24.584 20:20:42 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:24.584 20:20:42 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:24.584 20:20:42 -- setup/hugepages.sh@92 -- # local surp 00:03:24.584 20:20:42 -- setup/hugepages.sh@93 -- # local resv 00:03:24.584 20:20:42 -- setup/hugepages.sh@94 -- # local anon 00:03:24.584 20:20:42 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:24.584 20:20:42 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:24.584 20:20:42 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:24.584 20:20:42 -- setup/common.sh@18 -- # local node= 00:03:24.584 20:20:42 -- setup/common.sh@19 -- # local var val 00:03:24.584 20:20:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.584 20:20:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.584 20:20:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.584 20:20:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.584 20:20:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.584 20:20:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100273812 kB' 'MemAvailable: 104581860 kB' 'Buffers: 2696 kB' 'Cached: 18086732 kB' 'SwapCached: 0 kB' 'Active: 15032892 kB' 'Inactive: 3667940 kB' 'Active(anon): 13908948 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 614612 kB' 'Mapped: 196020 kB' 'Shmem: 13297544 kB' 'KReclaimable: 557108 kB' 'Slab: 1426980 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869872 kB' 'KernelStack: 27360 kB' 'PageTables: 9216 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69985192 kB' 'Committed_AS: 15409024 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235608 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.584 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.584 20:20:42 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.585 20:20:42 -- setup/common.sh@33 -- # echo 0 00:03:24.585 20:20:42 -- setup/common.sh@33 -- # return 0 00:03:24.585 20:20:42 -- setup/hugepages.sh@97 -- # anon=0 00:03:24.585 20:20:42 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:24.585 20:20:42 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:24.585 20:20:42 -- setup/common.sh@18 -- # local node= 00:03:24.585 20:20:42 -- setup/common.sh@19 -- # local var val 00:03:24.585 20:20:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.585 20:20:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.585 20:20:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.585 20:20:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.585 20:20:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.585 20:20:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100269864 kB' 'MemAvailable: 104577912 kB' 'Buffers: 2696 kB' 'Cached: 18086736 kB' 'SwapCached: 0 kB' 'Active: 15035156 kB' 'Inactive: 3667940 kB' 'Active(anon): 13911212 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 616940 kB' 'Mapped: 196432 kB' 'Shmem: 13297548 kB' 'KReclaimable: 557108 kB' 'Slab: 1426952 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869844 kB' 'KernelStack: 27344 kB' 'PageTables: 9172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69985192 kB' 'Committed_AS: 15411292 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235564 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.585 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.585 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.586 20:20:42 -- setup/common.sh@33 -- # echo 0 00:03:24.586 20:20:42 -- setup/common.sh@33 -- # return 0 00:03:24.586 20:20:42 -- setup/hugepages.sh@99 -- # surp=0 00:03:24.586 20:20:42 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:24.586 20:20:42 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:24.586 20:20:42 -- setup/common.sh@18 -- # local node= 00:03:24.586 20:20:42 -- setup/common.sh@19 -- # local var val 00:03:24.586 20:20:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.586 20:20:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.586 20:20:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.586 20:20:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.586 20:20:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.586 20:20:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.586 20:20:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100270144 kB' 'MemAvailable: 104578192 kB' 'Buffers: 2696 kB' 'Cached: 18086748 kB' 'SwapCached: 0 kB' 'Active: 15029672 kB' 'Inactive: 3667940 kB' 'Active(anon): 13905728 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 611560 kB' 'Mapped: 195988 kB' 'Shmem: 13297560 kB' 'KReclaimable: 557108 kB' 'Slab: 1426928 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869820 kB' 'KernelStack: 27376 kB' 'PageTables: 9372 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69985192 kB' 'Committed_AS: 15404820 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235528 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.586 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.586 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.587 20:20:42 -- setup/common.sh@33 -- # echo 0 00:03:24.587 20:20:42 -- setup/common.sh@33 -- # return 0 00:03:24.587 20:20:42 -- setup/hugepages.sh@100 -- # resv=0 00:03:24.587 20:20:42 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:24.587 nr_hugepages=1536 00:03:24.587 20:20:42 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:24.587 resv_hugepages=0 00:03:24.587 20:20:42 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:24.587 surplus_hugepages=0 00:03:24.587 20:20:42 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:24.587 anon_hugepages=0 00:03:24.587 20:20:42 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:24.587 20:20:42 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:24.587 20:20:42 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:24.587 20:20:42 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:24.587 20:20:42 -- setup/common.sh@18 -- # local node= 00:03:24.587 20:20:42 -- setup/common.sh@19 -- # local var val 00:03:24.587 20:20:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.587 20:20:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.587 20:20:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.587 20:20:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.587 20:20:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.587 20:20:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.587 20:20:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100270828 kB' 'MemAvailable: 104578876 kB' 'Buffers: 2696 kB' 'Cached: 18086764 kB' 'SwapCached: 0 kB' 'Active: 15029108 kB' 'Inactive: 3667940 kB' 'Active(anon): 13905164 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 610896 kB' 'Mapped: 195516 kB' 'Shmem: 13297576 kB' 'KReclaimable: 557108 kB' 'Slab: 1426928 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869820 kB' 'KernelStack: 27296 kB' 'PageTables: 8940 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69985192 kB' 'Committed_AS: 15404968 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235512 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.587 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.587 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.850 20:20:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.850 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.850 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.850 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.851 20:20:42 -- setup/common.sh@33 -- # echo 1536 00:03:24.851 20:20:42 -- setup/common.sh@33 -- # return 0 00:03:24.851 20:20:42 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:24.851 20:20:42 -- setup/hugepages.sh@112 -- # get_nodes 00:03:24.851 20:20:42 -- setup/hugepages.sh@27 -- # local node 00:03:24.851 20:20:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:24.851 20:20:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:24.851 20:20:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:24.851 20:20:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:24.851 20:20:42 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:24.851 20:20:42 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:24.851 20:20:42 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:24.851 20:20:42 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:24.851 20:20:42 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:24.851 20:20:42 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:24.851 20:20:42 -- setup/common.sh@18 -- # local node=0 00:03:24.851 20:20:42 -- setup/common.sh@19 -- # local var val 00:03:24.851 20:20:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.851 20:20:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.851 20:20:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:24.851 20:20:42 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:24.851 20:20:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.851 20:20:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.851 20:20:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 55597124 kB' 'MemUsed: 10061884 kB' 'SwapCached: 0 kB' 'Active: 6652952 kB' 'Inactive: 283868 kB' 'Active(anon): 5957024 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283868 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6841940 kB' 'Mapped: 55300 kB' 'AnonPages: 98064 kB' 'Shmem: 5862144 kB' 'KernelStack: 13912 kB' 'PageTables: 3484 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 187320 kB' 'Slab: 681688 kB' 'SReclaimable: 187320 kB' 'SUnreclaim: 494368 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.851 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.851 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.852 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.852 20:20:42 -- setup/common.sh@33 -- # echo 0 00:03:24.852 20:20:42 -- setup/common.sh@33 -- # return 0 00:03:24.852 20:20:42 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:24.852 20:20:42 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:24.852 20:20:42 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:24.852 20:20:42 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:24.852 20:20:42 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:24.852 20:20:42 -- setup/common.sh@18 -- # local node=1 00:03:24.852 20:20:42 -- setup/common.sh@19 -- # local var val 00:03:24.852 20:20:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.852 20:20:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.852 20:20:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:24.852 20:20:42 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:24.852 20:20:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.852 20:20:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.852 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60679896 kB' 'MemFree: 44674064 kB' 'MemUsed: 16005832 kB' 'SwapCached: 0 kB' 'Active: 8376156 kB' 'Inactive: 3384072 kB' 'Active(anon): 7948140 kB' 'Inactive(anon): 0 kB' 'Active(file): 428016 kB' 'Inactive(file): 3384072 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 11247540 kB' 'Mapped: 140216 kB' 'AnonPages: 512816 kB' 'Shmem: 7435452 kB' 'KernelStack: 13368 kB' 'PageTables: 5400 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 369788 kB' 'Slab: 745240 kB' 'SReclaimable: 369788 kB' 'SUnreclaim: 375452 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # continue 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.853 20:20:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.853 20:20:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.853 20:20:42 -- setup/common.sh@33 -- # echo 0 00:03:24.853 20:20:42 -- setup/common.sh@33 -- # return 0 00:03:24.853 20:20:42 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:24.853 20:20:42 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:24.853 20:20:42 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:24.853 20:20:42 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:24.853 20:20:42 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:24.853 node0=512 expecting 512 00:03:24.853 20:20:42 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:24.853 20:20:42 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:24.853 20:20:42 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:24.853 20:20:42 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:24.853 node1=1024 expecting 1024 00:03:24.853 20:20:42 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:24.853 00:03:24.853 real 0m3.494s 00:03:24.853 user 0m1.401s 00:03:24.854 sys 0m2.149s 00:03:24.854 20:20:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:24.854 20:20:42 -- common/autotest_common.sh@10 -- # set +x 00:03:24.854 ************************************ 00:03:24.854 END TEST custom_alloc 00:03:24.854 ************************************ 00:03:24.854 20:20:43 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:24.854 20:20:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:24.854 20:20:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:24.854 20:20:43 -- common/autotest_common.sh@10 -- # set +x 00:03:24.854 ************************************ 00:03:24.854 START TEST no_shrink_alloc 00:03:24.854 ************************************ 00:03:24.854 20:20:43 -- common/autotest_common.sh@1104 -- # no_shrink_alloc 00:03:24.854 20:20:43 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:24.854 20:20:43 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:24.854 20:20:43 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:24.854 20:20:43 -- setup/hugepages.sh@51 -- # shift 00:03:24.854 20:20:43 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:24.854 20:20:43 -- setup/hugepages.sh@52 -- # local node_ids 00:03:24.854 20:20:43 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:24.854 20:20:43 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:24.854 20:20:43 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:24.854 20:20:43 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:24.854 20:20:43 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:24.854 20:20:43 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:24.854 20:20:43 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:24.854 20:20:43 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:24.854 20:20:43 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:24.854 20:20:43 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:24.854 20:20:43 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:24.854 20:20:43 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:24.854 20:20:43 -- setup/hugepages.sh@73 -- # return 0 00:03:24.854 20:20:43 -- setup/hugepages.sh@198 -- # setup output 00:03:24.854 20:20:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:24.854 20:20:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:28.161 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:28.161 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:28.161 20:20:45 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:28.161 20:20:45 -- setup/hugepages.sh@89 -- # local node 00:03:28.161 20:20:45 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:28.161 20:20:45 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:28.161 20:20:45 -- setup/hugepages.sh@92 -- # local surp 00:03:28.161 20:20:45 -- setup/hugepages.sh@93 -- # local resv 00:03:28.161 20:20:45 -- setup/hugepages.sh@94 -- # local anon 00:03:28.161 20:20:45 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:28.161 20:20:45 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:28.161 20:20:45 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:28.161 20:20:45 -- setup/common.sh@18 -- # local node= 00:03:28.161 20:20:45 -- setup/common.sh@19 -- # local var val 00:03:28.161 20:20:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.161 20:20:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.161 20:20:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.161 20:20:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.161 20:20:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.161 20:20:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.161 20:20:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101328632 kB' 'MemAvailable: 105636680 kB' 'Buffers: 2696 kB' 'Cached: 18086876 kB' 'SwapCached: 0 kB' 'Active: 15032472 kB' 'Inactive: 3667940 kB' 'Active(anon): 13908528 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 614020 kB' 'Mapped: 195604 kB' 'Shmem: 13297688 kB' 'KReclaimable: 557108 kB' 'Slab: 1427028 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869920 kB' 'KernelStack: 27664 kB' 'PageTables: 9860 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15409384 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235976 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:28.161 20:20:45 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.161 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.161 20:20:45 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.161 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.161 20:20:45 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.161 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.161 20:20:45 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.161 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.161 20:20:45 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.161 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.161 20:20:45 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.161 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.161 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.162 20:20:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.162 20:20:45 -- setup/common.sh@33 -- # echo 0 00:03:28.162 20:20:45 -- setup/common.sh@33 -- # return 0 00:03:28.162 20:20:45 -- setup/hugepages.sh@97 -- # anon=0 00:03:28.162 20:20:45 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:28.162 20:20:45 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.162 20:20:45 -- setup/common.sh@18 -- # local node= 00:03:28.162 20:20:45 -- setup/common.sh@19 -- # local var val 00:03:28.162 20:20:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.162 20:20:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.162 20:20:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.162 20:20:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.162 20:20:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.162 20:20:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.162 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101337600 kB' 'MemAvailable: 105645648 kB' 'Buffers: 2696 kB' 'Cached: 18086876 kB' 'SwapCached: 0 kB' 'Active: 15032916 kB' 'Inactive: 3667940 kB' 'Active(anon): 13908972 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 614248 kB' 'Mapped: 195612 kB' 'Shmem: 13297688 kB' 'KReclaimable: 557108 kB' 'Slab: 1426992 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869884 kB' 'KernelStack: 27632 kB' 'PageTables: 9400 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15409396 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235880 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.163 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.163 20:20:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.164 20:20:45 -- setup/common.sh@33 -- # echo 0 00:03:28.164 20:20:45 -- setup/common.sh@33 -- # return 0 00:03:28.164 20:20:45 -- setup/hugepages.sh@99 -- # surp=0 00:03:28.164 20:20:45 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:28.164 20:20:45 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:28.164 20:20:45 -- setup/common.sh@18 -- # local node= 00:03:28.164 20:20:45 -- setup/common.sh@19 -- # local var val 00:03:28.164 20:20:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.164 20:20:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.164 20:20:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.164 20:20:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.164 20:20:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.164 20:20:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.164 20:20:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101337924 kB' 'MemAvailable: 105645972 kB' 'Buffers: 2696 kB' 'Cached: 18086892 kB' 'SwapCached: 0 kB' 'Active: 15031440 kB' 'Inactive: 3667940 kB' 'Active(anon): 13907496 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 612900 kB' 'Mapped: 195528 kB' 'Shmem: 13297704 kB' 'KReclaimable: 557108 kB' 'Slab: 1426960 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 869852 kB' 'KernelStack: 27456 kB' 'PageTables: 9032 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15410808 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235928 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.164 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.164 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # continue 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.165 20:20:45 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.165 20:20:45 -- setup/common.sh@33 -- # echo 0 00:03:28.165 20:20:45 -- setup/common.sh@33 -- # return 0 00:03:28.165 20:20:45 -- setup/hugepages.sh@100 -- # resv=0 00:03:28.165 20:20:45 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:28.165 nr_hugepages=1024 00:03:28.165 20:20:45 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:28.165 resv_hugepages=0 00:03:28.165 20:20:45 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:28.165 surplus_hugepages=0 00:03:28.165 20:20:45 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:28.165 anon_hugepages=0 00:03:28.165 20:20:45 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:28.165 20:20:45 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:28.165 20:20:46 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:28.165 20:20:46 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:28.165 20:20:46 -- setup/common.sh@18 -- # local node= 00:03:28.165 20:20:46 -- setup/common.sh@19 -- # local var val 00:03:28.165 20:20:46 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.165 20:20:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.165 20:20:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.165 20:20:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.165 20:20:46 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.165 20:20:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.165 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.165 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101336808 kB' 'MemAvailable: 105644856 kB' 'Buffers: 2696 kB' 'Cached: 18086908 kB' 'SwapCached: 0 kB' 'Active: 15031172 kB' 'Inactive: 3667940 kB' 'Active(anon): 13907228 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 613116 kB' 'Mapped: 195528 kB' 'Shmem: 13297720 kB' 'KReclaimable: 557108 kB' 'Slab: 1427184 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 870076 kB' 'KernelStack: 27552 kB' 'PageTables: 9472 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15411072 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235928 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.166 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.166 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.167 20:20:46 -- setup/common.sh@33 -- # echo 1024 00:03:28.167 20:20:46 -- setup/common.sh@33 -- # return 0 00:03:28.167 20:20:46 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:28.167 20:20:46 -- setup/hugepages.sh@112 -- # get_nodes 00:03:28.167 20:20:46 -- setup/hugepages.sh@27 -- # local node 00:03:28.167 20:20:46 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:28.167 20:20:46 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:28.167 20:20:46 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:28.167 20:20:46 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:28.167 20:20:46 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:28.167 20:20:46 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:28.167 20:20:46 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:28.167 20:20:46 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:28.167 20:20:46 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:28.167 20:20:46 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.167 20:20:46 -- setup/common.sh@18 -- # local node=0 00:03:28.167 20:20:46 -- setup/common.sh@19 -- # local var val 00:03:28.167 20:20:46 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.167 20:20:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.167 20:20:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:28.167 20:20:46 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:28.167 20:20:46 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.167 20:20:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 54551440 kB' 'MemUsed: 11107568 kB' 'SwapCached: 0 kB' 'Active: 6653112 kB' 'Inactive: 283868 kB' 'Active(anon): 5957184 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283868 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6842028 kB' 'Mapped: 55300 kB' 'AnonPages: 98060 kB' 'Shmem: 5862232 kB' 'KernelStack: 13880 kB' 'PageTables: 3380 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 187320 kB' 'Slab: 681772 kB' 'SReclaimable: 187320 kB' 'SUnreclaim: 494452 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.167 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.167 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # continue 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.168 20:20:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.168 20:20:46 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.168 20:20:46 -- setup/common.sh@33 -- # echo 0 00:03:28.168 20:20:46 -- setup/common.sh@33 -- # return 0 00:03:28.168 20:20:46 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:28.168 20:20:46 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:28.168 20:20:46 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:28.168 20:20:46 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:28.168 20:20:46 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:28.168 node0=1024 expecting 1024 00:03:28.168 20:20:46 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:28.168 20:20:46 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:28.168 20:20:46 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:28.168 20:20:46 -- setup/hugepages.sh@202 -- # setup output 00:03:28.168 20:20:46 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:28.168 20:20:46 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:31.475 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:31.475 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:31.475 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:31.475 20:20:49 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:31.475 20:20:49 -- setup/hugepages.sh@89 -- # local node 00:03:31.475 20:20:49 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:31.475 20:20:49 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:31.475 20:20:49 -- setup/hugepages.sh@92 -- # local surp 00:03:31.475 20:20:49 -- setup/hugepages.sh@93 -- # local resv 00:03:31.475 20:20:49 -- setup/hugepages.sh@94 -- # local anon 00:03:31.475 20:20:49 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:31.475 20:20:49 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:31.475 20:20:49 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:31.475 20:20:49 -- setup/common.sh@18 -- # local node= 00:03:31.475 20:20:49 -- setup/common.sh@19 -- # local var val 00:03:31.475 20:20:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.475 20:20:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.475 20:20:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.475 20:20:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.475 20:20:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.475 20:20:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101344312 kB' 'MemAvailable: 105652360 kB' 'Buffers: 2696 kB' 'Cached: 18087008 kB' 'SwapCached: 0 kB' 'Active: 15032700 kB' 'Inactive: 3667940 kB' 'Active(anon): 13908756 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 613756 kB' 'Mapped: 195624 kB' 'Shmem: 13297820 kB' 'KReclaimable: 557108 kB' 'Slab: 1427716 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 870608 kB' 'KernelStack: 27376 kB' 'PageTables: 9112 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15407132 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235720 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.475 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.475 20:20:49 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.476 20:20:49 -- setup/common.sh@33 -- # echo 0 00:03:31.476 20:20:49 -- setup/common.sh@33 -- # return 0 00:03:31.476 20:20:49 -- setup/hugepages.sh@97 -- # anon=0 00:03:31.476 20:20:49 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:31.476 20:20:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:31.476 20:20:49 -- setup/common.sh@18 -- # local node= 00:03:31.476 20:20:49 -- setup/common.sh@19 -- # local var val 00:03:31.476 20:20:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.476 20:20:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.476 20:20:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.476 20:20:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.476 20:20:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.476 20:20:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.476 20:20:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101344432 kB' 'MemAvailable: 105652480 kB' 'Buffers: 2696 kB' 'Cached: 18087012 kB' 'SwapCached: 0 kB' 'Active: 15031904 kB' 'Inactive: 3667940 kB' 'Active(anon): 13907960 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 613012 kB' 'Mapped: 195624 kB' 'Shmem: 13297824 kB' 'KReclaimable: 557108 kB' 'Slab: 1427732 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 870624 kB' 'KernelStack: 27456 kB' 'PageTables: 9516 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15408040 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235688 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.476 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.476 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.477 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.477 20:20:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.478 20:20:49 -- setup/common.sh@33 -- # echo 0 00:03:31.478 20:20:49 -- setup/common.sh@33 -- # return 0 00:03:31.478 20:20:49 -- setup/hugepages.sh@99 -- # surp=0 00:03:31.478 20:20:49 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:31.478 20:20:49 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:31.478 20:20:49 -- setup/common.sh@18 -- # local node= 00:03:31.478 20:20:49 -- setup/common.sh@19 -- # local var val 00:03:31.478 20:20:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.478 20:20:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.478 20:20:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.478 20:20:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.478 20:20:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.478 20:20:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.478 20:20:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101340400 kB' 'MemAvailable: 105648448 kB' 'Buffers: 2696 kB' 'Cached: 18087024 kB' 'SwapCached: 0 kB' 'Active: 15034016 kB' 'Inactive: 3667940 kB' 'Active(anon): 13910072 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 615532 kB' 'Mapped: 196052 kB' 'Shmem: 13297836 kB' 'KReclaimable: 557108 kB' 'Slab: 1427720 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 870612 kB' 'KernelStack: 27440 kB' 'PageTables: 9452 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15410496 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235656 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.478 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.478 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.479 20:20:49 -- setup/common.sh@33 -- # echo 0 00:03:31.479 20:20:49 -- setup/common.sh@33 -- # return 0 00:03:31.479 20:20:49 -- setup/hugepages.sh@100 -- # resv=0 00:03:31.479 20:20:49 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:31.479 nr_hugepages=1024 00:03:31.479 20:20:49 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:31.479 resv_hugepages=0 00:03:31.479 20:20:49 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:31.479 surplus_hugepages=0 00:03:31.479 20:20:49 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:31.479 anon_hugepages=0 00:03:31.479 20:20:49 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:31.479 20:20:49 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:31.479 20:20:49 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:31.479 20:20:49 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:31.479 20:20:49 -- setup/common.sh@18 -- # local node= 00:03:31.479 20:20:49 -- setup/common.sh@19 -- # local var val 00:03:31.479 20:20:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.479 20:20:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.479 20:20:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.479 20:20:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.479 20:20:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.479 20:20:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101336572 kB' 'MemAvailable: 105644620 kB' 'Buffers: 2696 kB' 'Cached: 18087040 kB' 'SwapCached: 0 kB' 'Active: 15037312 kB' 'Inactive: 3667940 kB' 'Active(anon): 13913368 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 618816 kB' 'Mapped: 196448 kB' 'Shmem: 13297852 kB' 'KReclaimable: 557108 kB' 'Slab: 1427720 kB' 'SReclaimable: 557108 kB' 'SUnreclaim: 870612 kB' 'KernelStack: 27440 kB' 'PageTables: 9460 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15413296 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 235660 kB' 'VmallocChunk: 0 kB' 'Percpu: 144576 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4504948 kB' 'DirectMap2M: 32923648 kB' 'DirectMap1G: 98566144 kB' 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.479 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.479 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.480 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.480 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.481 20:20:49 -- setup/common.sh@33 -- # echo 1024 00:03:31.481 20:20:49 -- setup/common.sh@33 -- # return 0 00:03:31.481 20:20:49 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:31.481 20:20:49 -- setup/hugepages.sh@112 -- # get_nodes 00:03:31.481 20:20:49 -- setup/hugepages.sh@27 -- # local node 00:03:31.481 20:20:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:31.481 20:20:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:31.481 20:20:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:31.481 20:20:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:31.481 20:20:49 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:31.481 20:20:49 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:31.481 20:20:49 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:31.481 20:20:49 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:31.481 20:20:49 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:31.481 20:20:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:31.481 20:20:49 -- setup/common.sh@18 -- # local node=0 00:03:31.481 20:20:49 -- setup/common.sh@19 -- # local var val 00:03:31.481 20:20:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.481 20:20:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.481 20:20:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:31.481 20:20:49 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:31.481 20:20:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.481 20:20:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 54533360 kB' 'MemUsed: 11125648 kB' 'SwapCached: 0 kB' 'Active: 6652776 kB' 'Inactive: 283868 kB' 'Active(anon): 5956848 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283868 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 6842112 kB' 'Mapped: 55300 kB' 'AnonPages: 97664 kB' 'Shmem: 5862316 kB' 'KernelStack: 13928 kB' 'PageTables: 3492 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 187320 kB' 'Slab: 682104 kB' 'SReclaimable: 187320 kB' 'SUnreclaim: 494784 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.481 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.481 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # continue 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.482 20:20:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.482 20:20:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.482 20:20:49 -- setup/common.sh@33 -- # echo 0 00:03:31.482 20:20:49 -- setup/common.sh@33 -- # return 0 00:03:31.482 20:20:49 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:31.482 20:20:49 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:31.482 20:20:49 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:31.482 20:20:49 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:31.482 20:20:49 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:31.482 node0=1024 expecting 1024 00:03:31.482 20:20:49 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:31.482 00:03:31.482 real 0m6.425s 00:03:31.482 user 0m2.366s 00:03:31.482 sys 0m4.075s 00:03:31.482 20:20:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:31.482 20:20:49 -- common/autotest_common.sh@10 -- # set +x 00:03:31.482 ************************************ 00:03:31.482 END TEST no_shrink_alloc 00:03:31.482 ************************************ 00:03:31.482 20:20:49 -- setup/hugepages.sh@217 -- # clear_hp 00:03:31.482 20:20:49 -- setup/hugepages.sh@37 -- # local node hp 00:03:31.482 20:20:49 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:31.482 20:20:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:31.482 20:20:49 -- setup/hugepages.sh@41 -- # echo 0 00:03:31.482 20:20:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:31.482 20:20:49 -- setup/hugepages.sh@41 -- # echo 0 00:03:31.482 20:20:49 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:31.482 20:20:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:31.482 20:20:49 -- setup/hugepages.sh@41 -- # echo 0 00:03:31.482 20:20:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:31.482 20:20:49 -- setup/hugepages.sh@41 -- # echo 0 00:03:31.482 20:20:49 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:31.482 20:20:49 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:31.482 00:03:31.482 real 0m24.029s 00:03:31.482 user 0m9.259s 00:03:31.482 sys 0m14.945s 00:03:31.482 20:20:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:31.482 20:20:49 -- common/autotest_common.sh@10 -- # set +x 00:03:31.482 ************************************ 00:03:31.482 END TEST hugepages 00:03:31.482 ************************************ 00:03:31.482 20:20:49 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:31.482 20:20:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:31.482 20:20:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:31.482 20:20:49 -- common/autotest_common.sh@10 -- # set +x 00:03:31.482 ************************************ 00:03:31.482 START TEST driver 00:03:31.482 ************************************ 00:03:31.482 20:20:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:31.482 * Looking for test storage... 00:03:31.482 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:31.482 20:20:49 -- setup/driver.sh@68 -- # setup reset 00:03:31.482 20:20:49 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:31.482 20:20:49 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:36.776 20:20:54 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:36.776 20:20:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:36.776 20:20:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:36.776 20:20:54 -- common/autotest_common.sh@10 -- # set +x 00:03:36.776 ************************************ 00:03:36.776 START TEST guess_driver 00:03:36.776 ************************************ 00:03:36.776 20:20:54 -- common/autotest_common.sh@1104 -- # guess_driver 00:03:36.776 20:20:54 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:36.776 20:20:54 -- setup/driver.sh@47 -- # local fail=0 00:03:36.776 20:20:54 -- setup/driver.sh@49 -- # pick_driver 00:03:36.776 20:20:54 -- setup/driver.sh@36 -- # vfio 00:03:36.776 20:20:54 -- setup/driver.sh@21 -- # local iommu_grups 00:03:36.776 20:20:54 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:36.776 20:20:54 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:36.776 20:20:54 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:36.776 20:20:54 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:36.776 20:20:54 -- setup/driver.sh@29 -- # (( 314 > 0 )) 00:03:36.776 20:20:54 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:36.776 20:20:54 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:36.776 20:20:54 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:36.776 20:20:54 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:36.776 20:20:54 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:36.776 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:36.776 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:36.776 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:36.776 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:36.776 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:36.776 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:36.776 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:36.776 20:20:54 -- setup/driver.sh@30 -- # return 0 00:03:36.776 20:20:54 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:36.776 20:20:54 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:36.776 20:20:54 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:36.776 20:20:54 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:36.776 Looking for driver=vfio-pci 00:03:36.776 20:20:54 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:36.776 20:20:54 -- setup/driver.sh@45 -- # setup output config 00:03:36.776 20:20:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:36.776 20:20:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:40.080 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.080 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.080 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.080 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.080 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.080 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.080 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.080 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.080 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.080 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.080 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.080 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.080 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.080 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.080 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.081 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.081 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.081 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.081 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.081 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.081 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.081 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.081 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.081 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.081 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.081 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.081 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.081 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.081 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.081 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.081 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.081 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.081 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.081 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.081 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.081 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.081 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.081 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.081 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.081 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.081 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.081 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.081 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.081 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.081 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.081 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.081 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.081 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.081 20:20:57 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:40.081 20:20:57 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:40.081 20:20:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.081 20:20:57 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:40.081 20:20:57 -- setup/driver.sh@65 -- # setup reset 00:03:40.081 20:20:57 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:40.081 20:20:57 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:44.290 00:03:44.290 real 0m7.874s 00:03:44.290 user 0m2.470s 00:03:44.290 sys 0m4.578s 00:03:44.290 20:21:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:44.290 20:21:02 -- common/autotest_common.sh@10 -- # set +x 00:03:44.290 ************************************ 00:03:44.290 END TEST guess_driver 00:03:44.290 ************************************ 00:03:44.290 00:03:44.290 real 0m12.706s 00:03:44.290 user 0m3.941s 00:03:44.290 sys 0m7.178s 00:03:44.290 20:21:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:44.290 20:21:02 -- common/autotest_common.sh@10 -- # set +x 00:03:44.290 ************************************ 00:03:44.290 END TEST driver 00:03:44.290 ************************************ 00:03:44.290 20:21:02 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:44.290 20:21:02 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:44.290 20:21:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:44.290 20:21:02 -- common/autotest_common.sh@10 -- # set +x 00:03:44.290 ************************************ 00:03:44.290 START TEST devices 00:03:44.290 ************************************ 00:03:44.290 20:21:02 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:44.290 * Looking for test storage... 00:03:44.290 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:44.290 20:21:02 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:44.290 20:21:02 -- setup/devices.sh@192 -- # setup reset 00:03:44.290 20:21:02 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:44.290 20:21:02 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:47.625 20:21:05 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:47.625 20:21:05 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:03:47.625 20:21:05 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:03:47.625 20:21:05 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:03:47.625 20:21:05 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:03:47.625 20:21:05 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:03:47.625 20:21:05 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:03:47.625 20:21:05 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:47.625 20:21:05 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:03:47.625 20:21:05 -- setup/devices.sh@196 -- # blocks=() 00:03:47.625 20:21:05 -- setup/devices.sh@196 -- # declare -a blocks 00:03:47.625 20:21:05 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:47.625 20:21:05 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:47.625 20:21:05 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:47.625 20:21:05 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:47.625 20:21:05 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:47.625 20:21:05 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:47.625 20:21:05 -- setup/devices.sh@202 -- # pci=0000:65:00.0 00:03:47.625 20:21:05 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\6\5\:\0\0\.\0* ]] 00:03:47.625 20:21:05 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:47.625 20:21:05 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:47.625 20:21:05 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:47.625 No valid GPT data, bailing 00:03:47.625 20:21:05 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:47.625 20:21:05 -- scripts/common.sh@393 -- # pt= 00:03:47.625 20:21:05 -- scripts/common.sh@394 -- # return 1 00:03:47.625 20:21:05 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:47.625 20:21:05 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:47.625 20:21:05 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:47.625 20:21:05 -- setup/common.sh@80 -- # echo 1920383410176 00:03:47.625 20:21:05 -- setup/devices.sh@204 -- # (( 1920383410176 >= min_disk_size )) 00:03:47.625 20:21:05 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:47.625 20:21:05 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:65:00.0 00:03:47.625 20:21:05 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:47.625 20:21:05 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:47.625 20:21:05 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:47.625 20:21:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:47.625 20:21:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:47.625 20:21:05 -- common/autotest_common.sh@10 -- # set +x 00:03:47.625 ************************************ 00:03:47.625 START TEST nvme_mount 00:03:47.625 ************************************ 00:03:47.625 20:21:05 -- common/autotest_common.sh@1104 -- # nvme_mount 00:03:47.625 20:21:05 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:47.625 20:21:05 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:47.625 20:21:05 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:47.625 20:21:05 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:47.625 20:21:05 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:47.625 20:21:05 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:47.625 20:21:05 -- setup/common.sh@40 -- # local part_no=1 00:03:47.625 20:21:05 -- setup/common.sh@41 -- # local size=1073741824 00:03:47.625 20:21:05 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:47.625 20:21:05 -- setup/common.sh@44 -- # parts=() 00:03:47.625 20:21:05 -- setup/common.sh@44 -- # local parts 00:03:47.625 20:21:05 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:47.625 20:21:05 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:47.625 20:21:05 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:47.625 20:21:05 -- setup/common.sh@46 -- # (( part++ )) 00:03:47.625 20:21:05 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:47.625 20:21:05 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:47.625 20:21:05 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:47.625 20:21:05 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:48.220 Creating new GPT entries in memory. 00:03:48.220 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:48.220 other utilities. 00:03:48.220 20:21:06 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:48.220 20:21:06 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:48.220 20:21:06 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:48.220 20:21:06 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:48.220 20:21:06 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:49.607 Creating new GPT entries in memory. 00:03:49.607 The operation has completed successfully. 00:03:49.607 20:21:07 -- setup/common.sh@57 -- # (( part++ )) 00:03:49.608 20:21:07 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:49.608 20:21:07 -- setup/common.sh@62 -- # wait 3811894 00:03:49.608 20:21:07 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:49.608 20:21:07 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:49.608 20:21:07 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:49.608 20:21:07 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:49.608 20:21:07 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:49.608 20:21:07 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:49.608 20:21:07 -- setup/devices.sh@105 -- # verify 0000:65:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:49.608 20:21:07 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:03:49.608 20:21:07 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:49.608 20:21:07 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:49.608 20:21:07 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:49.608 20:21:07 -- setup/devices.sh@53 -- # local found=0 00:03:49.608 20:21:07 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:49.608 20:21:07 -- setup/devices.sh@56 -- # : 00:03:49.608 20:21:07 -- setup/devices.sh@59 -- # local pci status 00:03:49.608 20:21:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.608 20:21:07 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:03:49.608 20:21:07 -- setup/devices.sh@47 -- # setup output config 00:03:49.608 20:21:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:49.608 20:21:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:52.912 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:52.913 20:21:10 -- setup/devices.sh@63 -- # found=1 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:52.913 20:21:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.913 20:21:10 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:52.913 20:21:10 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:52.913 20:21:10 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:52.913 20:21:10 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:52.913 20:21:10 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:52.913 20:21:10 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:52.913 20:21:10 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:52.913 20:21:11 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:52.913 20:21:11 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:52.913 20:21:11 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:52.913 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:52.913 20:21:11 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:52.913 20:21:11 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:53.173 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:53.173 /dev/nvme0n1: 8 bytes were erased at offset 0x1bf1fc55e00 (gpt): 45 46 49 20 50 41 52 54 00:03:53.173 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:53.173 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:53.173 20:21:11 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:53.173 20:21:11 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:53.173 20:21:11 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:53.173 20:21:11 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:53.173 20:21:11 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:53.173 20:21:11 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:53.173 20:21:11 -- setup/devices.sh@116 -- # verify 0000:65:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:53.173 20:21:11 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:03:53.173 20:21:11 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:53.173 20:21:11 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:53.173 20:21:11 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:53.173 20:21:11 -- setup/devices.sh@53 -- # local found=0 00:03:53.173 20:21:11 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:53.173 20:21:11 -- setup/devices.sh@56 -- # : 00:03:53.173 20:21:11 -- setup/devices.sh@59 -- # local pci status 00:03:53.173 20:21:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.173 20:21:11 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:03:53.173 20:21:11 -- setup/devices.sh@47 -- # setup output config 00:03:53.173 20:21:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:53.173 20:21:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:56.498 20:21:14 -- setup/devices.sh@63 -- # found=1 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:56.498 20:21:14 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:56.498 20:21:14 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:56.498 20:21:14 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:56.498 20:21:14 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:56.498 20:21:14 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:56.498 20:21:14 -- setup/devices.sh@125 -- # verify 0000:65:00.0 data@nvme0n1 '' '' 00:03:56.498 20:21:14 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:03:56.498 20:21:14 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:56.498 20:21:14 -- setup/devices.sh@50 -- # local mount_point= 00:03:56.498 20:21:14 -- setup/devices.sh@51 -- # local test_file= 00:03:56.498 20:21:14 -- setup/devices.sh@53 -- # local found=0 00:03:56.498 20:21:14 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:56.498 20:21:14 -- setup/devices.sh@59 -- # local pci status 00:03:56.498 20:21:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.498 20:21:14 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:03:56.498 20:21:14 -- setup/devices.sh@47 -- # setup output config 00:03:56.498 20:21:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:56.498 20:21:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:59.802 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.802 20:21:18 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:59.802 20:21:18 -- setup/devices.sh@63 -- # found=1 00:03:59.802 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.802 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.802 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.802 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.802 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.802 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.802 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.802 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.803 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.803 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.803 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.803 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.803 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.803 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.803 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.803 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.803 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.803 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.803 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.803 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.803 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.803 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.803 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.803 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.803 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.803 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.803 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.803 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.803 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.803 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.803 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.803 20:21:18 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.803 20:21:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.102 20:21:18 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:00.102 20:21:18 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:00.102 20:21:18 -- setup/devices.sh@68 -- # return 0 00:04:00.102 20:21:18 -- setup/devices.sh@128 -- # cleanup_nvme 00:04:00.102 20:21:18 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:00.102 20:21:18 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:00.102 20:21:18 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:00.102 20:21:18 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:00.102 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:00.102 00:04:00.102 real 0m12.787s 00:04:00.102 user 0m3.959s 00:04:00.102 sys 0m6.743s 00:04:00.102 20:21:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:00.102 20:21:18 -- common/autotest_common.sh@10 -- # set +x 00:04:00.102 ************************************ 00:04:00.102 END TEST nvme_mount 00:04:00.102 ************************************ 00:04:00.102 20:21:18 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:04:00.102 20:21:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:00.102 20:21:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:00.102 20:21:18 -- common/autotest_common.sh@10 -- # set +x 00:04:00.102 ************************************ 00:04:00.102 START TEST dm_mount 00:04:00.102 ************************************ 00:04:00.102 20:21:18 -- common/autotest_common.sh@1104 -- # dm_mount 00:04:00.102 20:21:18 -- setup/devices.sh@144 -- # pv=nvme0n1 00:04:00.102 20:21:18 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:04:00.102 20:21:18 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:04:00.102 20:21:18 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:04:00.102 20:21:18 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:00.102 20:21:18 -- setup/common.sh@40 -- # local part_no=2 00:04:00.102 20:21:18 -- setup/common.sh@41 -- # local size=1073741824 00:04:00.102 20:21:18 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:00.102 20:21:18 -- setup/common.sh@44 -- # parts=() 00:04:00.102 20:21:18 -- setup/common.sh@44 -- # local parts 00:04:00.102 20:21:18 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:00.102 20:21:18 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:00.102 20:21:18 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:00.102 20:21:18 -- setup/common.sh@46 -- # (( part++ )) 00:04:00.102 20:21:18 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:00.102 20:21:18 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:00.102 20:21:18 -- setup/common.sh@46 -- # (( part++ )) 00:04:00.102 20:21:18 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:00.102 20:21:18 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:00.102 20:21:18 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:00.102 20:21:18 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:04:01.043 Creating new GPT entries in memory. 00:04:01.043 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:01.043 other utilities. 00:04:01.043 20:21:19 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:01.043 20:21:19 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:01.043 20:21:19 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:01.043 20:21:19 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:01.043 20:21:19 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:02.428 Creating new GPT entries in memory. 00:04:02.428 The operation has completed successfully. 00:04:02.428 20:21:20 -- setup/common.sh@57 -- # (( part++ )) 00:04:02.428 20:21:20 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:02.428 20:21:20 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:02.428 20:21:20 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:02.428 20:21:20 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:04:03.370 The operation has completed successfully. 00:04:03.370 20:21:21 -- setup/common.sh@57 -- # (( part++ )) 00:04:03.370 20:21:21 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:03.370 20:21:21 -- setup/common.sh@62 -- # wait 3817501 00:04:03.370 20:21:21 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:04:03.370 20:21:21 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:03.370 20:21:21 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:03.370 20:21:21 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:04:03.370 20:21:21 -- setup/devices.sh@160 -- # for t in {1..5} 00:04:03.370 20:21:21 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:03.370 20:21:21 -- setup/devices.sh@161 -- # break 00:04:03.370 20:21:21 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:03.370 20:21:21 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:04:03.370 20:21:21 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:04:03.370 20:21:21 -- setup/devices.sh@166 -- # dm=dm-0 00:04:03.370 20:21:21 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:04:03.370 20:21:21 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:04:03.371 20:21:21 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:03.371 20:21:21 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:04:03.371 20:21:21 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:03.371 20:21:21 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:03.371 20:21:21 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:04:03.371 20:21:21 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:03.371 20:21:21 -- setup/devices.sh@174 -- # verify 0000:65:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:03.371 20:21:21 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:04:03.371 20:21:21 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:04:03.371 20:21:21 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:03.371 20:21:21 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:03.371 20:21:21 -- setup/devices.sh@53 -- # local found=0 00:04:03.371 20:21:21 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:03.371 20:21:21 -- setup/devices.sh@56 -- # : 00:04:03.371 20:21:21 -- setup/devices.sh@59 -- # local pci status 00:04:03.371 20:21:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.371 20:21:21 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:04:03.371 20:21:21 -- setup/devices.sh@47 -- # setup output config 00:04:03.371 20:21:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:03.371 20:21:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:04:06.677 20:21:24 -- setup/devices.sh@63 -- # found=1 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:06.677 20:21:24 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:04:06.677 20:21:24 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:06.677 20:21:24 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:06.677 20:21:24 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:06.677 20:21:24 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:06.677 20:21:24 -- setup/devices.sh@184 -- # verify 0000:65:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:04:06.677 20:21:24 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:04:06.677 20:21:24 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:04:06.677 20:21:24 -- setup/devices.sh@50 -- # local mount_point= 00:04:06.677 20:21:24 -- setup/devices.sh@51 -- # local test_file= 00:04:06.677 20:21:24 -- setup/devices.sh@53 -- # local found=0 00:04:06.677 20:21:24 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:06.677 20:21:24 -- setup/devices.sh@59 -- # local pci status 00:04:06.677 20:21:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:06.677 20:21:24 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:04:06.677 20:21:24 -- setup/devices.sh@47 -- # setup output config 00:04:06.677 20:21:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:06.677 20:21:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:04:09.985 20:21:28 -- setup/devices.sh@63 -- # found=1 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.985 20:21:28 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:09.985 20:21:28 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:09.985 20:21:28 -- setup/devices.sh@68 -- # return 0 00:04:09.985 20:21:28 -- setup/devices.sh@187 -- # cleanup_dm 00:04:09.985 20:21:28 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:09.985 20:21:28 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:09.985 20:21:28 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:09.985 20:21:28 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:09.985 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:09.985 20:21:28 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:09.985 20:21:28 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:09.985 00:04:09.985 real 0m9.988s 00:04:09.985 user 0m2.639s 00:04:09.985 sys 0m4.427s 00:04:09.985 20:21:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:09.985 20:21:28 -- common/autotest_common.sh@10 -- # set +x 00:04:09.985 ************************************ 00:04:09.985 END TEST dm_mount 00:04:09.985 ************************************ 00:04:10.246 20:21:28 -- setup/devices.sh@1 -- # cleanup 00:04:10.246 20:21:28 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:10.246 20:21:28 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:10.246 20:21:28 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:10.246 20:21:28 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:10.246 20:21:28 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:10.246 20:21:28 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:10.507 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:10.507 /dev/nvme0n1: 8 bytes were erased at offset 0x1bf1fc55e00 (gpt): 45 46 49 20 50 41 52 54 00:04:10.507 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:10.507 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:10.507 20:21:28 -- setup/devices.sh@12 -- # cleanup_dm 00:04:10.507 20:21:28 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:10.507 20:21:28 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:10.507 20:21:28 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:10.508 20:21:28 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:10.508 20:21:28 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:10.508 20:21:28 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:10.508 00:04:10.508 real 0m26.355s 00:04:10.508 user 0m7.783s 00:04:10.508 sys 0m13.320s 00:04:10.508 20:21:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:10.508 20:21:28 -- common/autotest_common.sh@10 -- # set +x 00:04:10.508 ************************************ 00:04:10.508 END TEST devices 00:04:10.508 ************************************ 00:04:10.508 00:04:10.508 real 1m27.469s 00:04:10.508 user 0m29.012s 00:04:10.508 sys 0m49.659s 00:04:10.508 20:21:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:10.508 20:21:28 -- common/autotest_common.sh@10 -- # set +x 00:04:10.508 ************************************ 00:04:10.508 END TEST setup.sh 00:04:10.508 ************************************ 00:04:10.508 20:21:28 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:13.812 Hugepages 00:04:13.812 node hugesize free / total 00:04:13.812 node0 1048576kB 0 / 0 00:04:13.812 node0 2048kB 2048 / 2048 00:04:13.812 node1 1048576kB 0 / 0 00:04:13.812 node1 2048kB 0 / 0 00:04:13.812 00:04:13.812 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:13.812 I/OAT 0000:00:01.0 8086 0b00 0 ioatdma - - 00:04:13.812 I/OAT 0000:00:01.1 8086 0b00 0 ioatdma - - 00:04:13.812 I/OAT 0000:00:01.2 8086 0b00 0 ioatdma - - 00:04:13.812 I/OAT 0000:00:01.3 8086 0b00 0 ioatdma - - 00:04:13.812 I/OAT 0000:00:01.4 8086 0b00 0 ioatdma - - 00:04:13.812 I/OAT 0000:00:01.5 8086 0b00 0 ioatdma - - 00:04:13.812 I/OAT 0000:00:01.6 8086 0b00 0 ioatdma - - 00:04:13.812 I/OAT 0000:00:01.7 8086 0b00 0 ioatdma - - 00:04:13.812 NVMe 0000:65:00.0 144d a80a 0 nvme nvme0 nvme0n1 00:04:13.812 I/OAT 0000:80:01.0 8086 0b00 1 ioatdma - - 00:04:13.812 I/OAT 0000:80:01.1 8086 0b00 1 ioatdma - - 00:04:13.812 I/OAT 0000:80:01.2 8086 0b00 1 ioatdma - - 00:04:13.812 I/OAT 0000:80:01.3 8086 0b00 1 ioatdma - - 00:04:13.812 I/OAT 0000:80:01.4 8086 0b00 1 ioatdma - - 00:04:13.812 I/OAT 0000:80:01.5 8086 0b00 1 ioatdma - - 00:04:13.812 I/OAT 0000:80:01.6 8086 0b00 1 ioatdma - - 00:04:13.812 I/OAT 0000:80:01.7 8086 0b00 1 ioatdma - - 00:04:13.812 20:21:31 -- spdk/autotest.sh@141 -- # uname -s 00:04:13.812 20:21:31 -- spdk/autotest.sh@141 -- # [[ Linux == Linux ]] 00:04:13.812 20:21:31 -- spdk/autotest.sh@143 -- # nvme_namespace_revert 00:04:13.812 20:21:31 -- common/autotest_common.sh@1516 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:16.361 0000:80:01.6 (8086 0b00): ioatdma -> vfio-pci 00:04:16.361 0000:80:01.7 (8086 0b00): ioatdma -> vfio-pci 00:04:16.361 0000:80:01.4 (8086 0b00): ioatdma -> vfio-pci 00:04:16.361 0000:80:01.5 (8086 0b00): ioatdma -> vfio-pci 00:04:16.361 0000:80:01.2 (8086 0b00): ioatdma -> vfio-pci 00:04:16.361 0000:80:01.3 (8086 0b00): ioatdma -> vfio-pci 00:04:16.361 0000:80:01.0 (8086 0b00): ioatdma -> vfio-pci 00:04:16.361 0000:80:01.1 (8086 0b00): ioatdma -> vfio-pci 00:04:16.361 0000:00:01.6 (8086 0b00): ioatdma -> vfio-pci 00:04:16.361 0000:00:01.7 (8086 0b00): ioatdma -> vfio-pci 00:04:16.361 0000:00:01.4 (8086 0b00): ioatdma -> vfio-pci 00:04:16.361 0000:00:01.5 (8086 0b00): ioatdma -> vfio-pci 00:04:16.361 0000:00:01.2 (8086 0b00): ioatdma -> vfio-pci 00:04:16.622 0000:00:01.3 (8086 0b00): ioatdma -> vfio-pci 00:04:16.622 0000:00:01.0 (8086 0b00): ioatdma -> vfio-pci 00:04:16.622 0000:00:01.1 (8086 0b00): ioatdma -> vfio-pci 00:04:18.534 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:04:18.534 20:21:36 -- common/autotest_common.sh@1517 -- # sleep 1 00:04:19.478 20:21:37 -- common/autotest_common.sh@1518 -- # bdfs=() 00:04:19.478 20:21:37 -- common/autotest_common.sh@1518 -- # local bdfs 00:04:19.478 20:21:37 -- common/autotest_common.sh@1519 -- # bdfs=($(get_nvme_bdfs)) 00:04:19.478 20:21:37 -- common/autotest_common.sh@1519 -- # get_nvme_bdfs 00:04:19.478 20:21:37 -- common/autotest_common.sh@1498 -- # bdfs=() 00:04:19.478 20:21:37 -- common/autotest_common.sh@1498 -- # local bdfs 00:04:19.478 20:21:37 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:19.478 20:21:37 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:19.478 20:21:37 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:04:19.478 20:21:37 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:04:19.478 20:21:37 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:65:00.0 00:04:19.478 20:21:37 -- common/autotest_common.sh@1521 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:22.806 Waiting for block devices as requested 00:04:22.806 0000:80:01.6 (8086 0b00): vfio-pci -> ioatdma 00:04:22.806 0000:80:01.7 (8086 0b00): vfio-pci -> ioatdma 00:04:23.066 0000:80:01.4 (8086 0b00): vfio-pci -> ioatdma 00:04:23.066 0000:80:01.5 (8086 0b00): vfio-pci -> ioatdma 00:04:23.066 0000:80:01.2 (8086 0b00): vfio-pci -> ioatdma 00:04:23.326 0000:80:01.3 (8086 0b00): vfio-pci -> ioatdma 00:04:23.326 0000:80:01.0 (8086 0b00): vfio-pci -> ioatdma 00:04:23.326 0000:80:01.1 (8086 0b00): vfio-pci -> ioatdma 00:04:23.587 0000:65:00.0 (144d a80a): vfio-pci -> nvme 00:04:23.587 0000:00:01.6 (8086 0b00): vfio-pci -> ioatdma 00:04:23.587 0000:00:01.7 (8086 0b00): vfio-pci -> ioatdma 00:04:23.848 0000:00:01.4 (8086 0b00): vfio-pci -> ioatdma 00:04:23.848 0000:00:01.5 (8086 0b00): vfio-pci -> ioatdma 00:04:23.848 0000:00:01.2 (8086 0b00): vfio-pci -> ioatdma 00:04:23.848 0000:00:01.3 (8086 0b00): vfio-pci -> ioatdma 00:04:24.109 0000:00:01.0 (8086 0b00): vfio-pci -> ioatdma 00:04:24.109 0000:00:01.1 (8086 0b00): vfio-pci -> ioatdma 00:04:24.109 20:21:42 -- common/autotest_common.sh@1523 -- # for bdf in "${bdfs[@]}" 00:04:24.109 20:21:42 -- common/autotest_common.sh@1524 -- # get_nvme_ctrlr_from_bdf 0000:65:00.0 00:04:24.109 20:21:42 -- common/autotest_common.sh@1487 -- # readlink -f /sys/class/nvme/nvme0 00:04:24.109 20:21:42 -- common/autotest_common.sh@1487 -- # grep 0000:65:00.0/nvme/nvme 00:04:24.109 20:21:42 -- common/autotest_common.sh@1487 -- # bdf_sysfs_path=/sys/devices/pci0000:64/0000:64:02.0/0000:65:00.0/nvme/nvme0 00:04:24.109 20:21:42 -- common/autotest_common.sh@1488 -- # [[ -z /sys/devices/pci0000:64/0000:64:02.0/0000:65:00.0/nvme/nvme0 ]] 00:04:24.109 20:21:42 -- common/autotest_common.sh@1492 -- # basename /sys/devices/pci0000:64/0000:64:02.0/0000:65:00.0/nvme/nvme0 00:04:24.109 20:21:42 -- common/autotest_common.sh@1492 -- # printf '%s\n' nvme0 00:04:24.109 20:21:42 -- common/autotest_common.sh@1524 -- # nvme_ctrlr=/dev/nvme0 00:04:24.109 20:21:42 -- common/autotest_common.sh@1525 -- # [[ -z /dev/nvme0 ]] 00:04:24.109 20:21:42 -- common/autotest_common.sh@1530 -- # nvme id-ctrl /dev/nvme0 00:04:24.109 20:21:42 -- common/autotest_common.sh@1530 -- # grep oacs 00:04:24.109 20:21:42 -- common/autotest_common.sh@1530 -- # cut -d: -f2 00:04:24.109 20:21:42 -- common/autotest_common.sh@1530 -- # oacs=' 0x5f' 00:04:24.109 20:21:42 -- common/autotest_common.sh@1531 -- # oacs_ns_manage=8 00:04:24.109 20:21:42 -- common/autotest_common.sh@1533 -- # [[ 8 -ne 0 ]] 00:04:24.109 20:21:42 -- common/autotest_common.sh@1539 -- # nvme id-ctrl /dev/nvme0 00:04:24.109 20:21:42 -- common/autotest_common.sh@1539 -- # grep unvmcap 00:04:24.109 20:21:42 -- common/autotest_common.sh@1539 -- # cut -d: -f2 00:04:24.109 20:21:42 -- common/autotest_common.sh@1539 -- # unvmcap=' 0' 00:04:24.109 20:21:42 -- common/autotest_common.sh@1540 -- # [[ 0 -eq 0 ]] 00:04:24.109 20:21:42 -- common/autotest_common.sh@1542 -- # continue 00:04:24.109 20:21:42 -- spdk/autotest.sh@146 -- # timing_exit pre_cleanup 00:04:24.109 20:21:42 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:24.109 20:21:42 -- common/autotest_common.sh@10 -- # set +x 00:04:24.109 20:21:42 -- spdk/autotest.sh@149 -- # timing_enter afterboot 00:04:24.109 20:21:42 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:24.109 20:21:42 -- common/autotest_common.sh@10 -- # set +x 00:04:24.109 20:21:42 -- spdk/autotest.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:28.333 0000:80:01.6 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:80:01.7 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:80:01.4 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:80:01.5 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:80:01.2 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:80:01.3 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:80:01.0 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:80:01.1 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:00:01.6 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:00:01.7 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:00:01.4 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:00:01.5 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:00:01.2 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:00:01.3 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:00:01.0 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:00:01.1 (8086 0b00): ioatdma -> vfio-pci 00:04:28.333 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:04:28.333 20:21:46 -- spdk/autotest.sh@151 -- # timing_exit afterboot 00:04:28.333 20:21:46 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:28.333 20:21:46 -- common/autotest_common.sh@10 -- # set +x 00:04:28.333 20:21:46 -- spdk/autotest.sh@155 -- # opal_revert_cleanup 00:04:28.333 20:21:46 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:04:28.333 20:21:46 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:04:28.333 20:21:46 -- common/autotest_common.sh@1562 -- # bdfs=() 00:04:28.333 20:21:46 -- common/autotest_common.sh@1562 -- # local bdfs 00:04:28.333 20:21:46 -- common/autotest_common.sh@1564 -- # get_nvme_bdfs 00:04:28.333 20:21:46 -- common/autotest_common.sh@1498 -- # bdfs=() 00:04:28.333 20:21:46 -- common/autotest_common.sh@1498 -- # local bdfs 00:04:28.333 20:21:46 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:28.333 20:21:46 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:28.333 20:21:46 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:04:28.333 20:21:46 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:04:28.333 20:21:46 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:65:00.0 00:04:28.333 20:21:46 -- common/autotest_common.sh@1564 -- # for bdf in $(get_nvme_bdfs) 00:04:28.333 20:21:46 -- common/autotest_common.sh@1565 -- # cat /sys/bus/pci/devices/0000:65:00.0/device 00:04:28.333 20:21:46 -- common/autotest_common.sh@1565 -- # device=0xa80a 00:04:28.333 20:21:46 -- common/autotest_common.sh@1566 -- # [[ 0xa80a == \0\x\0\a\5\4 ]] 00:04:28.333 20:21:46 -- common/autotest_common.sh@1571 -- # printf '%s\n' 00:04:28.333 20:21:46 -- common/autotest_common.sh@1577 -- # [[ -z '' ]] 00:04:28.333 20:21:46 -- common/autotest_common.sh@1578 -- # return 0 00:04:28.333 20:21:46 -- spdk/autotest.sh@161 -- # '[' 0 -eq 1 ']' 00:04:28.333 20:21:46 -- spdk/autotest.sh@165 -- # '[' 1 -eq 1 ']' 00:04:28.333 20:21:46 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:04:28.333 20:21:46 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:04:28.333 20:21:46 -- spdk/autotest.sh@173 -- # timing_enter lib 00:04:28.333 20:21:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:28.333 20:21:46 -- common/autotest_common.sh@10 -- # set +x 00:04:28.333 20:21:46 -- spdk/autotest.sh@175 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:28.333 20:21:46 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:28.333 20:21:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:28.333 20:21:46 -- common/autotest_common.sh@10 -- # set +x 00:04:28.333 ************************************ 00:04:28.333 START TEST env 00:04:28.333 ************************************ 00:04:28.333 20:21:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:28.333 * Looking for test storage... 00:04:28.333 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:28.333 20:21:46 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:28.333 20:21:46 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:28.333 20:21:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:28.333 20:21:46 -- common/autotest_common.sh@10 -- # set +x 00:04:28.333 ************************************ 00:04:28.333 START TEST env_memory 00:04:28.333 ************************************ 00:04:28.333 20:21:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:28.333 00:04:28.333 00:04:28.333 CUnit - A unit testing framework for C - Version 2.1-3 00:04:28.333 http://cunit.sourceforge.net/ 00:04:28.333 00:04:28.333 00:04:28.333 Suite: memory 00:04:28.333 Test: alloc and free memory map ...[2024-04-26 20:21:46.358608] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:28.333 passed 00:04:28.333 Test: mem map translation ...[2024-04-26 20:21:46.384071] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:28.333 [2024-04-26 20:21:46.384094] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:28.333 [2024-04-26 20:21:46.384141] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:28.333 [2024-04-26 20:21:46.384148] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:28.333 passed 00:04:28.333 Test: mem map registration ...[2024-04-26 20:21:46.439181] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:28.333 [2024-04-26 20:21:46.439199] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:28.333 passed 00:04:28.333 Test: mem map adjacent registrations ...passed 00:04:28.333 00:04:28.333 Run Summary: Type Total Ran Passed Failed Inactive 00:04:28.333 suites 1 1 n/a 0 0 00:04:28.333 tests 4 4 4 0 0 00:04:28.333 asserts 152 152 152 0 n/a 00:04:28.333 00:04:28.333 Elapsed time = 0.194 seconds 00:04:28.333 00:04:28.333 real 0m0.207s 00:04:28.333 user 0m0.196s 00:04:28.333 sys 0m0.010s 00:04:28.333 20:21:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:28.333 20:21:46 -- common/autotest_common.sh@10 -- # set +x 00:04:28.333 ************************************ 00:04:28.333 END TEST env_memory 00:04:28.333 ************************************ 00:04:28.333 20:21:46 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:28.333 20:21:46 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:28.333 20:21:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:28.334 20:21:46 -- common/autotest_common.sh@10 -- # set +x 00:04:28.334 ************************************ 00:04:28.334 START TEST env_vtophys 00:04:28.334 ************************************ 00:04:28.334 20:21:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:28.334 EAL: lib.eal log level changed from notice to debug 00:04:28.334 EAL: Detected lcore 0 as core 0 on socket 0 00:04:28.334 EAL: Detected lcore 1 as core 1 on socket 0 00:04:28.334 EAL: Detected lcore 2 as core 2 on socket 0 00:04:28.334 EAL: Detected lcore 3 as core 3 on socket 0 00:04:28.334 EAL: Detected lcore 4 as core 4 on socket 0 00:04:28.334 EAL: Detected lcore 5 as core 5 on socket 0 00:04:28.334 EAL: Detected lcore 6 as core 6 on socket 0 00:04:28.334 EAL: Detected lcore 7 as core 7 on socket 0 00:04:28.334 EAL: Detected lcore 8 as core 8 on socket 0 00:04:28.334 EAL: Detected lcore 9 as core 9 on socket 0 00:04:28.334 EAL: Detected lcore 10 as core 10 on socket 0 00:04:28.334 EAL: Detected lcore 11 as core 11 on socket 0 00:04:28.334 EAL: Detected lcore 12 as core 12 on socket 0 00:04:28.334 EAL: Detected lcore 13 as core 13 on socket 0 00:04:28.334 EAL: Detected lcore 14 as core 14 on socket 0 00:04:28.334 EAL: Detected lcore 15 as core 15 on socket 0 00:04:28.334 EAL: Detected lcore 16 as core 16 on socket 0 00:04:28.334 EAL: Detected lcore 17 as core 17 on socket 0 00:04:28.334 EAL: Detected lcore 18 as core 18 on socket 0 00:04:28.334 EAL: Detected lcore 19 as core 19 on socket 0 00:04:28.334 EAL: Detected lcore 20 as core 20 on socket 0 00:04:28.334 EAL: Detected lcore 21 as core 21 on socket 0 00:04:28.334 EAL: Detected lcore 22 as core 22 on socket 0 00:04:28.334 EAL: Detected lcore 23 as core 23 on socket 0 00:04:28.334 EAL: Detected lcore 24 as core 24 on socket 0 00:04:28.334 EAL: Detected lcore 25 as core 25 on socket 0 00:04:28.334 EAL: Detected lcore 26 as core 26 on socket 0 00:04:28.334 EAL: Detected lcore 27 as core 27 on socket 0 00:04:28.334 EAL: Detected lcore 28 as core 28 on socket 0 00:04:28.334 EAL: Detected lcore 29 as core 29 on socket 0 00:04:28.334 EAL: Detected lcore 30 as core 30 on socket 0 00:04:28.334 EAL: Detected lcore 31 as core 31 on socket 0 00:04:28.334 EAL: Detected lcore 32 as core 32 on socket 0 00:04:28.334 EAL: Detected lcore 33 as core 33 on socket 0 00:04:28.334 EAL: Detected lcore 34 as core 34 on socket 0 00:04:28.334 EAL: Detected lcore 35 as core 35 on socket 0 00:04:28.334 EAL: Detected lcore 36 as core 0 on socket 1 00:04:28.334 EAL: Detected lcore 37 as core 1 on socket 1 00:04:28.334 EAL: Detected lcore 38 as core 2 on socket 1 00:04:28.334 EAL: Detected lcore 39 as core 3 on socket 1 00:04:28.334 EAL: Detected lcore 40 as core 4 on socket 1 00:04:28.334 EAL: Detected lcore 41 as core 5 on socket 1 00:04:28.334 EAL: Detected lcore 42 as core 6 on socket 1 00:04:28.334 EAL: Detected lcore 43 as core 7 on socket 1 00:04:28.334 EAL: Detected lcore 44 as core 8 on socket 1 00:04:28.334 EAL: Detected lcore 45 as core 9 on socket 1 00:04:28.334 EAL: Detected lcore 46 as core 10 on socket 1 00:04:28.334 EAL: Detected lcore 47 as core 11 on socket 1 00:04:28.334 EAL: Detected lcore 48 as core 12 on socket 1 00:04:28.334 EAL: Detected lcore 49 as core 13 on socket 1 00:04:28.334 EAL: Detected lcore 50 as core 14 on socket 1 00:04:28.334 EAL: Detected lcore 51 as core 15 on socket 1 00:04:28.334 EAL: Detected lcore 52 as core 16 on socket 1 00:04:28.334 EAL: Detected lcore 53 as core 17 on socket 1 00:04:28.334 EAL: Detected lcore 54 as core 18 on socket 1 00:04:28.334 EAL: Detected lcore 55 as core 19 on socket 1 00:04:28.334 EAL: Detected lcore 56 as core 20 on socket 1 00:04:28.334 EAL: Detected lcore 57 as core 21 on socket 1 00:04:28.334 EAL: Detected lcore 58 as core 22 on socket 1 00:04:28.334 EAL: Detected lcore 59 as core 23 on socket 1 00:04:28.334 EAL: Detected lcore 60 as core 24 on socket 1 00:04:28.334 EAL: Detected lcore 61 as core 25 on socket 1 00:04:28.334 EAL: Detected lcore 62 as core 26 on socket 1 00:04:28.334 EAL: Detected lcore 63 as core 27 on socket 1 00:04:28.334 EAL: Detected lcore 64 as core 28 on socket 1 00:04:28.334 EAL: Detected lcore 65 as core 29 on socket 1 00:04:28.334 EAL: Detected lcore 66 as core 30 on socket 1 00:04:28.334 EAL: Detected lcore 67 as core 31 on socket 1 00:04:28.334 EAL: Detected lcore 68 as core 32 on socket 1 00:04:28.334 EAL: Detected lcore 69 as core 33 on socket 1 00:04:28.334 EAL: Detected lcore 70 as core 34 on socket 1 00:04:28.334 EAL: Detected lcore 71 as core 35 on socket 1 00:04:28.334 EAL: Detected lcore 72 as core 0 on socket 0 00:04:28.334 EAL: Detected lcore 73 as core 1 on socket 0 00:04:28.334 EAL: Detected lcore 74 as core 2 on socket 0 00:04:28.334 EAL: Detected lcore 75 as core 3 on socket 0 00:04:28.334 EAL: Detected lcore 76 as core 4 on socket 0 00:04:28.334 EAL: Detected lcore 77 as core 5 on socket 0 00:04:28.334 EAL: Detected lcore 78 as core 6 on socket 0 00:04:28.334 EAL: Detected lcore 79 as core 7 on socket 0 00:04:28.334 EAL: Detected lcore 80 as core 8 on socket 0 00:04:28.334 EAL: Detected lcore 81 as core 9 on socket 0 00:04:28.334 EAL: Detected lcore 82 as core 10 on socket 0 00:04:28.334 EAL: Detected lcore 83 as core 11 on socket 0 00:04:28.334 EAL: Detected lcore 84 as core 12 on socket 0 00:04:28.334 EAL: Detected lcore 85 as core 13 on socket 0 00:04:28.334 EAL: Detected lcore 86 as core 14 on socket 0 00:04:28.334 EAL: Detected lcore 87 as core 15 on socket 0 00:04:28.334 EAL: Detected lcore 88 as core 16 on socket 0 00:04:28.334 EAL: Detected lcore 89 as core 17 on socket 0 00:04:28.334 EAL: Detected lcore 90 as core 18 on socket 0 00:04:28.334 EAL: Detected lcore 91 as core 19 on socket 0 00:04:28.334 EAL: Detected lcore 92 as core 20 on socket 0 00:04:28.334 EAL: Detected lcore 93 as core 21 on socket 0 00:04:28.334 EAL: Detected lcore 94 as core 22 on socket 0 00:04:28.334 EAL: Detected lcore 95 as core 23 on socket 0 00:04:28.334 EAL: Detected lcore 96 as core 24 on socket 0 00:04:28.334 EAL: Detected lcore 97 as core 25 on socket 0 00:04:28.334 EAL: Detected lcore 98 as core 26 on socket 0 00:04:28.334 EAL: Detected lcore 99 as core 27 on socket 0 00:04:28.334 EAL: Detected lcore 100 as core 28 on socket 0 00:04:28.334 EAL: Detected lcore 101 as core 29 on socket 0 00:04:28.334 EAL: Detected lcore 102 as core 30 on socket 0 00:04:28.334 EAL: Detected lcore 103 as core 31 on socket 0 00:04:28.334 EAL: Detected lcore 104 as core 32 on socket 0 00:04:28.334 EAL: Detected lcore 105 as core 33 on socket 0 00:04:28.334 EAL: Detected lcore 106 as core 34 on socket 0 00:04:28.334 EAL: Detected lcore 107 as core 35 on socket 0 00:04:28.334 EAL: Detected lcore 108 as core 0 on socket 1 00:04:28.334 EAL: Detected lcore 109 as core 1 on socket 1 00:04:28.334 EAL: Detected lcore 110 as core 2 on socket 1 00:04:28.334 EAL: Detected lcore 111 as core 3 on socket 1 00:04:28.334 EAL: Detected lcore 112 as core 4 on socket 1 00:04:28.334 EAL: Detected lcore 113 as core 5 on socket 1 00:04:28.334 EAL: Detected lcore 114 as core 6 on socket 1 00:04:28.334 EAL: Detected lcore 115 as core 7 on socket 1 00:04:28.334 EAL: Detected lcore 116 as core 8 on socket 1 00:04:28.334 EAL: Detected lcore 117 as core 9 on socket 1 00:04:28.334 EAL: Detected lcore 118 as core 10 on socket 1 00:04:28.334 EAL: Detected lcore 119 as core 11 on socket 1 00:04:28.334 EAL: Detected lcore 120 as core 12 on socket 1 00:04:28.334 EAL: Detected lcore 121 as core 13 on socket 1 00:04:28.334 EAL: Detected lcore 122 as core 14 on socket 1 00:04:28.334 EAL: Detected lcore 123 as core 15 on socket 1 00:04:28.334 EAL: Detected lcore 124 as core 16 on socket 1 00:04:28.334 EAL: Detected lcore 125 as core 17 on socket 1 00:04:28.334 EAL: Detected lcore 126 as core 18 on socket 1 00:04:28.334 EAL: Detected lcore 127 as core 19 on socket 1 00:04:28.334 EAL: Skipped lcore 128 as core 20 on socket 1 00:04:28.334 EAL: Skipped lcore 129 as core 21 on socket 1 00:04:28.334 EAL: Skipped lcore 130 as core 22 on socket 1 00:04:28.334 EAL: Skipped lcore 131 as core 23 on socket 1 00:04:28.334 EAL: Skipped lcore 132 as core 24 on socket 1 00:04:28.334 EAL: Skipped lcore 133 as core 25 on socket 1 00:04:28.334 EAL: Skipped lcore 134 as core 26 on socket 1 00:04:28.334 EAL: Skipped lcore 135 as core 27 on socket 1 00:04:28.334 EAL: Skipped lcore 136 as core 28 on socket 1 00:04:28.334 EAL: Skipped lcore 137 as core 29 on socket 1 00:04:28.334 EAL: Skipped lcore 138 as core 30 on socket 1 00:04:28.334 EAL: Skipped lcore 139 as core 31 on socket 1 00:04:28.334 EAL: Skipped lcore 140 as core 32 on socket 1 00:04:28.334 EAL: Skipped lcore 141 as core 33 on socket 1 00:04:28.334 EAL: Skipped lcore 142 as core 34 on socket 1 00:04:28.334 EAL: Skipped lcore 143 as core 35 on socket 1 00:04:28.334 EAL: Maximum logical cores by configuration: 128 00:04:28.334 EAL: Detected CPU lcores: 128 00:04:28.334 EAL: Detected NUMA nodes: 2 00:04:28.334 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:28.334 EAL: Detected shared linkage of DPDK 00:04:28.334 EAL: No shared files mode enabled, IPC will be disabled 00:04:28.334 EAL: Bus pci wants IOVA as 'DC' 00:04:28.334 EAL: Buses did not request a specific IOVA mode. 00:04:28.334 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:28.334 EAL: Selected IOVA mode 'VA' 00:04:28.334 EAL: No free 2048 kB hugepages reported on node 1 00:04:28.334 EAL: Probing VFIO support... 00:04:28.334 EAL: IOMMU type 1 (Type 1) is supported 00:04:28.334 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:28.334 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:28.334 EAL: VFIO support initialized 00:04:28.334 EAL: Ask a virtual area of 0x2e000 bytes 00:04:28.334 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:28.334 EAL: Setting up physically contiguous memory... 00:04:28.334 EAL: Setting maximum number of open files to 524288 00:04:28.334 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:28.334 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:28.334 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:28.334 EAL: Ask a virtual area of 0x61000 bytes 00:04:28.334 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:28.334 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:28.334 EAL: Ask a virtual area of 0x400000000 bytes 00:04:28.334 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:28.334 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:28.334 EAL: Ask a virtual area of 0x61000 bytes 00:04:28.334 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:28.334 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:28.334 EAL: Ask a virtual area of 0x400000000 bytes 00:04:28.334 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:28.334 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:28.334 EAL: Ask a virtual area of 0x61000 bytes 00:04:28.334 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:28.334 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:28.334 EAL: Ask a virtual area of 0x400000000 bytes 00:04:28.334 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:28.334 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:28.334 EAL: Ask a virtual area of 0x61000 bytes 00:04:28.334 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:28.334 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:28.334 EAL: Ask a virtual area of 0x400000000 bytes 00:04:28.334 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:28.334 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:28.334 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:28.334 EAL: Ask a virtual area of 0x61000 bytes 00:04:28.334 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:28.334 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:28.334 EAL: Ask a virtual area of 0x400000000 bytes 00:04:28.334 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:28.334 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:28.334 EAL: Ask a virtual area of 0x61000 bytes 00:04:28.334 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:28.334 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:28.334 EAL: Ask a virtual area of 0x400000000 bytes 00:04:28.334 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:28.334 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:28.334 EAL: Ask a virtual area of 0x61000 bytes 00:04:28.334 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:28.334 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:28.334 EAL: Ask a virtual area of 0x400000000 bytes 00:04:28.334 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:28.334 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:28.334 EAL: Ask a virtual area of 0x61000 bytes 00:04:28.334 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:28.334 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:28.334 EAL: Ask a virtual area of 0x400000000 bytes 00:04:28.334 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:28.334 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:28.334 EAL: Hugepages will be freed exactly as allocated. 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: TSC frequency is ~2400000 KHz 00:04:28.334 EAL: Main lcore 0 is ready (tid=7f6f371e5a00;cpuset=[0]) 00:04:28.334 EAL: Trying to obtain current memory policy. 00:04:28.334 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:28.334 EAL: Restoring previous memory policy: 0 00:04:28.334 EAL: request: mp_malloc_sync 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: Heap on socket 0 was expanded by 2MB 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:28.334 EAL: Mem event callback 'spdk:(nil)' registered 00:04:28.334 00:04:28.334 00:04:28.334 CUnit - A unit testing framework for C - Version 2.1-3 00:04:28.334 http://cunit.sourceforge.net/ 00:04:28.334 00:04:28.334 00:04:28.334 Suite: components_suite 00:04:28.334 Test: vtophys_malloc_test ...passed 00:04:28.334 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:28.334 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:28.334 EAL: Restoring previous memory policy: 4 00:04:28.334 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.334 EAL: request: mp_malloc_sync 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: Heap on socket 0 was expanded by 4MB 00:04:28.334 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.334 EAL: request: mp_malloc_sync 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: Heap on socket 0 was shrunk by 4MB 00:04:28.334 EAL: Trying to obtain current memory policy. 00:04:28.334 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:28.334 EAL: Restoring previous memory policy: 4 00:04:28.334 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.334 EAL: request: mp_malloc_sync 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: Heap on socket 0 was expanded by 6MB 00:04:28.334 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.334 EAL: request: mp_malloc_sync 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: Heap on socket 0 was shrunk by 6MB 00:04:28.334 EAL: Trying to obtain current memory policy. 00:04:28.334 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:28.334 EAL: Restoring previous memory policy: 4 00:04:28.334 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.334 EAL: request: mp_malloc_sync 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: Heap on socket 0 was expanded by 10MB 00:04:28.334 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.334 EAL: request: mp_malloc_sync 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: Heap on socket 0 was shrunk by 10MB 00:04:28.334 EAL: Trying to obtain current memory policy. 00:04:28.334 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:28.334 EAL: Restoring previous memory policy: 4 00:04:28.334 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.334 EAL: request: mp_malloc_sync 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: Heap on socket 0 was expanded by 18MB 00:04:28.334 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.334 EAL: request: mp_malloc_sync 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: Heap on socket 0 was shrunk by 18MB 00:04:28.334 EAL: Trying to obtain current memory policy. 00:04:28.334 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:28.334 EAL: Restoring previous memory policy: 4 00:04:28.334 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.334 EAL: request: mp_malloc_sync 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: Heap on socket 0 was expanded by 34MB 00:04:28.334 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.334 EAL: request: mp_malloc_sync 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: Heap on socket 0 was shrunk by 34MB 00:04:28.334 EAL: Trying to obtain current memory policy. 00:04:28.334 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:28.334 EAL: Restoring previous memory policy: 4 00:04:28.334 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.334 EAL: request: mp_malloc_sync 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: Heap on socket 0 was expanded by 66MB 00:04:28.334 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.334 EAL: request: mp_malloc_sync 00:04:28.334 EAL: No shared files mode enabled, IPC is disabled 00:04:28.334 EAL: Heap on socket 0 was shrunk by 66MB 00:04:28.334 EAL: Trying to obtain current memory policy. 00:04:28.334 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:28.597 EAL: Restoring previous memory policy: 4 00:04:28.597 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.597 EAL: request: mp_malloc_sync 00:04:28.597 EAL: No shared files mode enabled, IPC is disabled 00:04:28.597 EAL: Heap on socket 0 was expanded by 130MB 00:04:28.597 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.597 EAL: request: mp_malloc_sync 00:04:28.597 EAL: No shared files mode enabled, IPC is disabled 00:04:28.597 EAL: Heap on socket 0 was shrunk by 130MB 00:04:28.597 EAL: Trying to obtain current memory policy. 00:04:28.597 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:28.597 EAL: Restoring previous memory policy: 4 00:04:28.597 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.597 EAL: request: mp_malloc_sync 00:04:28.597 EAL: No shared files mode enabled, IPC is disabled 00:04:28.597 EAL: Heap on socket 0 was expanded by 258MB 00:04:28.597 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.597 EAL: request: mp_malloc_sync 00:04:28.597 EAL: No shared files mode enabled, IPC is disabled 00:04:28.597 EAL: Heap on socket 0 was shrunk by 258MB 00:04:28.597 EAL: Trying to obtain current memory policy. 00:04:28.597 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:28.597 EAL: Restoring previous memory policy: 4 00:04:28.597 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.597 EAL: request: mp_malloc_sync 00:04:28.597 EAL: No shared files mode enabled, IPC is disabled 00:04:28.597 EAL: Heap on socket 0 was expanded by 514MB 00:04:28.597 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.858 EAL: request: mp_malloc_sync 00:04:28.858 EAL: No shared files mode enabled, IPC is disabled 00:04:28.858 EAL: Heap on socket 0 was shrunk by 514MB 00:04:28.858 EAL: Trying to obtain current memory policy. 00:04:28.858 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:28.858 EAL: Restoring previous memory policy: 4 00:04:28.858 EAL: Calling mem event callback 'spdk:(nil)' 00:04:28.858 EAL: request: mp_malloc_sync 00:04:28.858 EAL: No shared files mode enabled, IPC is disabled 00:04:28.858 EAL: Heap on socket 0 was expanded by 1026MB 00:04:29.119 EAL: Calling mem event callback 'spdk:(nil)' 00:04:29.119 EAL: request: mp_malloc_sync 00:04:29.119 EAL: No shared files mode enabled, IPC is disabled 00:04:29.119 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:29.119 passed 00:04:29.119 00:04:29.119 Run Summary: Type Total Ran Passed Failed Inactive 00:04:29.119 suites 1 1 n/a 0 0 00:04:29.119 tests 2 2 2 0 0 00:04:29.119 asserts 497 497 497 0 n/a 00:04:29.119 00:04:29.119 Elapsed time = 0.642 seconds 00:04:29.119 EAL: Calling mem event callback 'spdk:(nil)' 00:04:29.119 EAL: request: mp_malloc_sync 00:04:29.119 EAL: No shared files mode enabled, IPC is disabled 00:04:29.119 EAL: Heap on socket 0 was shrunk by 2MB 00:04:29.119 EAL: No shared files mode enabled, IPC is disabled 00:04:29.119 EAL: No shared files mode enabled, IPC is disabled 00:04:29.119 EAL: No shared files mode enabled, IPC is disabled 00:04:29.119 00:04:29.119 real 0m0.769s 00:04:29.119 user 0m0.401s 00:04:29.119 sys 0m0.330s 00:04:29.119 20:21:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:29.119 20:21:47 -- common/autotest_common.sh@10 -- # set +x 00:04:29.119 ************************************ 00:04:29.119 END TEST env_vtophys 00:04:29.119 ************************************ 00:04:29.119 20:21:47 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:29.119 20:21:47 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:29.119 20:21:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:29.119 20:21:47 -- common/autotest_common.sh@10 -- # set +x 00:04:29.119 ************************************ 00:04:29.119 START TEST env_pci 00:04:29.119 ************************************ 00:04:29.119 20:21:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:29.119 00:04:29.119 00:04:29.119 CUnit - A unit testing framework for C - Version 2.1-3 00:04:29.119 http://cunit.sourceforge.net/ 00:04:29.119 00:04:29.119 00:04:29.119 Suite: pci 00:04:29.119 Test: pci_hook ...[2024-04-26 20:21:47.386989] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3828660 has claimed it 00:04:29.119 EAL: Cannot find device (10000:00:01.0) 00:04:29.119 EAL: Failed to attach device on primary process 00:04:29.119 passed 00:04:29.119 00:04:29.119 Run Summary: Type Total Ran Passed Failed Inactive 00:04:29.119 suites 1 1 n/a 0 0 00:04:29.119 tests 1 1 1 0 0 00:04:29.119 asserts 25 25 25 0 n/a 00:04:29.119 00:04:29.120 Elapsed time = 0.030 seconds 00:04:29.120 00:04:29.120 real 0m0.051s 00:04:29.120 user 0m0.015s 00:04:29.120 sys 0m0.036s 00:04:29.120 20:21:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:29.120 20:21:47 -- common/autotest_common.sh@10 -- # set +x 00:04:29.120 ************************************ 00:04:29.120 END TEST env_pci 00:04:29.120 ************************************ 00:04:29.120 20:21:47 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:29.120 20:21:47 -- env/env.sh@15 -- # uname 00:04:29.380 20:21:47 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:29.380 20:21:47 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:29.380 20:21:47 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:29.380 20:21:47 -- common/autotest_common.sh@1077 -- # '[' 5 -le 1 ']' 00:04:29.380 20:21:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:29.380 20:21:47 -- common/autotest_common.sh@10 -- # set +x 00:04:29.380 ************************************ 00:04:29.380 START TEST env_dpdk_post_init 00:04:29.380 ************************************ 00:04:29.380 20:21:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:29.380 EAL: Detected CPU lcores: 128 00:04:29.380 EAL: Detected NUMA nodes: 2 00:04:29.380 EAL: Detected shared linkage of DPDK 00:04:29.380 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:29.380 EAL: Selected IOVA mode 'VA' 00:04:29.380 EAL: No free 2048 kB hugepages reported on node 1 00:04:29.380 EAL: VFIO support initialized 00:04:29.380 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:29.380 EAL: Using IOMMU type 1 (Type 1) 00:04:29.380 EAL: Ignore mapping IO port bar(1) 00:04:29.683 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.0 (socket 0) 00:04:29.683 EAL: Ignore mapping IO port bar(1) 00:04:30.019 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.1 (socket 0) 00:04:30.019 EAL: Ignore mapping IO port bar(1) 00:04:30.019 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.2 (socket 0) 00:04:30.279 EAL: Ignore mapping IO port bar(1) 00:04:30.279 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.3 (socket 0) 00:04:30.279 EAL: Ignore mapping IO port bar(1) 00:04:30.540 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.4 (socket 0) 00:04:30.540 EAL: Ignore mapping IO port bar(1) 00:04:30.800 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.5 (socket 0) 00:04:30.800 EAL: Ignore mapping IO port bar(1) 00:04:31.061 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.6 (socket 0) 00:04:31.061 EAL: Ignore mapping IO port bar(1) 00:04:31.061 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.7 (socket 0) 00:04:31.320 EAL: Probe PCI driver: spdk_nvme (144d:a80a) device: 0000:65:00.0 (socket 0) 00:04:31.580 EAL: Ignore mapping IO port bar(1) 00:04:31.580 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.0 (socket 1) 00:04:31.840 EAL: Ignore mapping IO port bar(1) 00:04:31.840 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.1 (socket 1) 00:04:31.840 EAL: Ignore mapping IO port bar(1) 00:04:32.101 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.2 (socket 1) 00:04:32.101 EAL: Ignore mapping IO port bar(1) 00:04:32.360 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.3 (socket 1) 00:04:32.360 EAL: Ignore mapping IO port bar(1) 00:04:32.621 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.4 (socket 1) 00:04:32.622 EAL: Ignore mapping IO port bar(1) 00:04:32.622 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.5 (socket 1) 00:04:32.882 EAL: Ignore mapping IO port bar(1) 00:04:32.882 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.6 (socket 1) 00:04:33.142 EAL: Ignore mapping IO port bar(1) 00:04:33.142 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.7 (socket 1) 00:04:33.142 EAL: Releasing PCI mapped resource for 0000:65:00.0 00:04:33.142 EAL: Calling pci_unmap_resource for 0000:65:00.0 at 0x202001020000 00:04:33.402 Starting DPDK initialization... 00:04:33.402 Starting SPDK post initialization... 00:04:33.402 SPDK NVMe probe 00:04:33.402 Attaching to 0000:65:00.0 00:04:33.402 Attached to 0000:65:00.0 00:04:33.402 Cleaning up... 00:04:35.316 00:04:35.316 real 0m5.716s 00:04:35.316 user 0m0.179s 00:04:35.316 sys 0m0.082s 00:04:35.316 20:21:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:35.316 20:21:53 -- common/autotest_common.sh@10 -- # set +x 00:04:35.316 ************************************ 00:04:35.316 END TEST env_dpdk_post_init 00:04:35.316 ************************************ 00:04:35.316 20:21:53 -- env/env.sh@26 -- # uname 00:04:35.316 20:21:53 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:35.316 20:21:53 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:35.316 20:21:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:35.316 20:21:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:35.316 20:21:53 -- common/autotest_common.sh@10 -- # set +x 00:04:35.316 ************************************ 00:04:35.316 START TEST env_mem_callbacks 00:04:35.316 ************************************ 00:04:35.316 20:21:53 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:35.316 EAL: Detected CPU lcores: 128 00:04:35.316 EAL: Detected NUMA nodes: 2 00:04:35.316 EAL: Detected shared linkage of DPDK 00:04:35.316 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:35.316 EAL: Selected IOVA mode 'VA' 00:04:35.316 EAL: No free 2048 kB hugepages reported on node 1 00:04:35.316 EAL: VFIO support initialized 00:04:35.316 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:35.316 00:04:35.316 00:04:35.316 CUnit - A unit testing framework for C - Version 2.1-3 00:04:35.316 http://cunit.sourceforge.net/ 00:04:35.316 00:04:35.316 00:04:35.316 Suite: memory 00:04:35.316 Test: test ... 00:04:35.316 register 0x200000200000 2097152 00:04:35.316 malloc 3145728 00:04:35.316 register 0x200000400000 4194304 00:04:35.316 buf 0x200000500000 len 3145728 PASSED 00:04:35.316 malloc 64 00:04:35.316 buf 0x2000004fff40 len 64 PASSED 00:04:35.316 malloc 4194304 00:04:35.316 register 0x200000800000 6291456 00:04:35.316 buf 0x200000a00000 len 4194304 PASSED 00:04:35.316 free 0x200000500000 3145728 00:04:35.316 free 0x2000004fff40 64 00:04:35.316 unregister 0x200000400000 4194304 PASSED 00:04:35.316 free 0x200000a00000 4194304 00:04:35.316 unregister 0x200000800000 6291456 PASSED 00:04:35.316 malloc 8388608 00:04:35.316 register 0x200000400000 10485760 00:04:35.316 buf 0x200000600000 len 8388608 PASSED 00:04:35.316 free 0x200000600000 8388608 00:04:35.316 unregister 0x200000400000 10485760 PASSED 00:04:35.316 passed 00:04:35.316 00:04:35.316 Run Summary: Type Total Ran Passed Failed Inactive 00:04:35.316 suites 1 1 n/a 0 0 00:04:35.316 tests 1 1 1 0 0 00:04:35.316 asserts 15 15 15 0 n/a 00:04:35.316 00:04:35.316 Elapsed time = 0.004 seconds 00:04:35.316 00:04:35.316 real 0m0.058s 00:04:35.316 user 0m0.019s 00:04:35.316 sys 0m0.039s 00:04:35.316 20:21:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:35.316 20:21:53 -- common/autotest_common.sh@10 -- # set +x 00:04:35.316 ************************************ 00:04:35.316 END TEST env_mem_callbacks 00:04:35.316 ************************************ 00:04:35.316 00:04:35.316 real 0m7.126s 00:04:35.316 user 0m0.928s 00:04:35.316 sys 0m0.744s 00:04:35.316 20:21:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:35.316 20:21:53 -- common/autotest_common.sh@10 -- # set +x 00:04:35.316 ************************************ 00:04:35.316 END TEST env 00:04:35.316 ************************************ 00:04:35.316 20:21:53 -- spdk/autotest.sh@176 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:35.316 20:21:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:35.316 20:21:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:35.316 20:21:53 -- common/autotest_common.sh@10 -- # set +x 00:04:35.316 ************************************ 00:04:35.316 START TEST rpc 00:04:35.316 ************************************ 00:04:35.316 20:21:53 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:35.316 * Looking for test storage... 00:04:35.316 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:35.316 20:21:53 -- rpc/rpc.sh@65 -- # spdk_pid=3829859 00:04:35.316 20:21:53 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:35.316 20:21:53 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:35.316 20:21:53 -- rpc/rpc.sh@67 -- # waitforlisten 3829859 00:04:35.316 20:21:53 -- common/autotest_common.sh@819 -- # '[' -z 3829859 ']' 00:04:35.316 20:21:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:35.316 20:21:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:35.316 20:21:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:35.316 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:35.316 20:21:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:35.316 20:21:53 -- common/autotest_common.sh@10 -- # set +x 00:04:35.316 [2024-04-26 20:21:53.524138] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:04:35.316 [2024-04-26 20:21:53.524211] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3829859 ] 00:04:35.316 EAL: No free 2048 kB hugepages reported on node 1 00:04:35.316 [2024-04-26 20:21:53.587436] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:35.576 [2024-04-26 20:21:53.660195] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:35.577 [2024-04-26 20:21:53.660323] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:35.577 [2024-04-26 20:21:53.660332] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3829859' to capture a snapshot of events at runtime. 00:04:35.577 [2024-04-26 20:21:53.660340] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3829859 for offline analysis/debug. 00:04:35.577 [2024-04-26 20:21:53.660358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:36.185 20:21:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:36.185 20:21:54 -- common/autotest_common.sh@852 -- # return 0 00:04:36.185 20:21:54 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:36.185 20:21:54 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:36.185 20:21:54 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:36.185 20:21:54 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:36.185 20:21:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:36.185 20:21:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:36.185 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.185 ************************************ 00:04:36.185 START TEST rpc_integrity 00:04:36.185 ************************************ 00:04:36.185 20:21:54 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:04:36.185 20:21:54 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:36.185 20:21:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.185 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.185 20:21:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.185 20:21:54 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:36.185 20:21:54 -- rpc/rpc.sh@13 -- # jq length 00:04:36.185 20:21:54 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:36.185 20:21:54 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:36.185 20:21:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.185 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.185 20:21:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.185 20:21:54 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:36.185 20:21:54 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:36.185 20:21:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.185 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.185 20:21:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.185 20:21:54 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:36.185 { 00:04:36.185 "name": "Malloc0", 00:04:36.185 "aliases": [ 00:04:36.185 "05614139-2a81-44a2-9fd1-485311a356b0" 00:04:36.185 ], 00:04:36.185 "product_name": "Malloc disk", 00:04:36.185 "block_size": 512, 00:04:36.185 "num_blocks": 16384, 00:04:36.185 "uuid": "05614139-2a81-44a2-9fd1-485311a356b0", 00:04:36.185 "assigned_rate_limits": { 00:04:36.185 "rw_ios_per_sec": 0, 00:04:36.185 "rw_mbytes_per_sec": 0, 00:04:36.185 "r_mbytes_per_sec": 0, 00:04:36.185 "w_mbytes_per_sec": 0 00:04:36.185 }, 00:04:36.185 "claimed": false, 00:04:36.185 "zoned": false, 00:04:36.185 "supported_io_types": { 00:04:36.185 "read": true, 00:04:36.185 "write": true, 00:04:36.185 "unmap": true, 00:04:36.185 "write_zeroes": true, 00:04:36.185 "flush": true, 00:04:36.185 "reset": true, 00:04:36.185 "compare": false, 00:04:36.185 "compare_and_write": false, 00:04:36.185 "abort": true, 00:04:36.185 "nvme_admin": false, 00:04:36.185 "nvme_io": false 00:04:36.185 }, 00:04:36.185 "memory_domains": [ 00:04:36.185 { 00:04:36.185 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:36.185 "dma_device_type": 2 00:04:36.185 } 00:04:36.185 ], 00:04:36.185 "driver_specific": {} 00:04:36.185 } 00:04:36.185 ]' 00:04:36.185 20:21:54 -- rpc/rpc.sh@17 -- # jq length 00:04:36.185 20:21:54 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:36.185 20:21:54 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:36.185 20:21:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.185 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.185 [2024-04-26 20:21:54.429716] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:36.186 [2024-04-26 20:21:54.429749] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:36.186 [2024-04-26 20:21:54.429762] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x112c460 00:04:36.186 [2024-04-26 20:21:54.429769] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:36.186 [2024-04-26 20:21:54.431101] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:36.186 [2024-04-26 20:21:54.431121] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:36.186 Passthru0 00:04:36.186 20:21:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.186 20:21:54 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:36.186 20:21:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.186 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.186 20:21:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.186 20:21:54 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:36.186 { 00:04:36.186 "name": "Malloc0", 00:04:36.186 "aliases": [ 00:04:36.186 "05614139-2a81-44a2-9fd1-485311a356b0" 00:04:36.186 ], 00:04:36.186 "product_name": "Malloc disk", 00:04:36.186 "block_size": 512, 00:04:36.186 "num_blocks": 16384, 00:04:36.186 "uuid": "05614139-2a81-44a2-9fd1-485311a356b0", 00:04:36.186 "assigned_rate_limits": { 00:04:36.186 "rw_ios_per_sec": 0, 00:04:36.186 "rw_mbytes_per_sec": 0, 00:04:36.186 "r_mbytes_per_sec": 0, 00:04:36.186 "w_mbytes_per_sec": 0 00:04:36.186 }, 00:04:36.186 "claimed": true, 00:04:36.186 "claim_type": "exclusive_write", 00:04:36.186 "zoned": false, 00:04:36.186 "supported_io_types": { 00:04:36.186 "read": true, 00:04:36.186 "write": true, 00:04:36.186 "unmap": true, 00:04:36.186 "write_zeroes": true, 00:04:36.186 "flush": true, 00:04:36.186 "reset": true, 00:04:36.186 "compare": false, 00:04:36.186 "compare_and_write": false, 00:04:36.186 "abort": true, 00:04:36.186 "nvme_admin": false, 00:04:36.186 "nvme_io": false 00:04:36.186 }, 00:04:36.186 "memory_domains": [ 00:04:36.186 { 00:04:36.186 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:36.186 "dma_device_type": 2 00:04:36.186 } 00:04:36.186 ], 00:04:36.186 "driver_specific": {} 00:04:36.186 }, 00:04:36.186 { 00:04:36.186 "name": "Passthru0", 00:04:36.186 "aliases": [ 00:04:36.186 "9d1d3292-838c-50e6-b2c4-6a49bf758749" 00:04:36.186 ], 00:04:36.186 "product_name": "passthru", 00:04:36.186 "block_size": 512, 00:04:36.186 "num_blocks": 16384, 00:04:36.186 "uuid": "9d1d3292-838c-50e6-b2c4-6a49bf758749", 00:04:36.186 "assigned_rate_limits": { 00:04:36.186 "rw_ios_per_sec": 0, 00:04:36.186 "rw_mbytes_per_sec": 0, 00:04:36.186 "r_mbytes_per_sec": 0, 00:04:36.186 "w_mbytes_per_sec": 0 00:04:36.186 }, 00:04:36.186 "claimed": false, 00:04:36.186 "zoned": false, 00:04:36.186 "supported_io_types": { 00:04:36.186 "read": true, 00:04:36.186 "write": true, 00:04:36.186 "unmap": true, 00:04:36.186 "write_zeroes": true, 00:04:36.186 "flush": true, 00:04:36.186 "reset": true, 00:04:36.186 "compare": false, 00:04:36.186 "compare_and_write": false, 00:04:36.186 "abort": true, 00:04:36.186 "nvme_admin": false, 00:04:36.186 "nvme_io": false 00:04:36.186 }, 00:04:36.186 "memory_domains": [ 00:04:36.186 { 00:04:36.186 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:36.186 "dma_device_type": 2 00:04:36.186 } 00:04:36.186 ], 00:04:36.186 "driver_specific": { 00:04:36.186 "passthru": { 00:04:36.186 "name": "Passthru0", 00:04:36.186 "base_bdev_name": "Malloc0" 00:04:36.186 } 00:04:36.186 } 00:04:36.186 } 00:04:36.186 ]' 00:04:36.186 20:21:54 -- rpc/rpc.sh@21 -- # jq length 00:04:36.186 20:21:54 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:36.186 20:21:54 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:36.186 20:21:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.186 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.186 20:21:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.186 20:21:54 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:36.186 20:21:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.186 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.186 20:21:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.186 20:21:54 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:36.186 20:21:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.446 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.446 20:21:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.446 20:21:54 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:36.446 20:21:54 -- rpc/rpc.sh@26 -- # jq length 00:04:36.446 20:21:54 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:36.446 00:04:36.446 real 0m0.294s 00:04:36.446 user 0m0.189s 00:04:36.446 sys 0m0.039s 00:04:36.446 20:21:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:36.446 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.446 ************************************ 00:04:36.446 END TEST rpc_integrity 00:04:36.446 ************************************ 00:04:36.446 20:21:54 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:36.446 20:21:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:36.446 20:21:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:36.446 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.446 ************************************ 00:04:36.446 START TEST rpc_plugins 00:04:36.446 ************************************ 00:04:36.446 20:21:54 -- common/autotest_common.sh@1104 -- # rpc_plugins 00:04:36.446 20:21:54 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:36.446 20:21:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.446 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.446 20:21:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.446 20:21:54 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:36.446 20:21:54 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:36.446 20:21:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.446 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.446 20:21:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.446 20:21:54 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:36.446 { 00:04:36.446 "name": "Malloc1", 00:04:36.446 "aliases": [ 00:04:36.446 "dcba4d34-4ada-48cb-b5fd-dedfce1d0f2f" 00:04:36.446 ], 00:04:36.446 "product_name": "Malloc disk", 00:04:36.446 "block_size": 4096, 00:04:36.446 "num_blocks": 256, 00:04:36.446 "uuid": "dcba4d34-4ada-48cb-b5fd-dedfce1d0f2f", 00:04:36.446 "assigned_rate_limits": { 00:04:36.446 "rw_ios_per_sec": 0, 00:04:36.446 "rw_mbytes_per_sec": 0, 00:04:36.446 "r_mbytes_per_sec": 0, 00:04:36.446 "w_mbytes_per_sec": 0 00:04:36.446 }, 00:04:36.446 "claimed": false, 00:04:36.446 "zoned": false, 00:04:36.446 "supported_io_types": { 00:04:36.446 "read": true, 00:04:36.446 "write": true, 00:04:36.446 "unmap": true, 00:04:36.446 "write_zeroes": true, 00:04:36.446 "flush": true, 00:04:36.446 "reset": true, 00:04:36.446 "compare": false, 00:04:36.446 "compare_and_write": false, 00:04:36.446 "abort": true, 00:04:36.446 "nvme_admin": false, 00:04:36.446 "nvme_io": false 00:04:36.446 }, 00:04:36.446 "memory_domains": [ 00:04:36.446 { 00:04:36.446 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:36.446 "dma_device_type": 2 00:04:36.446 } 00:04:36.446 ], 00:04:36.446 "driver_specific": {} 00:04:36.446 } 00:04:36.446 ]' 00:04:36.446 20:21:54 -- rpc/rpc.sh@32 -- # jq length 00:04:36.446 20:21:54 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:36.446 20:21:54 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:36.446 20:21:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.446 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.446 20:21:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.447 20:21:54 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:36.447 20:21:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.447 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.447 20:21:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.447 20:21:54 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:36.447 20:21:54 -- rpc/rpc.sh@36 -- # jq length 00:04:36.447 20:21:54 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:36.447 00:04:36.447 real 0m0.150s 00:04:36.447 user 0m0.092s 00:04:36.447 sys 0m0.021s 00:04:36.447 20:21:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:36.447 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.447 ************************************ 00:04:36.447 END TEST rpc_plugins 00:04:36.447 ************************************ 00:04:36.707 20:21:54 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:36.707 20:21:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:36.707 20:21:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:36.707 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.707 ************************************ 00:04:36.707 START TEST rpc_trace_cmd_test 00:04:36.707 ************************************ 00:04:36.707 20:21:54 -- common/autotest_common.sh@1104 -- # rpc_trace_cmd_test 00:04:36.707 20:21:54 -- rpc/rpc.sh@40 -- # local info 00:04:36.707 20:21:54 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:36.707 20:21:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.707 20:21:54 -- common/autotest_common.sh@10 -- # set +x 00:04:36.708 20:21:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.708 20:21:54 -- rpc/rpc.sh@42 -- # info='{ 00:04:36.708 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3829859", 00:04:36.708 "tpoint_group_mask": "0x8", 00:04:36.708 "iscsi_conn": { 00:04:36.708 "mask": "0x2", 00:04:36.708 "tpoint_mask": "0x0" 00:04:36.708 }, 00:04:36.708 "scsi": { 00:04:36.708 "mask": "0x4", 00:04:36.708 "tpoint_mask": "0x0" 00:04:36.708 }, 00:04:36.708 "bdev": { 00:04:36.708 "mask": "0x8", 00:04:36.708 "tpoint_mask": "0xffffffffffffffff" 00:04:36.708 }, 00:04:36.708 "nvmf_rdma": { 00:04:36.708 "mask": "0x10", 00:04:36.708 "tpoint_mask": "0x0" 00:04:36.708 }, 00:04:36.708 "nvmf_tcp": { 00:04:36.708 "mask": "0x20", 00:04:36.708 "tpoint_mask": "0x0" 00:04:36.708 }, 00:04:36.708 "ftl": { 00:04:36.708 "mask": "0x40", 00:04:36.708 "tpoint_mask": "0x0" 00:04:36.708 }, 00:04:36.708 "blobfs": { 00:04:36.708 "mask": "0x80", 00:04:36.708 "tpoint_mask": "0x0" 00:04:36.708 }, 00:04:36.708 "dsa": { 00:04:36.708 "mask": "0x200", 00:04:36.708 "tpoint_mask": "0x0" 00:04:36.708 }, 00:04:36.708 "thread": { 00:04:36.708 "mask": "0x400", 00:04:36.708 "tpoint_mask": "0x0" 00:04:36.708 }, 00:04:36.708 "nvme_pcie": { 00:04:36.708 "mask": "0x800", 00:04:36.708 "tpoint_mask": "0x0" 00:04:36.708 }, 00:04:36.708 "iaa": { 00:04:36.708 "mask": "0x1000", 00:04:36.708 "tpoint_mask": "0x0" 00:04:36.708 }, 00:04:36.708 "nvme_tcp": { 00:04:36.708 "mask": "0x2000", 00:04:36.708 "tpoint_mask": "0x0" 00:04:36.708 }, 00:04:36.708 "bdev_nvme": { 00:04:36.708 "mask": "0x4000", 00:04:36.708 "tpoint_mask": "0x0" 00:04:36.708 } 00:04:36.708 }' 00:04:36.708 20:21:54 -- rpc/rpc.sh@43 -- # jq length 00:04:36.708 20:21:54 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:36.708 20:21:54 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:36.708 20:21:54 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:36.708 20:21:54 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:36.708 20:21:54 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:36.708 20:21:54 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:36.708 20:21:55 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:36.708 20:21:55 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:36.708 20:21:55 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:36.708 00:04:36.708 real 0m0.229s 00:04:36.708 user 0m0.186s 00:04:36.708 sys 0m0.035s 00:04:36.708 20:21:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:36.708 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:36.708 ************************************ 00:04:36.708 END TEST rpc_trace_cmd_test 00:04:36.708 ************************************ 00:04:36.969 20:21:55 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:36.969 20:21:55 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:36.969 20:21:55 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:36.969 20:21:55 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:36.969 20:21:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:36.969 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:36.969 ************************************ 00:04:36.969 START TEST rpc_daemon_integrity 00:04:36.969 ************************************ 00:04:36.969 20:21:55 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:04:36.969 20:21:55 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:36.969 20:21:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.969 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:36.969 20:21:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.969 20:21:55 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:36.969 20:21:55 -- rpc/rpc.sh@13 -- # jq length 00:04:36.969 20:21:55 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:36.969 20:21:55 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:36.969 20:21:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.969 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:36.969 20:21:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.969 20:21:55 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:36.969 20:21:55 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:36.969 20:21:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.969 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:36.969 20:21:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.969 20:21:55 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:36.969 { 00:04:36.969 "name": "Malloc2", 00:04:36.969 "aliases": [ 00:04:36.969 "9338ecea-09a2-40bd-b0ba-805a7b4ab2f4" 00:04:36.969 ], 00:04:36.969 "product_name": "Malloc disk", 00:04:36.969 "block_size": 512, 00:04:36.969 "num_blocks": 16384, 00:04:36.969 "uuid": "9338ecea-09a2-40bd-b0ba-805a7b4ab2f4", 00:04:36.969 "assigned_rate_limits": { 00:04:36.969 "rw_ios_per_sec": 0, 00:04:36.969 "rw_mbytes_per_sec": 0, 00:04:36.969 "r_mbytes_per_sec": 0, 00:04:36.969 "w_mbytes_per_sec": 0 00:04:36.969 }, 00:04:36.969 "claimed": false, 00:04:36.969 "zoned": false, 00:04:36.969 "supported_io_types": { 00:04:36.969 "read": true, 00:04:36.969 "write": true, 00:04:36.969 "unmap": true, 00:04:36.969 "write_zeroes": true, 00:04:36.969 "flush": true, 00:04:36.969 "reset": true, 00:04:36.969 "compare": false, 00:04:36.969 "compare_and_write": false, 00:04:36.969 "abort": true, 00:04:36.969 "nvme_admin": false, 00:04:36.969 "nvme_io": false 00:04:36.969 }, 00:04:36.969 "memory_domains": [ 00:04:36.969 { 00:04:36.969 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:36.969 "dma_device_type": 2 00:04:36.969 } 00:04:36.969 ], 00:04:36.969 "driver_specific": {} 00:04:36.969 } 00:04:36.969 ]' 00:04:36.969 20:21:55 -- rpc/rpc.sh@17 -- # jq length 00:04:36.969 20:21:55 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:36.969 20:21:55 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:36.969 20:21:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.969 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:36.969 [2024-04-26 20:21:55.232052] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:36.969 [2024-04-26 20:21:55.232081] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:36.969 [2024-04-26 20:21:55.232096] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x112cd50 00:04:36.969 [2024-04-26 20:21:55.232103] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:36.969 [2024-04-26 20:21:55.233314] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:36.969 [2024-04-26 20:21:55.233333] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:36.969 Passthru0 00:04:36.969 20:21:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.969 20:21:55 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:36.969 20:21:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.969 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:36.969 20:21:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:36.969 20:21:55 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:36.969 { 00:04:36.969 "name": "Malloc2", 00:04:36.969 "aliases": [ 00:04:36.969 "9338ecea-09a2-40bd-b0ba-805a7b4ab2f4" 00:04:36.969 ], 00:04:36.969 "product_name": "Malloc disk", 00:04:36.969 "block_size": 512, 00:04:36.969 "num_blocks": 16384, 00:04:36.969 "uuid": "9338ecea-09a2-40bd-b0ba-805a7b4ab2f4", 00:04:36.969 "assigned_rate_limits": { 00:04:36.969 "rw_ios_per_sec": 0, 00:04:36.969 "rw_mbytes_per_sec": 0, 00:04:36.969 "r_mbytes_per_sec": 0, 00:04:36.969 "w_mbytes_per_sec": 0 00:04:36.969 }, 00:04:36.969 "claimed": true, 00:04:36.969 "claim_type": "exclusive_write", 00:04:36.969 "zoned": false, 00:04:36.969 "supported_io_types": { 00:04:36.969 "read": true, 00:04:36.969 "write": true, 00:04:36.969 "unmap": true, 00:04:36.969 "write_zeroes": true, 00:04:36.969 "flush": true, 00:04:36.969 "reset": true, 00:04:36.969 "compare": false, 00:04:36.969 "compare_and_write": false, 00:04:36.969 "abort": true, 00:04:36.969 "nvme_admin": false, 00:04:36.969 "nvme_io": false 00:04:36.969 }, 00:04:36.969 "memory_domains": [ 00:04:36.969 { 00:04:36.969 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:36.969 "dma_device_type": 2 00:04:36.969 } 00:04:36.969 ], 00:04:36.969 "driver_specific": {} 00:04:36.969 }, 00:04:36.969 { 00:04:36.969 "name": "Passthru0", 00:04:36.969 "aliases": [ 00:04:36.969 "02e3d7f1-275d-55a3-a477-3726287f1848" 00:04:36.969 ], 00:04:36.969 "product_name": "passthru", 00:04:36.969 "block_size": 512, 00:04:36.969 "num_blocks": 16384, 00:04:36.969 "uuid": "02e3d7f1-275d-55a3-a477-3726287f1848", 00:04:36.969 "assigned_rate_limits": { 00:04:36.969 "rw_ios_per_sec": 0, 00:04:36.969 "rw_mbytes_per_sec": 0, 00:04:36.969 "r_mbytes_per_sec": 0, 00:04:36.969 "w_mbytes_per_sec": 0 00:04:36.969 }, 00:04:36.969 "claimed": false, 00:04:36.969 "zoned": false, 00:04:36.969 "supported_io_types": { 00:04:36.969 "read": true, 00:04:36.969 "write": true, 00:04:36.969 "unmap": true, 00:04:36.969 "write_zeroes": true, 00:04:36.969 "flush": true, 00:04:36.969 "reset": true, 00:04:36.969 "compare": false, 00:04:36.969 "compare_and_write": false, 00:04:36.969 "abort": true, 00:04:36.969 "nvme_admin": false, 00:04:36.969 "nvme_io": false 00:04:36.969 }, 00:04:36.969 "memory_domains": [ 00:04:36.969 { 00:04:36.969 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:36.969 "dma_device_type": 2 00:04:36.969 } 00:04:36.969 ], 00:04:36.969 "driver_specific": { 00:04:36.969 "passthru": { 00:04:36.969 "name": "Passthru0", 00:04:36.969 "base_bdev_name": "Malloc2" 00:04:36.969 } 00:04:36.969 } 00:04:36.969 } 00:04:36.969 ]' 00:04:36.969 20:21:55 -- rpc/rpc.sh@21 -- # jq length 00:04:36.969 20:21:55 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:36.969 20:21:55 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:36.969 20:21:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:36.969 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:37.230 20:21:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:37.230 20:21:55 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:37.230 20:21:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:37.230 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:37.230 20:21:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:37.230 20:21:55 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:37.230 20:21:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:37.230 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:37.230 20:21:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:37.230 20:21:55 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:37.230 20:21:55 -- rpc/rpc.sh@26 -- # jq length 00:04:37.230 20:21:55 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:37.230 00:04:37.230 real 0m0.292s 00:04:37.230 user 0m0.184s 00:04:37.230 sys 0m0.046s 00:04:37.230 20:21:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:37.230 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:37.230 ************************************ 00:04:37.230 END TEST rpc_daemon_integrity 00:04:37.230 ************************************ 00:04:37.230 20:21:55 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:37.230 20:21:55 -- rpc/rpc.sh@84 -- # killprocess 3829859 00:04:37.230 20:21:55 -- common/autotest_common.sh@926 -- # '[' -z 3829859 ']' 00:04:37.230 20:21:55 -- common/autotest_common.sh@930 -- # kill -0 3829859 00:04:37.230 20:21:55 -- common/autotest_common.sh@931 -- # uname 00:04:37.230 20:21:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:37.230 20:21:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3829859 00:04:37.230 20:21:55 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:37.230 20:21:55 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:37.230 20:21:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3829859' 00:04:37.230 killing process with pid 3829859 00:04:37.230 20:21:55 -- common/autotest_common.sh@945 -- # kill 3829859 00:04:37.230 20:21:55 -- common/autotest_common.sh@950 -- # wait 3829859 00:04:37.491 00:04:37.491 real 0m2.313s 00:04:37.491 user 0m3.013s 00:04:37.491 sys 0m0.630s 00:04:37.491 20:21:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:37.491 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:37.491 ************************************ 00:04:37.491 END TEST rpc 00:04:37.491 ************************************ 00:04:37.491 20:21:55 -- spdk/autotest.sh@177 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:37.491 20:21:55 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:37.491 20:21:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:37.491 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:37.491 ************************************ 00:04:37.491 START TEST rpc_client 00:04:37.491 ************************************ 00:04:37.491 20:21:55 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:37.491 * Looking for test storage... 00:04:37.491 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:37.491 20:21:55 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:37.754 OK 00:04:37.754 20:21:55 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:37.754 00:04:37.754 real 0m0.118s 00:04:37.754 user 0m0.054s 00:04:37.754 sys 0m0.071s 00:04:37.754 20:21:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:37.754 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:37.754 ************************************ 00:04:37.754 END TEST rpc_client 00:04:37.754 ************************************ 00:04:37.754 20:21:55 -- spdk/autotest.sh@178 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:37.754 20:21:55 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:37.754 20:21:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:37.754 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:37.754 ************************************ 00:04:37.754 START TEST json_config 00:04:37.754 ************************************ 00:04:37.754 20:21:55 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:37.754 20:21:55 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:37.754 20:21:55 -- nvmf/common.sh@7 -- # uname -s 00:04:37.754 20:21:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:37.754 20:21:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:37.754 20:21:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:37.754 20:21:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:37.754 20:21:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:37.754 20:21:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:37.754 20:21:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:37.754 20:21:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:37.754 20:21:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:37.754 20:21:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:37.754 20:21:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:04:37.754 20:21:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:04:37.754 20:21:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:37.754 20:21:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:37.754 20:21:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:37.754 20:21:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:37.754 20:21:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:37.754 20:21:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:37.754 20:21:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:37.754 20:21:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:37.754 20:21:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:37.754 20:21:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:37.754 20:21:55 -- paths/export.sh@5 -- # export PATH 00:04:37.754 20:21:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:37.754 20:21:55 -- nvmf/common.sh@46 -- # : 0 00:04:37.754 20:21:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:37.754 20:21:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:37.754 20:21:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:37.754 20:21:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:37.754 20:21:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:37.754 20:21:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:37.754 20:21:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:37.754 20:21:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:37.754 20:21:55 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:37.754 20:21:55 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:37.754 20:21:55 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:37.754 20:21:55 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:37.754 20:21:55 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:37.754 20:21:55 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:37.754 20:21:55 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:37.754 20:21:55 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:37.754 20:21:55 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:37.754 20:21:55 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:37.754 20:21:55 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:37.754 20:21:55 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:37.754 20:21:55 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:37.754 20:21:55 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:37.754 20:21:55 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:37.754 INFO: JSON configuration test init 00:04:37.754 20:21:55 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:37.754 20:21:55 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:37.754 20:21:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:37.754 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:37.754 20:21:55 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:37.754 20:21:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:37.754 20:21:55 -- common/autotest_common.sh@10 -- # set +x 00:04:37.754 20:21:56 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:37.754 20:21:56 -- json_config/json_config.sh@98 -- # local app=target 00:04:37.754 20:21:56 -- json_config/json_config.sh@99 -- # shift 00:04:37.754 20:21:56 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:37.754 20:21:56 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:37.754 20:21:56 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:37.754 20:21:56 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:37.754 20:21:56 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:37.754 20:21:56 -- json_config/json_config.sh@111 -- # app_pid[$app]=3830666 00:04:37.754 20:21:56 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:37.754 Waiting for target to run... 00:04:37.754 20:21:56 -- json_config/json_config.sh@114 -- # waitforlisten 3830666 /var/tmp/spdk_tgt.sock 00:04:37.754 20:21:56 -- common/autotest_common.sh@819 -- # '[' -z 3830666 ']' 00:04:37.754 20:21:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:37.754 20:21:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:37.754 20:21:56 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:37.754 20:21:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:37.754 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:37.754 20:21:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:37.754 20:21:56 -- common/autotest_common.sh@10 -- # set +x 00:04:37.754 [2024-04-26 20:21:56.059137] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:04:37.754 [2024-04-26 20:21:56.059215] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3830666 ] 00:04:37.754 EAL: No free 2048 kB hugepages reported on node 1 00:04:38.016 [2024-04-26 20:21:56.329420] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:38.276 [2024-04-26 20:21:56.377366] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:38.276 [2024-04-26 20:21:56.377490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:38.537 20:21:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:38.537 20:21:56 -- common/autotest_common.sh@852 -- # return 0 00:04:38.537 20:21:56 -- json_config/json_config.sh@115 -- # echo '' 00:04:38.537 00:04:38.537 20:21:56 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:38.537 20:21:56 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:38.537 20:21:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:38.537 20:21:56 -- common/autotest_common.sh@10 -- # set +x 00:04:38.537 20:21:56 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:38.537 20:21:56 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:38.537 20:21:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:38.537 20:21:56 -- common/autotest_common.sh@10 -- # set +x 00:04:38.537 20:21:56 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:38.537 20:21:56 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:38.537 20:21:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:39.109 20:21:57 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:39.109 20:21:57 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:39.109 20:21:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:39.109 20:21:57 -- common/autotest_common.sh@10 -- # set +x 00:04:39.109 20:21:57 -- json_config/json_config.sh@48 -- # local ret=0 00:04:39.109 20:21:57 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:39.109 20:21:57 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:39.109 20:21:57 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:39.109 20:21:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:39.109 20:21:57 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:39.371 20:21:57 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:39.371 20:21:57 -- json_config/json_config.sh@51 -- # local get_types 00:04:39.371 20:21:57 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:39.371 20:21:57 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:39.371 20:21:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:39.371 20:21:57 -- common/autotest_common.sh@10 -- # set +x 00:04:39.371 20:21:57 -- json_config/json_config.sh@58 -- # return 0 00:04:39.371 20:21:57 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:39.371 20:21:57 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:39.371 20:21:57 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:39.371 20:21:57 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:39.371 20:21:57 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:39.371 20:21:57 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:39.371 20:21:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:39.371 20:21:57 -- common/autotest_common.sh@10 -- # set +x 00:04:39.371 20:21:57 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:39.371 20:21:57 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:39.371 20:21:57 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:39.371 20:21:57 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:39.371 20:21:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:39.632 MallocForNvmf0 00:04:39.632 20:21:57 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:39.632 20:21:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:39.632 MallocForNvmf1 00:04:39.632 20:21:57 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:39.632 20:21:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:39.893 [2024-04-26 20:21:58.021229] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:39.893 20:21:58 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:39.893 20:21:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:39.893 20:21:58 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:39.893 20:21:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:40.153 20:21:58 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:40.153 20:21:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:40.153 20:21:58 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:40.153 20:21:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:40.414 [2024-04-26 20:21:58.603237] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:40.414 20:21:58 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:40.414 20:21:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:40.414 20:21:58 -- common/autotest_common.sh@10 -- # set +x 00:04:40.414 20:21:58 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:40.414 20:21:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:40.414 20:21:58 -- common/autotest_common.sh@10 -- # set +x 00:04:40.414 20:21:58 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:40.414 20:21:58 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:40.414 20:21:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:40.675 MallocBdevForConfigChangeCheck 00:04:40.675 20:21:58 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:40.675 20:21:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:40.675 20:21:58 -- common/autotest_common.sh@10 -- # set +x 00:04:40.675 20:21:58 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:40.675 20:21:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:40.936 20:21:59 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:40.936 INFO: shutting down applications... 00:04:40.936 20:21:59 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:40.936 20:21:59 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:40.936 20:21:59 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:40.936 20:21:59 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:41.507 Calling clear_iscsi_subsystem 00:04:41.507 Calling clear_nvmf_subsystem 00:04:41.507 Calling clear_nbd_subsystem 00:04:41.507 Calling clear_ublk_subsystem 00:04:41.507 Calling clear_vhost_blk_subsystem 00:04:41.507 Calling clear_vhost_scsi_subsystem 00:04:41.507 Calling clear_scheduler_subsystem 00:04:41.507 Calling clear_bdev_subsystem 00:04:41.507 Calling clear_accel_subsystem 00:04:41.507 Calling clear_vmd_subsystem 00:04:41.507 Calling clear_sock_subsystem 00:04:41.507 Calling clear_iobuf_subsystem 00:04:41.507 20:21:59 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:41.507 20:21:59 -- json_config/json_config.sh@396 -- # count=100 00:04:41.507 20:21:59 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:41.507 20:21:59 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:41.507 20:21:59 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:41.507 20:21:59 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:41.507 20:21:59 -- json_config/json_config.sh@398 -- # break 00:04:41.507 20:21:59 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:41.507 20:21:59 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:41.507 20:21:59 -- json_config/json_config.sh@120 -- # local app=target 00:04:41.507 20:21:59 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:41.507 20:21:59 -- json_config/json_config.sh@124 -- # [[ -n 3830666 ]] 00:04:41.507 20:21:59 -- json_config/json_config.sh@127 -- # kill -SIGINT 3830666 00:04:41.507 20:21:59 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:41.507 20:21:59 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:41.507 20:21:59 -- json_config/json_config.sh@130 -- # kill -0 3830666 00:04:41.507 20:21:59 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:42.080 20:22:00 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:42.080 20:22:00 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:42.080 20:22:00 -- json_config/json_config.sh@130 -- # kill -0 3830666 00:04:42.080 20:22:00 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:42.080 20:22:00 -- json_config/json_config.sh@132 -- # break 00:04:42.080 20:22:00 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:42.080 20:22:00 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:42.080 SPDK target shutdown done 00:04:42.080 20:22:00 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:42.080 INFO: relaunching applications... 00:04:42.080 20:22:00 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:42.080 20:22:00 -- json_config/json_config.sh@98 -- # local app=target 00:04:42.080 20:22:00 -- json_config/json_config.sh@99 -- # shift 00:04:42.080 20:22:00 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:42.080 20:22:00 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:42.080 20:22:00 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:42.080 20:22:00 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:42.080 20:22:00 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:42.080 20:22:00 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:42.080 20:22:00 -- json_config/json_config.sh@111 -- # app_pid[$app]=3831665 00:04:42.081 20:22:00 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:42.081 Waiting for target to run... 00:04:42.081 20:22:00 -- json_config/json_config.sh@114 -- # waitforlisten 3831665 /var/tmp/spdk_tgt.sock 00:04:42.081 20:22:00 -- common/autotest_common.sh@819 -- # '[' -z 3831665 ']' 00:04:42.081 20:22:00 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:42.081 20:22:00 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:42.081 20:22:00 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:42.081 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:42.081 20:22:00 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:42.081 20:22:00 -- common/autotest_common.sh@10 -- # set +x 00:04:42.081 [2024-04-26 20:22:00.364241] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:04:42.081 [2024-04-26 20:22:00.364316] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3831665 ] 00:04:42.081 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.652 [2024-04-26 20:22:00.727889] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:42.652 [2024-04-26 20:22:00.778884] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:42.652 [2024-04-26 20:22:00.779007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:43.223 [2024-04-26 20:22:01.267659] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:43.223 [2024-04-26 20:22:01.300027] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:43.484 20:22:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:43.484 20:22:01 -- common/autotest_common.sh@852 -- # return 0 00:04:43.484 20:22:01 -- json_config/json_config.sh@115 -- # echo '' 00:04:43.484 00:04:43.484 20:22:01 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:43.484 20:22:01 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:43.484 INFO: Checking if target configuration is the same... 00:04:43.484 20:22:01 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:43.484 20:22:01 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:43.484 20:22:01 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:43.484 + '[' 2 -ne 2 ']' 00:04:43.484 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:43.484 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:43.484 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:43.484 +++ basename /dev/fd/62 00:04:43.484 ++ mktemp /tmp/62.XXX 00:04:43.484 + tmp_file_1=/tmp/62.ufL 00:04:43.484 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:43.484 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:43.484 + tmp_file_2=/tmp/spdk_tgt_config.json.SD8 00:04:43.484 + ret=0 00:04:43.485 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:43.745 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:44.006 + diff -u /tmp/62.ufL /tmp/spdk_tgt_config.json.SD8 00:04:44.006 + echo 'INFO: JSON config files are the same' 00:04:44.006 INFO: JSON config files are the same 00:04:44.006 + rm /tmp/62.ufL /tmp/spdk_tgt_config.json.SD8 00:04:44.006 + exit 0 00:04:44.006 20:22:02 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:44.006 20:22:02 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:44.006 INFO: changing configuration and checking if this can be detected... 00:04:44.006 20:22:02 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:44.006 20:22:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:44.006 20:22:02 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:44.006 20:22:02 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:44.006 20:22:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:44.006 + '[' 2 -ne 2 ']' 00:04:44.006 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:44.006 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:44.006 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:44.006 +++ basename /dev/fd/62 00:04:44.006 ++ mktemp /tmp/62.XXX 00:04:44.006 + tmp_file_1=/tmp/62.JaH 00:04:44.006 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:44.006 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:44.006 + tmp_file_2=/tmp/spdk_tgt_config.json.jsr 00:04:44.006 + ret=0 00:04:44.006 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:44.267 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:44.267 + diff -u /tmp/62.JaH /tmp/spdk_tgt_config.json.jsr 00:04:44.267 + ret=1 00:04:44.267 + echo '=== Start of file: /tmp/62.JaH ===' 00:04:44.267 + cat /tmp/62.JaH 00:04:44.267 + echo '=== End of file: /tmp/62.JaH ===' 00:04:44.267 + echo '' 00:04:44.267 + echo '=== Start of file: /tmp/spdk_tgt_config.json.jsr ===' 00:04:44.267 + cat /tmp/spdk_tgt_config.json.jsr 00:04:44.267 + echo '=== End of file: /tmp/spdk_tgt_config.json.jsr ===' 00:04:44.267 + echo '' 00:04:44.267 + rm /tmp/62.JaH /tmp/spdk_tgt_config.json.jsr 00:04:44.267 + exit 1 00:04:44.267 20:22:02 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:44.267 INFO: configuration change detected. 00:04:44.267 20:22:02 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:44.267 20:22:02 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:44.267 20:22:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:44.267 20:22:02 -- common/autotest_common.sh@10 -- # set +x 00:04:44.267 20:22:02 -- json_config/json_config.sh@360 -- # local ret=0 00:04:44.267 20:22:02 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:44.267 20:22:02 -- json_config/json_config.sh@370 -- # [[ -n 3831665 ]] 00:04:44.267 20:22:02 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:44.267 20:22:02 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:44.267 20:22:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:44.267 20:22:02 -- common/autotest_common.sh@10 -- # set +x 00:04:44.267 20:22:02 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:44.267 20:22:02 -- json_config/json_config.sh@246 -- # uname -s 00:04:44.267 20:22:02 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:44.528 20:22:02 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:44.529 20:22:02 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:44.529 20:22:02 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:44.529 20:22:02 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:44.529 20:22:02 -- common/autotest_common.sh@10 -- # set +x 00:04:44.529 20:22:02 -- json_config/json_config.sh@376 -- # killprocess 3831665 00:04:44.529 20:22:02 -- common/autotest_common.sh@926 -- # '[' -z 3831665 ']' 00:04:44.529 20:22:02 -- common/autotest_common.sh@930 -- # kill -0 3831665 00:04:44.529 20:22:02 -- common/autotest_common.sh@931 -- # uname 00:04:44.529 20:22:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:44.529 20:22:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3831665 00:04:44.529 20:22:02 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:44.529 20:22:02 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:44.529 20:22:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3831665' 00:04:44.529 killing process with pid 3831665 00:04:44.529 20:22:02 -- common/autotest_common.sh@945 -- # kill 3831665 00:04:44.529 20:22:02 -- common/autotest_common.sh@950 -- # wait 3831665 00:04:44.790 20:22:02 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:44.790 20:22:02 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:44.790 20:22:02 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:44.790 20:22:03 -- common/autotest_common.sh@10 -- # set +x 00:04:44.790 20:22:03 -- json_config/json_config.sh@381 -- # return 0 00:04:44.790 20:22:03 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:44.790 INFO: Success 00:04:44.790 00:04:44.790 real 0m7.146s 00:04:44.790 user 0m8.485s 00:04:44.790 sys 0m1.745s 00:04:44.790 20:22:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:44.790 20:22:03 -- common/autotest_common.sh@10 -- # set +x 00:04:44.790 ************************************ 00:04:44.790 END TEST json_config 00:04:44.790 ************************************ 00:04:44.790 20:22:03 -- spdk/autotest.sh@179 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:44.790 20:22:03 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:44.790 20:22:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:44.790 20:22:03 -- common/autotest_common.sh@10 -- # set +x 00:04:44.790 ************************************ 00:04:44.790 START TEST json_config_extra_key 00:04:44.790 ************************************ 00:04:44.790 20:22:03 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:45.056 20:22:03 -- nvmf/common.sh@7 -- # uname -s 00:04:45.056 20:22:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:45.056 20:22:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:45.056 20:22:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:45.056 20:22:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:45.056 20:22:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:45.056 20:22:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:45.056 20:22:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:45.056 20:22:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:45.056 20:22:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:45.056 20:22:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:45.056 20:22:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:04:45.056 20:22:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:04:45.056 20:22:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:45.056 20:22:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:45.056 20:22:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:45.056 20:22:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:45.056 20:22:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:45.056 20:22:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:45.056 20:22:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:45.056 20:22:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:45.056 20:22:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:45.056 20:22:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:45.056 20:22:03 -- paths/export.sh@5 -- # export PATH 00:04:45.056 20:22:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:45.056 20:22:03 -- nvmf/common.sh@46 -- # : 0 00:04:45.056 20:22:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:45.056 20:22:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:45.056 20:22:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:45.056 20:22:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:45.056 20:22:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:45.056 20:22:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:45.056 20:22:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:45.056 20:22:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:45.056 INFO: launching applications... 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=3832275 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:45.056 Waiting for target to run... 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 3832275 /var/tmp/spdk_tgt.sock 00:04:45.056 20:22:03 -- common/autotest_common.sh@819 -- # '[' -z 3832275 ']' 00:04:45.056 20:22:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:45.056 20:22:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:45.056 20:22:03 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:45.056 20:22:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:45.056 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:45.056 20:22:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:45.056 20:22:03 -- common/autotest_common.sh@10 -- # set +x 00:04:45.056 [2024-04-26 20:22:03.231402] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:04:45.056 [2024-04-26 20:22:03.231457] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3832275 ] 00:04:45.056 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.316 [2024-04-26 20:22:03.509860] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:45.316 [2024-04-26 20:22:03.563551] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:45.316 [2024-04-26 20:22:03.563675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:45.887 20:22:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:45.887 20:22:04 -- common/autotest_common.sh@852 -- # return 0 00:04:45.887 20:22:04 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:45.887 00:04:45.887 20:22:04 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:45.887 INFO: shutting down applications... 00:04:45.887 20:22:04 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:45.887 20:22:04 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:45.887 20:22:04 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:45.887 20:22:04 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 3832275 ]] 00:04:45.887 20:22:04 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 3832275 00:04:45.887 20:22:04 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:45.887 20:22:04 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:45.887 20:22:04 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3832275 00:04:45.887 20:22:04 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:46.459 20:22:04 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:46.459 20:22:04 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:46.459 20:22:04 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3832275 00:04:46.459 20:22:04 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:46.459 20:22:04 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:46.459 20:22:04 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:46.459 20:22:04 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:46.459 SPDK target shutdown done 00:04:46.459 20:22:04 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:46.459 Success 00:04:46.459 00:04:46.459 real 0m1.438s 00:04:46.459 user 0m1.098s 00:04:46.459 sys 0m0.370s 00:04:46.459 20:22:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:46.459 20:22:04 -- common/autotest_common.sh@10 -- # set +x 00:04:46.459 ************************************ 00:04:46.459 END TEST json_config_extra_key 00:04:46.459 ************************************ 00:04:46.459 20:22:04 -- spdk/autotest.sh@180 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:46.459 20:22:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:46.459 20:22:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:46.459 20:22:04 -- common/autotest_common.sh@10 -- # set +x 00:04:46.459 ************************************ 00:04:46.459 START TEST alias_rpc 00:04:46.459 ************************************ 00:04:46.459 20:22:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:46.459 * Looking for test storage... 00:04:46.459 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:46.459 20:22:04 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:46.459 20:22:04 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3832653 00:04:46.459 20:22:04 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3832653 00:04:46.459 20:22:04 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:46.459 20:22:04 -- common/autotest_common.sh@819 -- # '[' -z 3832653 ']' 00:04:46.459 20:22:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:46.459 20:22:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:46.459 20:22:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:46.459 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:46.459 20:22:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:46.459 20:22:04 -- common/autotest_common.sh@10 -- # set +x 00:04:46.459 [2024-04-26 20:22:04.710123] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:04:46.459 [2024-04-26 20:22:04.710191] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3832653 ] 00:04:46.459 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.459 [2024-04-26 20:22:04.774900] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:46.720 [2024-04-26 20:22:04.845919] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:46.720 [2024-04-26 20:22:04.846068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:47.292 20:22:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:47.292 20:22:05 -- common/autotest_common.sh@852 -- # return 0 00:04:47.292 20:22:05 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:47.553 20:22:05 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3832653 00:04:47.553 20:22:05 -- common/autotest_common.sh@926 -- # '[' -z 3832653 ']' 00:04:47.553 20:22:05 -- common/autotest_common.sh@930 -- # kill -0 3832653 00:04:47.553 20:22:05 -- common/autotest_common.sh@931 -- # uname 00:04:47.553 20:22:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:47.553 20:22:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3832653 00:04:47.553 20:22:05 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:47.553 20:22:05 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:47.553 20:22:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3832653' 00:04:47.553 killing process with pid 3832653 00:04:47.553 20:22:05 -- common/autotest_common.sh@945 -- # kill 3832653 00:04:47.553 20:22:05 -- common/autotest_common.sh@950 -- # wait 3832653 00:04:47.814 00:04:47.814 real 0m1.342s 00:04:47.814 user 0m1.478s 00:04:47.814 sys 0m0.355s 00:04:47.814 20:22:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:47.814 20:22:05 -- common/autotest_common.sh@10 -- # set +x 00:04:47.814 ************************************ 00:04:47.814 END TEST alias_rpc 00:04:47.814 ************************************ 00:04:47.814 20:22:05 -- spdk/autotest.sh@182 -- # [[ 0 -eq 0 ]] 00:04:47.814 20:22:05 -- spdk/autotest.sh@183 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:47.814 20:22:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:47.814 20:22:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:47.814 20:22:05 -- common/autotest_common.sh@10 -- # set +x 00:04:47.814 ************************************ 00:04:47.814 START TEST spdkcli_tcp 00:04:47.814 ************************************ 00:04:47.814 20:22:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:47.814 * Looking for test storage... 00:04:47.814 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:47.814 20:22:06 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:47.814 20:22:06 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:47.814 20:22:06 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:47.814 20:22:06 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:47.814 20:22:06 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:47.814 20:22:06 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:47.814 20:22:06 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:47.814 20:22:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:47.814 20:22:06 -- common/autotest_common.sh@10 -- # set +x 00:04:47.814 20:22:06 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3833042 00:04:47.814 20:22:06 -- spdkcli/tcp.sh@27 -- # waitforlisten 3833042 00:04:47.814 20:22:06 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:47.814 20:22:06 -- common/autotest_common.sh@819 -- # '[' -z 3833042 ']' 00:04:47.814 20:22:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:47.814 20:22:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:47.814 20:22:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:47.814 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:47.814 20:22:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:47.814 20:22:06 -- common/autotest_common.sh@10 -- # set +x 00:04:47.814 [2024-04-26 20:22:06.104674] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:04:47.814 [2024-04-26 20:22:06.104744] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3833042 ] 00:04:47.815 EAL: No free 2048 kB hugepages reported on node 1 00:04:48.075 [2024-04-26 20:22:06.170361] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:48.075 [2024-04-26 20:22:06.243351] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:48.075 [2024-04-26 20:22:06.243599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:48.075 [2024-04-26 20:22:06.243713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:48.647 20:22:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:48.647 20:22:06 -- common/autotest_common.sh@852 -- # return 0 00:04:48.647 20:22:06 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:48.647 20:22:06 -- spdkcli/tcp.sh@31 -- # socat_pid=3833230 00:04:48.647 20:22:06 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:48.908 [ 00:04:48.908 "bdev_malloc_delete", 00:04:48.908 "bdev_malloc_create", 00:04:48.908 "bdev_null_resize", 00:04:48.908 "bdev_null_delete", 00:04:48.908 "bdev_null_create", 00:04:48.908 "bdev_nvme_cuse_unregister", 00:04:48.908 "bdev_nvme_cuse_register", 00:04:48.908 "bdev_opal_new_user", 00:04:48.908 "bdev_opal_set_lock_state", 00:04:48.908 "bdev_opal_delete", 00:04:48.908 "bdev_opal_get_info", 00:04:48.908 "bdev_opal_create", 00:04:48.908 "bdev_nvme_opal_revert", 00:04:48.908 "bdev_nvme_opal_init", 00:04:48.908 "bdev_nvme_send_cmd", 00:04:48.908 "bdev_nvme_get_path_iostat", 00:04:48.908 "bdev_nvme_get_mdns_discovery_info", 00:04:48.908 "bdev_nvme_stop_mdns_discovery", 00:04:48.908 "bdev_nvme_start_mdns_discovery", 00:04:48.908 "bdev_nvme_set_multipath_policy", 00:04:48.908 "bdev_nvme_set_preferred_path", 00:04:48.908 "bdev_nvme_get_io_paths", 00:04:48.908 "bdev_nvme_remove_error_injection", 00:04:48.908 "bdev_nvme_add_error_injection", 00:04:48.908 "bdev_nvme_get_discovery_info", 00:04:48.908 "bdev_nvme_stop_discovery", 00:04:48.908 "bdev_nvme_start_discovery", 00:04:48.908 "bdev_nvme_get_controller_health_info", 00:04:48.908 "bdev_nvme_disable_controller", 00:04:48.908 "bdev_nvme_enable_controller", 00:04:48.908 "bdev_nvme_reset_controller", 00:04:48.908 "bdev_nvme_get_transport_statistics", 00:04:48.908 "bdev_nvme_apply_firmware", 00:04:48.908 "bdev_nvme_detach_controller", 00:04:48.908 "bdev_nvme_get_controllers", 00:04:48.908 "bdev_nvme_attach_controller", 00:04:48.908 "bdev_nvme_set_hotplug", 00:04:48.908 "bdev_nvme_set_options", 00:04:48.908 "bdev_passthru_delete", 00:04:48.908 "bdev_passthru_create", 00:04:48.908 "bdev_lvol_grow_lvstore", 00:04:48.908 "bdev_lvol_get_lvols", 00:04:48.908 "bdev_lvol_get_lvstores", 00:04:48.908 "bdev_lvol_delete", 00:04:48.908 "bdev_lvol_set_read_only", 00:04:48.908 "bdev_lvol_resize", 00:04:48.908 "bdev_lvol_decouple_parent", 00:04:48.908 "bdev_lvol_inflate", 00:04:48.908 "bdev_lvol_rename", 00:04:48.908 "bdev_lvol_clone_bdev", 00:04:48.908 "bdev_lvol_clone", 00:04:48.908 "bdev_lvol_snapshot", 00:04:48.908 "bdev_lvol_create", 00:04:48.908 "bdev_lvol_delete_lvstore", 00:04:48.908 "bdev_lvol_rename_lvstore", 00:04:48.908 "bdev_lvol_create_lvstore", 00:04:48.908 "bdev_raid_set_options", 00:04:48.908 "bdev_raid_remove_base_bdev", 00:04:48.908 "bdev_raid_add_base_bdev", 00:04:48.908 "bdev_raid_delete", 00:04:48.908 "bdev_raid_create", 00:04:48.908 "bdev_raid_get_bdevs", 00:04:48.908 "bdev_error_inject_error", 00:04:48.908 "bdev_error_delete", 00:04:48.908 "bdev_error_create", 00:04:48.908 "bdev_split_delete", 00:04:48.908 "bdev_split_create", 00:04:48.908 "bdev_delay_delete", 00:04:48.908 "bdev_delay_create", 00:04:48.908 "bdev_delay_update_latency", 00:04:48.908 "bdev_zone_block_delete", 00:04:48.908 "bdev_zone_block_create", 00:04:48.908 "blobfs_create", 00:04:48.908 "blobfs_detect", 00:04:48.908 "blobfs_set_cache_size", 00:04:48.908 "bdev_aio_delete", 00:04:48.908 "bdev_aio_rescan", 00:04:48.908 "bdev_aio_create", 00:04:48.908 "bdev_ftl_set_property", 00:04:48.908 "bdev_ftl_get_properties", 00:04:48.908 "bdev_ftl_get_stats", 00:04:48.908 "bdev_ftl_unmap", 00:04:48.908 "bdev_ftl_unload", 00:04:48.908 "bdev_ftl_delete", 00:04:48.908 "bdev_ftl_load", 00:04:48.908 "bdev_ftl_create", 00:04:48.908 "bdev_virtio_attach_controller", 00:04:48.908 "bdev_virtio_scsi_get_devices", 00:04:48.908 "bdev_virtio_detach_controller", 00:04:48.908 "bdev_virtio_blk_set_hotplug", 00:04:48.908 "bdev_iscsi_delete", 00:04:48.909 "bdev_iscsi_create", 00:04:48.909 "bdev_iscsi_set_options", 00:04:48.909 "accel_error_inject_error", 00:04:48.909 "ioat_scan_accel_module", 00:04:48.909 "dsa_scan_accel_module", 00:04:48.909 "iaa_scan_accel_module", 00:04:48.909 "iscsi_set_options", 00:04:48.909 "iscsi_get_auth_groups", 00:04:48.909 "iscsi_auth_group_remove_secret", 00:04:48.909 "iscsi_auth_group_add_secret", 00:04:48.909 "iscsi_delete_auth_group", 00:04:48.909 "iscsi_create_auth_group", 00:04:48.909 "iscsi_set_discovery_auth", 00:04:48.909 "iscsi_get_options", 00:04:48.909 "iscsi_target_node_request_logout", 00:04:48.909 "iscsi_target_node_set_redirect", 00:04:48.909 "iscsi_target_node_set_auth", 00:04:48.909 "iscsi_target_node_add_lun", 00:04:48.909 "iscsi_get_connections", 00:04:48.909 "iscsi_portal_group_set_auth", 00:04:48.909 "iscsi_start_portal_group", 00:04:48.909 "iscsi_delete_portal_group", 00:04:48.909 "iscsi_create_portal_group", 00:04:48.909 "iscsi_get_portal_groups", 00:04:48.909 "iscsi_delete_target_node", 00:04:48.909 "iscsi_target_node_remove_pg_ig_maps", 00:04:48.909 "iscsi_target_node_add_pg_ig_maps", 00:04:48.909 "iscsi_create_target_node", 00:04:48.909 "iscsi_get_target_nodes", 00:04:48.909 "iscsi_delete_initiator_group", 00:04:48.909 "iscsi_initiator_group_remove_initiators", 00:04:48.909 "iscsi_initiator_group_add_initiators", 00:04:48.909 "iscsi_create_initiator_group", 00:04:48.909 "iscsi_get_initiator_groups", 00:04:48.909 "nvmf_set_crdt", 00:04:48.909 "nvmf_set_config", 00:04:48.909 "nvmf_set_max_subsystems", 00:04:48.909 "nvmf_subsystem_get_listeners", 00:04:48.909 "nvmf_subsystem_get_qpairs", 00:04:48.909 "nvmf_subsystem_get_controllers", 00:04:48.909 "nvmf_get_stats", 00:04:48.909 "nvmf_get_transports", 00:04:48.909 "nvmf_create_transport", 00:04:48.909 "nvmf_get_targets", 00:04:48.909 "nvmf_delete_target", 00:04:48.909 "nvmf_create_target", 00:04:48.909 "nvmf_subsystem_allow_any_host", 00:04:48.909 "nvmf_subsystem_remove_host", 00:04:48.909 "nvmf_subsystem_add_host", 00:04:48.909 "nvmf_subsystem_remove_ns", 00:04:48.909 "nvmf_subsystem_add_ns", 00:04:48.909 "nvmf_subsystem_listener_set_ana_state", 00:04:48.909 "nvmf_discovery_get_referrals", 00:04:48.909 "nvmf_discovery_remove_referral", 00:04:48.909 "nvmf_discovery_add_referral", 00:04:48.909 "nvmf_subsystem_remove_listener", 00:04:48.909 "nvmf_subsystem_add_listener", 00:04:48.909 "nvmf_delete_subsystem", 00:04:48.909 "nvmf_create_subsystem", 00:04:48.909 "nvmf_get_subsystems", 00:04:48.909 "env_dpdk_get_mem_stats", 00:04:48.909 "nbd_get_disks", 00:04:48.909 "nbd_stop_disk", 00:04:48.909 "nbd_start_disk", 00:04:48.909 "ublk_recover_disk", 00:04:48.909 "ublk_get_disks", 00:04:48.909 "ublk_stop_disk", 00:04:48.909 "ublk_start_disk", 00:04:48.909 "ublk_destroy_target", 00:04:48.909 "ublk_create_target", 00:04:48.909 "virtio_blk_create_transport", 00:04:48.909 "virtio_blk_get_transports", 00:04:48.909 "vhost_controller_set_coalescing", 00:04:48.909 "vhost_get_controllers", 00:04:48.909 "vhost_delete_controller", 00:04:48.909 "vhost_create_blk_controller", 00:04:48.909 "vhost_scsi_controller_remove_target", 00:04:48.909 "vhost_scsi_controller_add_target", 00:04:48.909 "vhost_start_scsi_controller", 00:04:48.909 "vhost_create_scsi_controller", 00:04:48.909 "thread_set_cpumask", 00:04:48.909 "framework_get_scheduler", 00:04:48.909 "framework_set_scheduler", 00:04:48.909 "framework_get_reactors", 00:04:48.909 "thread_get_io_channels", 00:04:48.909 "thread_get_pollers", 00:04:48.909 "thread_get_stats", 00:04:48.909 "framework_monitor_context_switch", 00:04:48.909 "spdk_kill_instance", 00:04:48.909 "log_enable_timestamps", 00:04:48.909 "log_get_flags", 00:04:48.909 "log_clear_flag", 00:04:48.909 "log_set_flag", 00:04:48.909 "log_get_level", 00:04:48.909 "log_set_level", 00:04:48.909 "log_get_print_level", 00:04:48.909 "log_set_print_level", 00:04:48.909 "framework_enable_cpumask_locks", 00:04:48.909 "framework_disable_cpumask_locks", 00:04:48.909 "framework_wait_init", 00:04:48.909 "framework_start_init", 00:04:48.909 "scsi_get_devices", 00:04:48.909 "bdev_get_histogram", 00:04:48.909 "bdev_enable_histogram", 00:04:48.909 "bdev_set_qos_limit", 00:04:48.909 "bdev_set_qd_sampling_period", 00:04:48.909 "bdev_get_bdevs", 00:04:48.909 "bdev_reset_iostat", 00:04:48.909 "bdev_get_iostat", 00:04:48.909 "bdev_examine", 00:04:48.909 "bdev_wait_for_examine", 00:04:48.909 "bdev_set_options", 00:04:48.909 "notify_get_notifications", 00:04:48.909 "notify_get_types", 00:04:48.909 "accel_get_stats", 00:04:48.909 "accel_set_options", 00:04:48.909 "accel_set_driver", 00:04:48.909 "accel_crypto_key_destroy", 00:04:48.909 "accel_crypto_keys_get", 00:04:48.909 "accel_crypto_key_create", 00:04:48.909 "accel_assign_opc", 00:04:48.909 "accel_get_module_info", 00:04:48.909 "accel_get_opc_assignments", 00:04:48.909 "vmd_rescan", 00:04:48.909 "vmd_remove_device", 00:04:48.909 "vmd_enable", 00:04:48.909 "sock_set_default_impl", 00:04:48.909 "sock_impl_set_options", 00:04:48.909 "sock_impl_get_options", 00:04:48.909 "iobuf_get_stats", 00:04:48.909 "iobuf_set_options", 00:04:48.909 "framework_get_pci_devices", 00:04:48.909 "framework_get_config", 00:04:48.909 "framework_get_subsystems", 00:04:48.909 "trace_get_info", 00:04:48.909 "trace_get_tpoint_group_mask", 00:04:48.909 "trace_disable_tpoint_group", 00:04:48.909 "trace_enable_tpoint_group", 00:04:48.909 "trace_clear_tpoint_mask", 00:04:48.909 "trace_set_tpoint_mask", 00:04:48.909 "spdk_get_version", 00:04:48.909 "rpc_get_methods" 00:04:48.909 ] 00:04:48.909 20:22:07 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:48.909 20:22:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:48.909 20:22:07 -- common/autotest_common.sh@10 -- # set +x 00:04:48.909 20:22:07 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:48.909 20:22:07 -- spdkcli/tcp.sh@38 -- # killprocess 3833042 00:04:48.909 20:22:07 -- common/autotest_common.sh@926 -- # '[' -z 3833042 ']' 00:04:48.909 20:22:07 -- common/autotest_common.sh@930 -- # kill -0 3833042 00:04:48.909 20:22:07 -- common/autotest_common.sh@931 -- # uname 00:04:48.909 20:22:07 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:48.909 20:22:07 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3833042 00:04:48.909 20:22:07 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:48.909 20:22:07 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:48.910 20:22:07 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3833042' 00:04:48.910 killing process with pid 3833042 00:04:48.910 20:22:07 -- common/autotest_common.sh@945 -- # kill 3833042 00:04:48.910 20:22:07 -- common/autotest_common.sh@950 -- # wait 3833042 00:04:49.172 00:04:49.172 real 0m1.371s 00:04:49.172 user 0m2.504s 00:04:49.172 sys 0m0.419s 00:04:49.172 20:22:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:49.172 20:22:07 -- common/autotest_common.sh@10 -- # set +x 00:04:49.172 ************************************ 00:04:49.172 END TEST spdkcli_tcp 00:04:49.172 ************************************ 00:04:49.172 20:22:07 -- spdk/autotest.sh@186 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:49.172 20:22:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:49.172 20:22:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:49.172 20:22:07 -- common/autotest_common.sh@10 -- # set +x 00:04:49.172 ************************************ 00:04:49.172 START TEST dpdk_mem_utility 00:04:49.172 ************************************ 00:04:49.172 20:22:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:49.172 * Looking for test storage... 00:04:49.172 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:49.172 20:22:07 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:49.172 20:22:07 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3833447 00:04:49.172 20:22:07 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3833447 00:04:49.172 20:22:07 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:49.172 20:22:07 -- common/autotest_common.sh@819 -- # '[' -z 3833447 ']' 00:04:49.172 20:22:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:49.172 20:22:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:49.172 20:22:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:49.172 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:49.172 20:22:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:49.172 20:22:07 -- common/autotest_common.sh@10 -- # set +x 00:04:49.434 [2024-04-26 20:22:07.519967] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:04:49.434 [2024-04-26 20:22:07.520033] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3833447 ] 00:04:49.434 EAL: No free 2048 kB hugepages reported on node 1 00:04:49.434 [2024-04-26 20:22:07.580993] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:49.434 [2024-04-26 20:22:07.648409] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:49.434 [2024-04-26 20:22:07.648533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:50.005 20:22:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:50.005 20:22:08 -- common/autotest_common.sh@852 -- # return 0 00:04:50.005 20:22:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:50.005 20:22:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:50.005 20:22:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:50.005 20:22:08 -- common/autotest_common.sh@10 -- # set +x 00:04:50.005 { 00:04:50.005 "filename": "/tmp/spdk_mem_dump.txt" 00:04:50.005 } 00:04:50.005 20:22:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:50.005 20:22:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:50.005 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:50.005 1 heaps totaling size 814.000000 MiB 00:04:50.005 size: 814.000000 MiB heap id: 0 00:04:50.005 end heaps---------- 00:04:50.005 8 mempools totaling size 598.116089 MiB 00:04:50.005 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:50.005 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:50.005 size: 84.521057 MiB name: bdev_io_3833447 00:04:50.005 size: 51.011292 MiB name: evtpool_3833447 00:04:50.005 size: 50.003479 MiB name: msgpool_3833447 00:04:50.005 size: 21.763794 MiB name: PDU_Pool 00:04:50.005 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:50.005 size: 0.026123 MiB name: Session_Pool 00:04:50.005 end mempools------- 00:04:50.005 6 memzones totaling size 4.142822 MiB 00:04:50.005 size: 1.000366 MiB name: RG_ring_0_3833447 00:04:50.005 size: 1.000366 MiB name: RG_ring_1_3833447 00:04:50.005 size: 1.000366 MiB name: RG_ring_4_3833447 00:04:50.005 size: 1.000366 MiB name: RG_ring_5_3833447 00:04:50.005 size: 0.125366 MiB name: RG_ring_2_3833447 00:04:50.005 size: 0.015991 MiB name: RG_ring_3_3833447 00:04:50.005 end memzones------- 00:04:50.005 20:22:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:50.267 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:50.267 list of free elements. size: 12.519348 MiB 00:04:50.267 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:50.267 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:50.267 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:50.267 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:50.267 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:50.267 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:50.267 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:50.267 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:50.267 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:50.267 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:50.267 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:50.267 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:50.267 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:50.267 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:50.267 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:50.267 list of standard malloc elements. size: 199.218079 MiB 00:04:50.267 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:50.267 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:50.267 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:50.267 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:50.267 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:50.267 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:50.267 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:50.267 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:50.267 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:50.267 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:50.267 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:50.267 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:50.267 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:50.267 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:50.267 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:50.267 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:50.267 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:50.267 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:50.267 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:50.267 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:50.267 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:50.267 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:50.267 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:50.267 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:50.267 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:50.267 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:50.267 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:50.267 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:50.267 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:50.267 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:50.267 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:50.267 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:50.267 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:50.267 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:50.267 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:50.267 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:50.267 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:50.267 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:50.267 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:50.267 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:50.267 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:50.267 list of memzone associated elements. size: 602.262573 MiB 00:04:50.267 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:50.267 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:50.267 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:50.267 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:50.267 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:50.267 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3833447_0 00:04:50.267 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:50.267 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3833447_0 00:04:50.267 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:50.267 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3833447_0 00:04:50.267 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:50.267 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:50.267 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:50.267 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:50.267 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:50.267 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3833447 00:04:50.267 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:50.267 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3833447 00:04:50.267 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:50.267 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3833447 00:04:50.267 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:50.267 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:50.268 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:50.268 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:50.268 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:50.268 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:50.268 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:50.268 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:50.268 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:50.268 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3833447 00:04:50.268 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:50.268 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3833447 00:04:50.268 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:50.268 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3833447 00:04:50.268 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:50.268 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3833447 00:04:50.268 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:50.268 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3833447 00:04:50.268 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:50.268 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:50.268 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:50.268 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:50.268 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:50.268 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:50.268 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:50.268 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3833447 00:04:50.268 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:50.268 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:50.268 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:50.268 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:50.268 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:50.268 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3833447 00:04:50.268 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:50.268 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:50.268 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:50.268 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3833447 00:04:50.268 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:50.268 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3833447 00:04:50.268 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:50.268 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:50.268 20:22:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:50.268 20:22:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3833447 00:04:50.268 20:22:08 -- common/autotest_common.sh@926 -- # '[' -z 3833447 ']' 00:04:50.268 20:22:08 -- common/autotest_common.sh@930 -- # kill -0 3833447 00:04:50.268 20:22:08 -- common/autotest_common.sh@931 -- # uname 00:04:50.268 20:22:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:50.268 20:22:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3833447 00:04:50.268 20:22:08 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:50.268 20:22:08 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:50.268 20:22:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3833447' 00:04:50.268 killing process with pid 3833447 00:04:50.268 20:22:08 -- common/autotest_common.sh@945 -- # kill 3833447 00:04:50.268 20:22:08 -- common/autotest_common.sh@950 -- # wait 3833447 00:04:50.529 00:04:50.529 real 0m1.265s 00:04:50.529 user 0m1.348s 00:04:50.529 sys 0m0.354s 00:04:50.529 20:22:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:50.529 20:22:08 -- common/autotest_common.sh@10 -- # set +x 00:04:50.529 ************************************ 00:04:50.529 END TEST dpdk_mem_utility 00:04:50.529 ************************************ 00:04:50.529 20:22:08 -- spdk/autotest.sh@187 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:50.529 20:22:08 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:50.529 20:22:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:50.529 20:22:08 -- common/autotest_common.sh@10 -- # set +x 00:04:50.529 ************************************ 00:04:50.529 START TEST event 00:04:50.529 ************************************ 00:04:50.529 20:22:08 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:50.529 * Looking for test storage... 00:04:50.529 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:50.529 20:22:08 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:50.529 20:22:08 -- bdev/nbd_common.sh@6 -- # set -e 00:04:50.529 20:22:08 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:50.529 20:22:08 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:04:50.529 20:22:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:50.529 20:22:08 -- common/autotest_common.sh@10 -- # set +x 00:04:50.529 ************************************ 00:04:50.529 START TEST event_perf 00:04:50.529 ************************************ 00:04:50.529 20:22:08 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:50.529 Running I/O for 1 seconds...[2024-04-26 20:22:08.801364] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:04:50.529 [2024-04-26 20:22:08.801472] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3833824 ] 00:04:50.529 EAL: No free 2048 kB hugepages reported on node 1 00:04:50.529 [2024-04-26 20:22:08.867508] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:50.790 [2024-04-26 20:22:08.931948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:50.790 [2024-04-26 20:22:08.932082] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:50.790 [2024-04-26 20:22:08.932207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:50.790 [2024-04-26 20:22:08.932210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.732 Running I/O for 1 seconds... 00:04:51.732 lcore 0: 167648 00:04:51.732 lcore 1: 167649 00:04:51.732 lcore 2: 167646 00:04:51.732 lcore 3: 167650 00:04:51.732 done. 00:04:51.732 00:04:51.732 real 0m1.205s 00:04:51.732 user 0m4.127s 00:04:51.732 sys 0m0.076s 00:04:51.732 20:22:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:51.732 20:22:09 -- common/autotest_common.sh@10 -- # set +x 00:04:51.732 ************************************ 00:04:51.732 END TEST event_perf 00:04:51.732 ************************************ 00:04:51.732 20:22:10 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:51.732 20:22:10 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:04:51.732 20:22:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:51.732 20:22:10 -- common/autotest_common.sh@10 -- # set +x 00:04:51.732 ************************************ 00:04:51.732 START TEST event_reactor 00:04:51.732 ************************************ 00:04:51.732 20:22:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:51.732 [2024-04-26 20:22:10.050961] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:04:51.732 [2024-04-26 20:22:10.051074] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3833965 ] 00:04:51.993 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.993 [2024-04-26 20:22:10.113745] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:51.993 [2024-04-26 20:22:10.176992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:52.935 test_start 00:04:52.935 oneshot 00:04:52.935 tick 100 00:04:52.935 tick 100 00:04:52.935 tick 250 00:04:52.935 tick 100 00:04:52.935 tick 100 00:04:52.935 tick 100 00:04:52.935 tick 250 00:04:52.935 tick 500 00:04:52.935 tick 100 00:04:52.935 tick 100 00:04:52.935 tick 250 00:04:52.935 tick 100 00:04:52.935 tick 100 00:04:52.935 test_end 00:04:52.935 00:04:52.935 real 0m1.199s 00:04:52.935 user 0m1.128s 00:04:52.935 sys 0m0.067s 00:04:52.935 20:22:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:52.935 20:22:11 -- common/autotest_common.sh@10 -- # set +x 00:04:52.935 ************************************ 00:04:52.935 END TEST event_reactor 00:04:52.935 ************************************ 00:04:52.935 20:22:11 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:52.935 20:22:11 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:04:52.935 20:22:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:52.935 20:22:11 -- common/autotest_common.sh@10 -- # set +x 00:04:52.935 ************************************ 00:04:52.935 START TEST event_reactor_perf 00:04:52.935 ************************************ 00:04:52.935 20:22:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:53.195 [2024-04-26 20:22:11.293970] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:04:53.195 [2024-04-26 20:22:11.294058] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3834224 ] 00:04:53.195 EAL: No free 2048 kB hugepages reported on node 1 00:04:53.195 [2024-04-26 20:22:11.356669] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:53.195 [2024-04-26 20:22:11.420965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.135 test_start 00:04:54.135 test_end 00:04:54.135 Performance: 360980 events per second 00:04:54.135 00:04:54.135 real 0m1.200s 00:04:54.135 user 0m1.128s 00:04:54.135 sys 0m0.068s 00:04:54.135 20:22:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:54.135 20:22:12 -- common/autotest_common.sh@10 -- # set +x 00:04:54.135 ************************************ 00:04:54.135 END TEST event_reactor_perf 00:04:54.135 ************************************ 00:04:54.395 20:22:12 -- event/event.sh@49 -- # uname -s 00:04:54.395 20:22:12 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:54.395 20:22:12 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:54.395 20:22:12 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:54.395 20:22:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:54.395 20:22:12 -- common/autotest_common.sh@10 -- # set +x 00:04:54.395 ************************************ 00:04:54.395 START TEST event_scheduler 00:04:54.395 ************************************ 00:04:54.395 20:22:12 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:54.395 * Looking for test storage... 00:04:54.395 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:54.395 20:22:12 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:54.395 20:22:12 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3834606 00:04:54.395 20:22:12 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:54.395 20:22:12 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:54.395 20:22:12 -- scheduler/scheduler.sh@37 -- # waitforlisten 3834606 00:04:54.395 20:22:12 -- common/autotest_common.sh@819 -- # '[' -z 3834606 ']' 00:04:54.395 20:22:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:54.395 20:22:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:54.395 20:22:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:54.395 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:54.395 20:22:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:54.395 20:22:12 -- common/autotest_common.sh@10 -- # set +x 00:04:54.395 [2024-04-26 20:22:12.660849] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:04:54.395 [2024-04-26 20:22:12.660914] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3834606 ] 00:04:54.395 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.395 [2024-04-26 20:22:12.716766] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:54.655 [2024-04-26 20:22:12.777041] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.655 [2024-04-26 20:22:12.777182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:54.655 [2024-04-26 20:22:12.777308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:54.655 [2024-04-26 20:22:12.777310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:55.250 20:22:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:55.250 20:22:13 -- common/autotest_common.sh@852 -- # return 0 00:04:55.250 20:22:13 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:55.250 20:22:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:55.250 20:22:13 -- common/autotest_common.sh@10 -- # set +x 00:04:55.250 POWER: Env isn't set yet! 00:04:55.250 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:55.250 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:04:55.250 POWER: Cannot set governor of lcore 0 to userspace 00:04:55.250 POWER: Attempting to initialise PSTAT power management... 00:04:55.250 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:55.250 POWER: Initialized successfully for lcore 0 power management 00:04:55.250 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:55.250 POWER: Initialized successfully for lcore 1 power management 00:04:55.250 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:55.250 POWER: Initialized successfully for lcore 2 power management 00:04:55.250 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:55.250 POWER: Initialized successfully for lcore 3 power management 00:04:55.250 20:22:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:55.250 20:22:13 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:55.250 20:22:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:55.250 20:22:13 -- common/autotest_common.sh@10 -- # set +x 00:04:55.250 [2024-04-26 20:22:13.559125] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:55.250 20:22:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:55.250 20:22:13 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:55.250 20:22:13 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:55.250 20:22:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:55.250 20:22:13 -- common/autotest_common.sh@10 -- # set +x 00:04:55.250 ************************************ 00:04:55.250 START TEST scheduler_create_thread 00:04:55.250 ************************************ 00:04:55.250 20:22:13 -- common/autotest_common.sh@1104 -- # scheduler_create_thread 00:04:55.250 20:22:13 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:55.250 20:22:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:55.250 20:22:13 -- common/autotest_common.sh@10 -- # set +x 00:04:55.250 2 00:04:55.250 20:22:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:55.250 20:22:13 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:55.250 20:22:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:55.250 20:22:13 -- common/autotest_common.sh@10 -- # set +x 00:04:55.543 3 00:04:55.543 20:22:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:55.543 20:22:13 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:55.543 20:22:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:55.543 20:22:13 -- common/autotest_common.sh@10 -- # set +x 00:04:55.543 4 00:04:55.543 20:22:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:55.543 20:22:13 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:55.543 20:22:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:55.543 20:22:13 -- common/autotest_common.sh@10 -- # set +x 00:04:55.543 5 00:04:55.543 20:22:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:55.543 20:22:13 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:55.543 20:22:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:55.543 20:22:13 -- common/autotest_common.sh@10 -- # set +x 00:04:55.543 6 00:04:55.543 20:22:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:55.543 20:22:13 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:55.543 20:22:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:55.543 20:22:13 -- common/autotest_common.sh@10 -- # set +x 00:04:55.543 7 00:04:55.543 20:22:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:55.543 20:22:13 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:55.543 20:22:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:55.543 20:22:13 -- common/autotest_common.sh@10 -- # set +x 00:04:55.543 8 00:04:55.543 20:22:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:55.543 20:22:13 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:55.543 20:22:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:55.543 20:22:13 -- common/autotest_common.sh@10 -- # set +x 00:04:56.929 9 00:04:56.929 20:22:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:56.929 20:22:14 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:56.929 20:22:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:56.929 20:22:14 -- common/autotest_common.sh@10 -- # set +x 00:04:57.867 10 00:04:57.867 20:22:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:57.867 20:22:16 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:57.867 20:22:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:57.867 20:22:16 -- common/autotest_common.sh@10 -- # set +x 00:04:58.809 20:22:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:58.809 20:22:16 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:58.810 20:22:16 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:58.810 20:22:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:58.810 20:22:16 -- common/autotest_common.sh@10 -- # set +x 00:04:59.380 20:22:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:59.380 20:22:17 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:59.380 20:22:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:59.380 20:22:17 -- common/autotest_common.sh@10 -- # set +x 00:04:59.949 20:22:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:59.949 20:22:18 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:59.949 20:22:18 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:59.949 20:22:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:59.949 20:22:18 -- common/autotest_common.sh@10 -- # set +x 00:05:00.209 20:22:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:00.209 00:05:00.209 real 0m4.968s 00:05:00.209 user 0m0.026s 00:05:00.209 sys 0m0.005s 00:05:00.209 20:22:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:00.209 20:22:18 -- common/autotest_common.sh@10 -- # set +x 00:05:00.209 ************************************ 00:05:00.209 END TEST scheduler_create_thread 00:05:00.209 ************************************ 00:05:00.469 20:22:18 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:00.469 20:22:18 -- scheduler/scheduler.sh@46 -- # killprocess 3834606 00:05:00.469 20:22:18 -- common/autotest_common.sh@926 -- # '[' -z 3834606 ']' 00:05:00.469 20:22:18 -- common/autotest_common.sh@930 -- # kill -0 3834606 00:05:00.469 20:22:18 -- common/autotest_common.sh@931 -- # uname 00:05:00.470 20:22:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:00.470 20:22:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3834606 00:05:00.470 20:22:18 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:05:00.470 20:22:18 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:05:00.470 20:22:18 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3834606' 00:05:00.470 killing process with pid 3834606 00:05:00.470 20:22:18 -- common/autotest_common.sh@945 -- # kill 3834606 00:05:00.470 20:22:18 -- common/autotest_common.sh@950 -- # wait 3834606 00:05:00.470 [2024-04-26 20:22:18.765586] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:00.730 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:05:00.730 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:00.730 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:05:00.730 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:00.730 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:05:00.730 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:00.730 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:05:00.730 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:00.730 00:05:00.730 real 0m6.446s 00:05:00.730 user 0m15.132s 00:05:00.730 sys 0m0.313s 00:05:00.730 20:22:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:00.730 20:22:18 -- common/autotest_common.sh@10 -- # set +x 00:05:00.730 ************************************ 00:05:00.730 END TEST event_scheduler 00:05:00.730 ************************************ 00:05:00.730 20:22:19 -- event/event.sh@51 -- # modprobe -n nbd 00:05:00.730 20:22:19 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:00.730 20:22:19 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:00.730 20:22:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:00.730 20:22:19 -- common/autotest_common.sh@10 -- # set +x 00:05:00.730 ************************************ 00:05:00.730 START TEST app_repeat 00:05:00.730 ************************************ 00:05:00.730 20:22:19 -- common/autotest_common.sh@1104 -- # app_repeat_test 00:05:00.730 20:22:19 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:00.730 20:22:19 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.730 20:22:19 -- event/event.sh@13 -- # local nbd_list 00:05:00.730 20:22:19 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:00.730 20:22:19 -- event/event.sh@14 -- # local bdev_list 00:05:00.730 20:22:19 -- event/event.sh@15 -- # local repeat_times=4 00:05:00.730 20:22:19 -- event/event.sh@17 -- # modprobe nbd 00:05:00.730 20:22:19 -- event/event.sh@19 -- # repeat_pid=3836009 00:05:00.730 20:22:19 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:00.730 20:22:19 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:00.730 20:22:19 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3836009' 00:05:00.730 Process app_repeat pid: 3836009 00:05:00.730 20:22:19 -- event/event.sh@23 -- # for i in {0..2} 00:05:00.730 20:22:19 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:00.730 spdk_app_start Round 0 00:05:00.730 20:22:19 -- event/event.sh@25 -- # waitforlisten 3836009 /var/tmp/spdk-nbd.sock 00:05:00.730 20:22:19 -- common/autotest_common.sh@819 -- # '[' -z 3836009 ']' 00:05:00.730 20:22:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:00.730 20:22:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:00.730 20:22:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:00.730 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:00.730 20:22:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:00.730 20:22:19 -- common/autotest_common.sh@10 -- # set +x 00:05:00.730 [2024-04-26 20:22:19.056542] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:00.730 [2024-04-26 20:22:19.056611] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3836009 ] 00:05:00.990 EAL: No free 2048 kB hugepages reported on node 1 00:05:00.990 [2024-04-26 20:22:19.117073] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:00.990 [2024-04-26 20:22:19.179779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:00.990 [2024-04-26 20:22:19.179786] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.561 20:22:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:01.561 20:22:19 -- common/autotest_common.sh@852 -- # return 0 00:05:01.561 20:22:19 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:01.822 Malloc0 00:05:01.822 20:22:20 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:02.083 Malloc1 00:05:02.083 20:22:20 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@12 -- # local i 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:02.083 /dev/nbd0 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:02.083 20:22:20 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:05:02.083 20:22:20 -- common/autotest_common.sh@857 -- # local i 00:05:02.083 20:22:20 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:02.083 20:22:20 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:02.083 20:22:20 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:05:02.083 20:22:20 -- common/autotest_common.sh@861 -- # break 00:05:02.083 20:22:20 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:02.083 20:22:20 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:02.083 20:22:20 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:02.083 1+0 records in 00:05:02.083 1+0 records out 00:05:02.083 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000282519 s, 14.5 MB/s 00:05:02.083 20:22:20 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.083 20:22:20 -- common/autotest_common.sh@874 -- # size=4096 00:05:02.083 20:22:20 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.083 20:22:20 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:02.083 20:22:20 -- common/autotest_common.sh@877 -- # return 0 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:02.083 20:22:20 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:02.343 /dev/nbd1 00:05:02.343 20:22:20 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:02.343 20:22:20 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:02.343 20:22:20 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:05:02.343 20:22:20 -- common/autotest_common.sh@857 -- # local i 00:05:02.343 20:22:20 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:02.343 20:22:20 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:02.343 20:22:20 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:05:02.343 20:22:20 -- common/autotest_common.sh@861 -- # break 00:05:02.343 20:22:20 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:02.343 20:22:20 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:02.343 20:22:20 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:02.343 1+0 records in 00:05:02.343 1+0 records out 00:05:02.343 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000241663 s, 16.9 MB/s 00:05:02.343 20:22:20 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.343 20:22:20 -- common/autotest_common.sh@874 -- # size=4096 00:05:02.343 20:22:20 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:02.343 20:22:20 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:02.343 20:22:20 -- common/autotest_common.sh@877 -- # return 0 00:05:02.343 20:22:20 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:02.343 20:22:20 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:02.343 20:22:20 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:02.343 20:22:20 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.343 20:22:20 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:02.603 20:22:20 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:02.603 { 00:05:02.603 "nbd_device": "/dev/nbd0", 00:05:02.603 "bdev_name": "Malloc0" 00:05:02.603 }, 00:05:02.603 { 00:05:02.603 "nbd_device": "/dev/nbd1", 00:05:02.603 "bdev_name": "Malloc1" 00:05:02.603 } 00:05:02.603 ]' 00:05:02.603 20:22:20 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:02.603 { 00:05:02.604 "nbd_device": "/dev/nbd0", 00:05:02.604 "bdev_name": "Malloc0" 00:05:02.604 }, 00:05:02.604 { 00:05:02.604 "nbd_device": "/dev/nbd1", 00:05:02.604 "bdev_name": "Malloc1" 00:05:02.604 } 00:05:02.604 ]' 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:02.604 /dev/nbd1' 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:02.604 /dev/nbd1' 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@65 -- # count=2 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@95 -- # count=2 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:02.604 256+0 records in 00:05:02.604 256+0 records out 00:05:02.604 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125261 s, 83.7 MB/s 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:02.604 256+0 records in 00:05:02.604 256+0 records out 00:05:02.604 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158431 s, 66.2 MB/s 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:02.604 256+0 records in 00:05:02.604 256+0 records out 00:05:02.604 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230902 s, 45.4 MB/s 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@51 -- # local i 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:02.604 20:22:20 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@41 -- # break 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@45 -- # return 0 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@41 -- # break 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@45 -- # return 0 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.863 20:22:21 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:03.122 20:22:21 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:03.122 20:22:21 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:03.122 20:22:21 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:03.122 20:22:21 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:03.122 20:22:21 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:03.122 20:22:21 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:03.122 20:22:21 -- bdev/nbd_common.sh@65 -- # true 00:05:03.122 20:22:21 -- bdev/nbd_common.sh@65 -- # count=0 00:05:03.122 20:22:21 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:03.122 20:22:21 -- bdev/nbd_common.sh@104 -- # count=0 00:05:03.122 20:22:21 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:03.122 20:22:21 -- bdev/nbd_common.sh@109 -- # return 0 00:05:03.122 20:22:21 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:03.382 20:22:21 -- event/event.sh@35 -- # sleep 3 00:05:03.382 [2024-04-26 20:22:21.692897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:03.642 [2024-04-26 20:22:21.752536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:03.642 [2024-04-26 20:22:21.752542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.642 [2024-04-26 20:22:21.784055] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:03.642 [2024-04-26 20:22:21.784091] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:06.939 20:22:24 -- event/event.sh@23 -- # for i in {0..2} 00:05:06.939 20:22:24 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:06.939 spdk_app_start Round 1 00:05:06.939 20:22:24 -- event/event.sh@25 -- # waitforlisten 3836009 /var/tmp/spdk-nbd.sock 00:05:06.939 20:22:24 -- common/autotest_common.sh@819 -- # '[' -z 3836009 ']' 00:05:06.939 20:22:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:06.939 20:22:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:06.939 20:22:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:06.939 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:06.939 20:22:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:06.939 20:22:24 -- common/autotest_common.sh@10 -- # set +x 00:05:06.939 20:22:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:06.939 20:22:24 -- common/autotest_common.sh@852 -- # return 0 00:05:06.939 20:22:24 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:06.939 Malloc0 00:05:06.939 20:22:24 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:06.939 Malloc1 00:05:06.939 20:22:25 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@12 -- # local i 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:06.939 /dev/nbd0 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:06.939 20:22:25 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:05:06.939 20:22:25 -- common/autotest_common.sh@857 -- # local i 00:05:06.939 20:22:25 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:06.939 20:22:25 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:06.939 20:22:25 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:05:06.939 20:22:25 -- common/autotest_common.sh@861 -- # break 00:05:06.939 20:22:25 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:06.939 20:22:25 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:06.939 20:22:25 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:06.939 1+0 records in 00:05:06.939 1+0 records out 00:05:06.939 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00023916 s, 17.1 MB/s 00:05:06.939 20:22:25 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:06.939 20:22:25 -- common/autotest_common.sh@874 -- # size=4096 00:05:06.939 20:22:25 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:06.939 20:22:25 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:06.939 20:22:25 -- common/autotest_common.sh@877 -- # return 0 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:06.939 20:22:25 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:07.200 /dev/nbd1 00:05:07.200 20:22:25 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:07.200 20:22:25 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:07.200 20:22:25 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:05:07.200 20:22:25 -- common/autotest_common.sh@857 -- # local i 00:05:07.200 20:22:25 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:07.200 20:22:25 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:07.200 20:22:25 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:05:07.200 20:22:25 -- common/autotest_common.sh@861 -- # break 00:05:07.200 20:22:25 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:07.200 20:22:25 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:07.200 20:22:25 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:07.200 1+0 records in 00:05:07.200 1+0 records out 00:05:07.200 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000271195 s, 15.1 MB/s 00:05:07.200 20:22:25 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:07.200 20:22:25 -- common/autotest_common.sh@874 -- # size=4096 00:05:07.200 20:22:25 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:07.200 20:22:25 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:07.200 20:22:25 -- common/autotest_common.sh@877 -- # return 0 00:05:07.200 20:22:25 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:07.200 20:22:25 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:07.200 20:22:25 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:07.200 20:22:25 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:07.200 20:22:25 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:07.200 20:22:25 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:07.200 { 00:05:07.200 "nbd_device": "/dev/nbd0", 00:05:07.200 "bdev_name": "Malloc0" 00:05:07.201 }, 00:05:07.201 { 00:05:07.201 "nbd_device": "/dev/nbd1", 00:05:07.201 "bdev_name": "Malloc1" 00:05:07.201 } 00:05:07.201 ]' 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:07.462 { 00:05:07.462 "nbd_device": "/dev/nbd0", 00:05:07.462 "bdev_name": "Malloc0" 00:05:07.462 }, 00:05:07.462 { 00:05:07.462 "nbd_device": "/dev/nbd1", 00:05:07.462 "bdev_name": "Malloc1" 00:05:07.462 } 00:05:07.462 ]' 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:07.462 /dev/nbd1' 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:07.462 /dev/nbd1' 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@65 -- # count=2 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@95 -- # count=2 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:07.462 256+0 records in 00:05:07.462 256+0 records out 00:05:07.462 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012485 s, 84.0 MB/s 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:07.462 256+0 records in 00:05:07.462 256+0 records out 00:05:07.462 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178596 s, 58.7 MB/s 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:07.462 256+0 records in 00:05:07.462 256+0 records out 00:05:07.462 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171278 s, 61.2 MB/s 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@51 -- # local i 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:07.462 20:22:25 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@41 -- # break 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@45 -- # return 0 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@41 -- # break 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@45 -- # return 0 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:07.724 20:22:25 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:07.986 20:22:26 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:07.986 20:22:26 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:07.986 20:22:26 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:07.986 20:22:26 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:07.986 20:22:26 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:07.986 20:22:26 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:07.986 20:22:26 -- bdev/nbd_common.sh@65 -- # true 00:05:07.986 20:22:26 -- bdev/nbd_common.sh@65 -- # count=0 00:05:07.986 20:22:26 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:07.986 20:22:26 -- bdev/nbd_common.sh@104 -- # count=0 00:05:07.986 20:22:26 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:07.986 20:22:26 -- bdev/nbd_common.sh@109 -- # return 0 00:05:07.986 20:22:26 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:08.246 20:22:26 -- event/event.sh@35 -- # sleep 3 00:05:08.246 [2024-04-26 20:22:26.490411] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:08.246 [2024-04-26 20:22:26.550380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:08.246 [2024-04-26 20:22:26.550534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:08.246 [2024-04-26 20:22:26.582089] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:08.246 [2024-04-26 20:22:26.582125] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:11.550 20:22:29 -- event/event.sh@23 -- # for i in {0..2} 00:05:11.550 20:22:29 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:11.550 spdk_app_start Round 2 00:05:11.550 20:22:29 -- event/event.sh@25 -- # waitforlisten 3836009 /var/tmp/spdk-nbd.sock 00:05:11.550 20:22:29 -- common/autotest_common.sh@819 -- # '[' -z 3836009 ']' 00:05:11.550 20:22:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:11.550 20:22:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:11.550 20:22:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:11.550 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:11.550 20:22:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:11.550 20:22:29 -- common/autotest_common.sh@10 -- # set +x 00:05:11.550 20:22:29 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:11.550 20:22:29 -- common/autotest_common.sh@852 -- # return 0 00:05:11.550 20:22:29 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:11.550 Malloc0 00:05:11.550 20:22:29 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:11.550 Malloc1 00:05:11.550 20:22:29 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@12 -- # local i 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:11.550 20:22:29 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:11.812 /dev/nbd0 00:05:11.812 20:22:29 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:11.812 20:22:30 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:11.812 20:22:30 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:05:11.812 20:22:30 -- common/autotest_common.sh@857 -- # local i 00:05:11.812 20:22:30 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:11.812 20:22:30 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:11.812 20:22:30 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:05:11.812 20:22:30 -- common/autotest_common.sh@861 -- # break 00:05:11.812 20:22:30 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:11.812 20:22:30 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:11.812 20:22:30 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:11.812 1+0 records in 00:05:11.812 1+0 records out 00:05:11.812 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000282131 s, 14.5 MB/s 00:05:11.812 20:22:30 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:11.812 20:22:30 -- common/autotest_common.sh@874 -- # size=4096 00:05:11.812 20:22:30 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:11.812 20:22:30 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:11.812 20:22:30 -- common/autotest_common.sh@877 -- # return 0 00:05:11.812 20:22:30 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:11.812 20:22:30 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:11.812 20:22:30 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:12.073 /dev/nbd1 00:05:12.073 20:22:30 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:12.073 20:22:30 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:12.073 20:22:30 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:05:12.073 20:22:30 -- common/autotest_common.sh@857 -- # local i 00:05:12.073 20:22:30 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:12.073 20:22:30 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:12.073 20:22:30 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:05:12.073 20:22:30 -- common/autotest_common.sh@861 -- # break 00:05:12.073 20:22:30 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:12.073 20:22:30 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:12.073 20:22:30 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:12.073 1+0 records in 00:05:12.073 1+0 records out 00:05:12.073 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000278337 s, 14.7 MB/s 00:05:12.073 20:22:30 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:12.073 20:22:30 -- common/autotest_common.sh@874 -- # size=4096 00:05:12.073 20:22:30 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:12.073 20:22:30 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:12.073 20:22:30 -- common/autotest_common.sh@877 -- # return 0 00:05:12.073 20:22:30 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:12.073 20:22:30 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:12.073 20:22:30 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:12.073 20:22:30 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:12.073 20:22:30 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:12.073 20:22:30 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:12.073 { 00:05:12.073 "nbd_device": "/dev/nbd0", 00:05:12.073 "bdev_name": "Malloc0" 00:05:12.073 }, 00:05:12.073 { 00:05:12.073 "nbd_device": "/dev/nbd1", 00:05:12.073 "bdev_name": "Malloc1" 00:05:12.073 } 00:05:12.073 ]' 00:05:12.073 20:22:30 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:12.073 { 00:05:12.073 "nbd_device": "/dev/nbd0", 00:05:12.073 "bdev_name": "Malloc0" 00:05:12.073 }, 00:05:12.073 { 00:05:12.073 "nbd_device": "/dev/nbd1", 00:05:12.073 "bdev_name": "Malloc1" 00:05:12.073 } 00:05:12.073 ]' 00:05:12.073 20:22:30 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:12.073 20:22:30 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:12.073 /dev/nbd1' 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:12.334 /dev/nbd1' 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@65 -- # count=2 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@95 -- # count=2 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:12.334 256+0 records in 00:05:12.334 256+0 records out 00:05:12.334 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118998 s, 88.1 MB/s 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:12.334 256+0 records in 00:05:12.334 256+0 records out 00:05:12.334 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160249 s, 65.4 MB/s 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:12.334 256+0 records in 00:05:12.334 256+0 records out 00:05:12.334 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200054 s, 52.4 MB/s 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@51 -- # local i 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@41 -- # break 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@45 -- # return 0 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:12.334 20:22:30 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:12.595 20:22:30 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:12.595 20:22:30 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:12.595 20:22:30 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:12.595 20:22:30 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:12.595 20:22:30 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:12.595 20:22:30 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:12.595 20:22:30 -- bdev/nbd_common.sh@41 -- # break 00:05:12.595 20:22:30 -- bdev/nbd_common.sh@45 -- # return 0 00:05:12.595 20:22:30 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:12.595 20:22:30 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:12.595 20:22:30 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:12.857 20:22:30 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:12.857 20:22:30 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:12.857 20:22:30 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:12.857 20:22:31 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:12.857 20:22:31 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:12.857 20:22:31 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:12.857 20:22:31 -- bdev/nbd_common.sh@65 -- # true 00:05:12.857 20:22:31 -- bdev/nbd_common.sh@65 -- # count=0 00:05:12.857 20:22:31 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:12.857 20:22:31 -- bdev/nbd_common.sh@104 -- # count=0 00:05:12.857 20:22:31 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:12.857 20:22:31 -- bdev/nbd_common.sh@109 -- # return 0 00:05:12.857 20:22:31 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:12.857 20:22:31 -- event/event.sh@35 -- # sleep 3 00:05:13.118 [2024-04-26 20:22:31.326673] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:13.118 [2024-04-26 20:22:31.386179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:13.118 [2024-04-26 20:22:31.386185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.118 [2024-04-26 20:22:31.417627] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:13.118 [2024-04-26 20:22:31.417661] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:16.458 20:22:34 -- event/event.sh@38 -- # waitforlisten 3836009 /var/tmp/spdk-nbd.sock 00:05:16.458 20:22:34 -- common/autotest_common.sh@819 -- # '[' -z 3836009 ']' 00:05:16.458 20:22:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:16.459 20:22:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:16.459 20:22:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:16.459 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:16.459 20:22:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:16.459 20:22:34 -- common/autotest_common.sh@10 -- # set +x 00:05:16.459 20:22:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:16.459 20:22:34 -- common/autotest_common.sh@852 -- # return 0 00:05:16.459 20:22:34 -- event/event.sh@39 -- # killprocess 3836009 00:05:16.459 20:22:34 -- common/autotest_common.sh@926 -- # '[' -z 3836009 ']' 00:05:16.459 20:22:34 -- common/autotest_common.sh@930 -- # kill -0 3836009 00:05:16.459 20:22:34 -- common/autotest_common.sh@931 -- # uname 00:05:16.459 20:22:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:16.459 20:22:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3836009 00:05:16.459 20:22:34 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:16.459 20:22:34 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:16.459 20:22:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3836009' 00:05:16.459 killing process with pid 3836009 00:05:16.459 20:22:34 -- common/autotest_common.sh@945 -- # kill 3836009 00:05:16.459 20:22:34 -- common/autotest_common.sh@950 -- # wait 3836009 00:05:16.459 spdk_app_start is called in Round 0. 00:05:16.459 Shutdown signal received, stop current app iteration 00:05:16.459 Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 reinitialization... 00:05:16.459 spdk_app_start is called in Round 1. 00:05:16.459 Shutdown signal received, stop current app iteration 00:05:16.459 Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 reinitialization... 00:05:16.459 spdk_app_start is called in Round 2. 00:05:16.459 Shutdown signal received, stop current app iteration 00:05:16.459 Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 reinitialization... 00:05:16.459 spdk_app_start is called in Round 3. 00:05:16.459 Shutdown signal received, stop current app iteration 00:05:16.459 20:22:34 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:16.459 20:22:34 -- event/event.sh@42 -- # return 0 00:05:16.459 00:05:16.459 real 0m15.498s 00:05:16.459 user 0m33.447s 00:05:16.459 sys 0m2.076s 00:05:16.459 20:22:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:16.459 20:22:34 -- common/autotest_common.sh@10 -- # set +x 00:05:16.459 ************************************ 00:05:16.459 END TEST app_repeat 00:05:16.459 ************************************ 00:05:16.459 20:22:34 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:16.459 20:22:34 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:16.459 20:22:34 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:16.459 20:22:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:16.459 20:22:34 -- common/autotest_common.sh@10 -- # set +x 00:05:16.459 ************************************ 00:05:16.459 START TEST cpu_locks 00:05:16.459 ************************************ 00:05:16.459 20:22:34 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:16.459 * Looking for test storage... 00:05:16.459 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:16.459 20:22:34 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:16.459 20:22:34 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:16.459 20:22:34 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:16.459 20:22:34 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:16.459 20:22:34 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:16.459 20:22:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:16.459 20:22:34 -- common/autotest_common.sh@10 -- # set +x 00:05:16.459 ************************************ 00:05:16.459 START TEST default_locks 00:05:16.459 ************************************ 00:05:16.459 20:22:34 -- common/autotest_common.sh@1104 -- # default_locks 00:05:16.459 20:22:34 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3839317 00:05:16.459 20:22:34 -- event/cpu_locks.sh@47 -- # waitforlisten 3839317 00:05:16.459 20:22:34 -- common/autotest_common.sh@819 -- # '[' -z 3839317 ']' 00:05:16.459 20:22:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:16.459 20:22:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:16.459 20:22:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:16.459 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:16.459 20:22:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:16.459 20:22:34 -- common/autotest_common.sh@10 -- # set +x 00:05:16.459 20:22:34 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:16.459 [2024-04-26 20:22:34.683105] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:16.459 [2024-04-26 20:22:34.683165] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3839317 ] 00:05:16.459 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.459 [2024-04-26 20:22:34.742045] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:16.720 [2024-04-26 20:22:34.805553] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:16.720 [2024-04-26 20:22:34.805679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:17.292 20:22:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:17.292 20:22:35 -- common/autotest_common.sh@852 -- # return 0 00:05:17.292 20:22:35 -- event/cpu_locks.sh@49 -- # locks_exist 3839317 00:05:17.292 20:22:35 -- event/cpu_locks.sh@22 -- # lslocks -p 3839317 00:05:17.292 20:22:35 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:17.292 lslocks: write error 00:05:17.292 20:22:35 -- event/cpu_locks.sh@50 -- # killprocess 3839317 00:05:17.292 20:22:35 -- common/autotest_common.sh@926 -- # '[' -z 3839317 ']' 00:05:17.292 20:22:35 -- common/autotest_common.sh@930 -- # kill -0 3839317 00:05:17.292 20:22:35 -- common/autotest_common.sh@931 -- # uname 00:05:17.292 20:22:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:17.292 20:22:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3839317 00:05:17.292 20:22:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:17.292 20:22:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:17.292 20:22:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3839317' 00:05:17.292 killing process with pid 3839317 00:05:17.292 20:22:35 -- common/autotest_common.sh@945 -- # kill 3839317 00:05:17.292 20:22:35 -- common/autotest_common.sh@950 -- # wait 3839317 00:05:17.553 20:22:35 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3839317 00:05:17.553 20:22:35 -- common/autotest_common.sh@640 -- # local es=0 00:05:17.553 20:22:35 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 3839317 00:05:17.553 20:22:35 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:05:17.553 20:22:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:17.553 20:22:35 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:05:17.553 20:22:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:17.553 20:22:35 -- common/autotest_common.sh@643 -- # waitforlisten 3839317 00:05:17.553 20:22:35 -- common/autotest_common.sh@819 -- # '[' -z 3839317 ']' 00:05:17.553 20:22:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:17.553 20:22:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:17.553 20:22:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:17.553 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:17.553 20:22:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:17.553 20:22:35 -- common/autotest_common.sh@10 -- # set +x 00:05:17.553 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (3839317) - No such process 00:05:17.553 ERROR: process (pid: 3839317) is no longer running 00:05:17.553 20:22:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:17.553 20:22:35 -- common/autotest_common.sh@852 -- # return 1 00:05:17.553 20:22:35 -- common/autotest_common.sh@643 -- # es=1 00:05:17.553 20:22:35 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:17.553 20:22:35 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:17.553 20:22:35 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:17.553 20:22:35 -- event/cpu_locks.sh@54 -- # no_locks 00:05:17.553 20:22:35 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:17.553 20:22:35 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:17.553 20:22:35 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:17.553 00:05:17.553 real 0m1.171s 00:05:17.553 user 0m1.254s 00:05:17.553 sys 0m0.338s 00:05:17.553 20:22:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:17.553 20:22:35 -- common/autotest_common.sh@10 -- # set +x 00:05:17.553 ************************************ 00:05:17.553 END TEST default_locks 00:05:17.553 ************************************ 00:05:17.553 20:22:35 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:17.553 20:22:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:17.553 20:22:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:17.553 20:22:35 -- common/autotest_common.sh@10 -- # set +x 00:05:17.553 ************************************ 00:05:17.553 START TEST default_locks_via_rpc 00:05:17.553 ************************************ 00:05:17.553 20:22:35 -- common/autotest_common.sh@1104 -- # default_locks_via_rpc 00:05:17.553 20:22:35 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3839663 00:05:17.553 20:22:35 -- event/cpu_locks.sh@63 -- # waitforlisten 3839663 00:05:17.553 20:22:35 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:17.553 20:22:35 -- common/autotest_common.sh@819 -- # '[' -z 3839663 ']' 00:05:17.553 20:22:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:17.553 20:22:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:17.553 20:22:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:17.553 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:17.553 20:22:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:17.553 20:22:35 -- common/autotest_common.sh@10 -- # set +x 00:05:17.814 [2024-04-26 20:22:35.900258] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:17.814 [2024-04-26 20:22:35.900327] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3839663 ] 00:05:17.814 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.814 [2024-04-26 20:22:35.959456] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:17.814 [2024-04-26 20:22:36.019246] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:17.814 [2024-04-26 20:22:36.019387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.386 20:22:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:18.386 20:22:36 -- common/autotest_common.sh@852 -- # return 0 00:05:18.386 20:22:36 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:18.386 20:22:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:18.386 20:22:36 -- common/autotest_common.sh@10 -- # set +x 00:05:18.386 20:22:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:18.386 20:22:36 -- event/cpu_locks.sh@67 -- # no_locks 00:05:18.386 20:22:36 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:18.386 20:22:36 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:18.386 20:22:36 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:18.386 20:22:36 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:18.386 20:22:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:18.386 20:22:36 -- common/autotest_common.sh@10 -- # set +x 00:05:18.386 20:22:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:18.386 20:22:36 -- event/cpu_locks.sh@71 -- # locks_exist 3839663 00:05:18.386 20:22:36 -- event/cpu_locks.sh@22 -- # lslocks -p 3839663 00:05:18.386 20:22:36 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:18.957 20:22:37 -- event/cpu_locks.sh@73 -- # killprocess 3839663 00:05:18.957 20:22:37 -- common/autotest_common.sh@926 -- # '[' -z 3839663 ']' 00:05:18.957 20:22:37 -- common/autotest_common.sh@930 -- # kill -0 3839663 00:05:18.957 20:22:37 -- common/autotest_common.sh@931 -- # uname 00:05:18.957 20:22:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:18.957 20:22:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3839663 00:05:18.957 20:22:37 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:18.957 20:22:37 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:18.957 20:22:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3839663' 00:05:18.957 killing process with pid 3839663 00:05:18.957 20:22:37 -- common/autotest_common.sh@945 -- # kill 3839663 00:05:18.957 20:22:37 -- common/autotest_common.sh@950 -- # wait 3839663 00:05:19.218 00:05:19.218 real 0m1.637s 00:05:19.218 user 0m1.757s 00:05:19.218 sys 0m0.521s 00:05:19.218 20:22:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:19.218 20:22:37 -- common/autotest_common.sh@10 -- # set +x 00:05:19.218 ************************************ 00:05:19.218 END TEST default_locks_via_rpc 00:05:19.218 ************************************ 00:05:19.218 20:22:37 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:19.218 20:22:37 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:19.218 20:22:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:19.218 20:22:37 -- common/autotest_common.sh@10 -- # set +x 00:05:19.218 ************************************ 00:05:19.219 START TEST non_locking_app_on_locked_coremask 00:05:19.219 ************************************ 00:05:19.219 20:22:37 -- common/autotest_common.sh@1104 -- # non_locking_app_on_locked_coremask 00:05:19.219 20:22:37 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3840025 00:05:19.219 20:22:37 -- event/cpu_locks.sh@81 -- # waitforlisten 3840025 /var/tmp/spdk.sock 00:05:19.219 20:22:37 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:19.219 20:22:37 -- common/autotest_common.sh@819 -- # '[' -z 3840025 ']' 00:05:19.219 20:22:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:19.219 20:22:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:19.219 20:22:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:19.219 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:19.219 20:22:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:19.219 20:22:37 -- common/autotest_common.sh@10 -- # set +x 00:05:19.480 [2024-04-26 20:22:37.583946] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:19.480 [2024-04-26 20:22:37.584007] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3840025 ] 00:05:19.480 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.480 [2024-04-26 20:22:37.643378] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.480 [2024-04-26 20:22:37.709337] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:19.480 [2024-04-26 20:22:37.709459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.061 20:22:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:20.061 20:22:38 -- common/autotest_common.sh@852 -- # return 0 00:05:20.062 20:22:38 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:20.062 20:22:38 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3840245 00:05:20.062 20:22:38 -- event/cpu_locks.sh@85 -- # waitforlisten 3840245 /var/tmp/spdk2.sock 00:05:20.062 20:22:38 -- common/autotest_common.sh@819 -- # '[' -z 3840245 ']' 00:05:20.062 20:22:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:20.062 20:22:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:20.062 20:22:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:20.062 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:20.062 20:22:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:20.062 20:22:38 -- common/autotest_common.sh@10 -- # set +x 00:05:20.062 [2024-04-26 20:22:38.365214] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:20.062 [2024-04-26 20:22:38.365263] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3840245 ] 00:05:20.062 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.328 [2024-04-26 20:22:38.453613] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:20.328 [2024-04-26 20:22:38.453641] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:20.328 [2024-04-26 20:22:38.588554] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:20.328 [2024-04-26 20:22:38.588679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.900 20:22:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:20.900 20:22:39 -- common/autotest_common.sh@852 -- # return 0 00:05:20.900 20:22:39 -- event/cpu_locks.sh@87 -- # locks_exist 3840025 00:05:20.900 20:22:39 -- event/cpu_locks.sh@22 -- # lslocks -p 3840025 00:05:20.900 20:22:39 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:21.471 lslocks: write error 00:05:21.471 20:22:39 -- event/cpu_locks.sh@89 -- # killprocess 3840025 00:05:21.471 20:22:39 -- common/autotest_common.sh@926 -- # '[' -z 3840025 ']' 00:05:21.471 20:22:39 -- common/autotest_common.sh@930 -- # kill -0 3840025 00:05:21.471 20:22:39 -- common/autotest_common.sh@931 -- # uname 00:05:21.471 20:22:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:21.471 20:22:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3840025 00:05:21.471 20:22:39 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:21.471 20:22:39 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:21.471 20:22:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3840025' 00:05:21.471 killing process with pid 3840025 00:05:21.471 20:22:39 -- common/autotest_common.sh@945 -- # kill 3840025 00:05:21.471 20:22:39 -- common/autotest_common.sh@950 -- # wait 3840025 00:05:22.043 20:22:40 -- event/cpu_locks.sh@90 -- # killprocess 3840245 00:05:22.043 20:22:40 -- common/autotest_common.sh@926 -- # '[' -z 3840245 ']' 00:05:22.043 20:22:40 -- common/autotest_common.sh@930 -- # kill -0 3840245 00:05:22.043 20:22:40 -- common/autotest_common.sh@931 -- # uname 00:05:22.043 20:22:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:22.043 20:22:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3840245 00:05:22.043 20:22:40 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:22.043 20:22:40 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:22.043 20:22:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3840245' 00:05:22.043 killing process with pid 3840245 00:05:22.043 20:22:40 -- common/autotest_common.sh@945 -- # kill 3840245 00:05:22.043 20:22:40 -- common/autotest_common.sh@950 -- # wait 3840245 00:05:22.303 00:05:22.303 real 0m2.935s 00:05:22.303 user 0m3.183s 00:05:22.303 sys 0m0.875s 00:05:22.303 20:22:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:22.303 20:22:40 -- common/autotest_common.sh@10 -- # set +x 00:05:22.303 ************************************ 00:05:22.304 END TEST non_locking_app_on_locked_coremask 00:05:22.304 ************************************ 00:05:22.304 20:22:40 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:22.304 20:22:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:22.304 20:22:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:22.304 20:22:40 -- common/autotest_common.sh@10 -- # set +x 00:05:22.304 ************************************ 00:05:22.304 START TEST locking_app_on_unlocked_coremask 00:05:22.304 ************************************ 00:05:22.304 20:22:40 -- common/autotest_common.sh@1104 -- # locking_app_on_unlocked_coremask 00:05:22.304 20:22:40 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3840739 00:05:22.304 20:22:40 -- event/cpu_locks.sh@99 -- # waitforlisten 3840739 /var/tmp/spdk.sock 00:05:22.304 20:22:40 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:22.304 20:22:40 -- common/autotest_common.sh@819 -- # '[' -z 3840739 ']' 00:05:22.304 20:22:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:22.304 20:22:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:22.304 20:22:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:22.304 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:22.304 20:22:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:22.304 20:22:40 -- common/autotest_common.sh@10 -- # set +x 00:05:22.304 [2024-04-26 20:22:40.558034] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:22.304 [2024-04-26 20:22:40.558093] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3840739 ] 00:05:22.304 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.304 [2024-04-26 20:22:40.616624] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:22.304 [2024-04-26 20:22:40.616654] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.565 [2024-04-26 20:22:40.680568] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:22.565 [2024-04-26 20:22:40.680692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.136 20:22:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:23.136 20:22:41 -- common/autotest_common.sh@852 -- # return 0 00:05:23.136 20:22:41 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3840781 00:05:23.136 20:22:41 -- event/cpu_locks.sh@103 -- # waitforlisten 3840781 /var/tmp/spdk2.sock 00:05:23.136 20:22:41 -- common/autotest_common.sh@819 -- # '[' -z 3840781 ']' 00:05:23.136 20:22:41 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:23.136 20:22:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:23.136 20:22:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:23.136 20:22:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:23.136 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:23.136 20:22:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:23.136 20:22:41 -- common/autotest_common.sh@10 -- # set +x 00:05:23.136 [2024-04-26 20:22:41.369090] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:23.136 [2024-04-26 20:22:41.369141] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3840781 ] 00:05:23.136 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.136 [2024-04-26 20:22:41.456427] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:23.397 [2024-04-26 20:22:41.583793] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:23.397 [2024-04-26 20:22:41.583916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.969 20:22:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:23.969 20:22:42 -- common/autotest_common.sh@852 -- # return 0 00:05:23.969 20:22:42 -- event/cpu_locks.sh@105 -- # locks_exist 3840781 00:05:23.969 20:22:42 -- event/cpu_locks.sh@22 -- # lslocks -p 3840781 00:05:23.969 20:22:42 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:24.541 lslocks: write error 00:05:24.541 20:22:42 -- event/cpu_locks.sh@107 -- # killprocess 3840739 00:05:24.541 20:22:42 -- common/autotest_common.sh@926 -- # '[' -z 3840739 ']' 00:05:24.541 20:22:42 -- common/autotest_common.sh@930 -- # kill -0 3840739 00:05:24.541 20:22:42 -- common/autotest_common.sh@931 -- # uname 00:05:24.541 20:22:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:24.541 20:22:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3840739 00:05:24.541 20:22:42 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:24.541 20:22:42 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:24.541 20:22:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3840739' 00:05:24.541 killing process with pid 3840739 00:05:24.541 20:22:42 -- common/autotest_common.sh@945 -- # kill 3840739 00:05:24.541 20:22:42 -- common/autotest_common.sh@950 -- # wait 3840739 00:05:25.112 20:22:43 -- event/cpu_locks.sh@108 -- # killprocess 3840781 00:05:25.112 20:22:43 -- common/autotest_common.sh@926 -- # '[' -z 3840781 ']' 00:05:25.112 20:22:43 -- common/autotest_common.sh@930 -- # kill -0 3840781 00:05:25.112 20:22:43 -- common/autotest_common.sh@931 -- # uname 00:05:25.112 20:22:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:25.112 20:22:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3840781 00:05:25.112 20:22:43 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:25.112 20:22:43 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:25.112 20:22:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3840781' 00:05:25.112 killing process with pid 3840781 00:05:25.112 20:22:43 -- common/autotest_common.sh@945 -- # kill 3840781 00:05:25.112 20:22:43 -- common/autotest_common.sh@950 -- # wait 3840781 00:05:25.112 00:05:25.112 real 0m2.937s 00:05:25.112 user 0m3.187s 00:05:25.112 sys 0m0.886s 00:05:25.112 20:22:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:25.112 20:22:43 -- common/autotest_common.sh@10 -- # set +x 00:05:25.112 ************************************ 00:05:25.112 END TEST locking_app_on_unlocked_coremask 00:05:25.112 ************************************ 00:05:25.372 20:22:43 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:25.372 20:22:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:25.372 20:22:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:25.372 20:22:43 -- common/autotest_common.sh@10 -- # set +x 00:05:25.372 ************************************ 00:05:25.372 START TEST locking_app_on_locked_coremask 00:05:25.372 ************************************ 00:05:25.372 20:22:43 -- common/autotest_common.sh@1104 -- # locking_app_on_locked_coremask 00:05:25.372 20:22:43 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3841441 00:05:25.372 20:22:43 -- event/cpu_locks.sh@116 -- # waitforlisten 3841441 /var/tmp/spdk.sock 00:05:25.372 20:22:43 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:25.372 20:22:43 -- common/autotest_common.sh@819 -- # '[' -z 3841441 ']' 00:05:25.372 20:22:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:25.372 20:22:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:25.372 20:22:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:25.372 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:25.372 20:22:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:25.372 20:22:43 -- common/autotest_common.sh@10 -- # set +x 00:05:25.372 [2024-04-26 20:22:43.549907] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:25.372 [2024-04-26 20:22:43.549974] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3841441 ] 00:05:25.372 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.372 [2024-04-26 20:22:43.609898] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.372 [2024-04-26 20:22:43.677108] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:25.372 [2024-04-26 20:22:43.677243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.315 20:22:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:26.315 20:22:44 -- common/autotest_common.sh@852 -- # return 0 00:05:26.315 20:22:44 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3841468 00:05:26.315 20:22:44 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3841468 /var/tmp/spdk2.sock 00:05:26.315 20:22:44 -- common/autotest_common.sh@640 -- # local es=0 00:05:26.315 20:22:44 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:26.315 20:22:44 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 3841468 /var/tmp/spdk2.sock 00:05:26.315 20:22:44 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:05:26.315 20:22:44 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:26.315 20:22:44 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:05:26.315 20:22:44 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:26.315 20:22:44 -- common/autotest_common.sh@643 -- # waitforlisten 3841468 /var/tmp/spdk2.sock 00:05:26.315 20:22:44 -- common/autotest_common.sh@819 -- # '[' -z 3841468 ']' 00:05:26.315 20:22:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:26.315 20:22:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:26.315 20:22:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:26.315 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:26.315 20:22:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:26.315 20:22:44 -- common/autotest_common.sh@10 -- # set +x 00:05:26.315 [2024-04-26 20:22:44.348459] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:26.315 [2024-04-26 20:22:44.348509] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3841468 ] 00:05:26.315 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.315 [2024-04-26 20:22:44.436151] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3841441 has claimed it. 00:05:26.315 [2024-04-26 20:22:44.436187] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:26.889 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (3841468) - No such process 00:05:26.889 ERROR: process (pid: 3841468) is no longer running 00:05:26.889 20:22:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:26.889 20:22:44 -- common/autotest_common.sh@852 -- # return 1 00:05:26.889 20:22:44 -- common/autotest_common.sh@643 -- # es=1 00:05:26.889 20:22:44 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:26.889 20:22:44 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:26.889 20:22:44 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:26.889 20:22:44 -- event/cpu_locks.sh@122 -- # locks_exist 3841441 00:05:26.889 20:22:44 -- event/cpu_locks.sh@22 -- # lslocks -p 3841441 00:05:26.889 20:22:44 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:27.171 lslocks: write error 00:05:27.171 20:22:45 -- event/cpu_locks.sh@124 -- # killprocess 3841441 00:05:27.171 20:22:45 -- common/autotest_common.sh@926 -- # '[' -z 3841441 ']' 00:05:27.171 20:22:45 -- common/autotest_common.sh@930 -- # kill -0 3841441 00:05:27.171 20:22:45 -- common/autotest_common.sh@931 -- # uname 00:05:27.171 20:22:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:27.171 20:22:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3841441 00:05:27.171 20:22:45 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:27.171 20:22:45 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:27.171 20:22:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3841441' 00:05:27.171 killing process with pid 3841441 00:05:27.171 20:22:45 -- common/autotest_common.sh@945 -- # kill 3841441 00:05:27.171 20:22:45 -- common/autotest_common.sh@950 -- # wait 3841441 00:05:27.482 00:05:27.482 real 0m2.098s 00:05:27.482 user 0m2.350s 00:05:27.482 sys 0m0.542s 00:05:27.482 20:22:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:27.482 20:22:45 -- common/autotest_common.sh@10 -- # set +x 00:05:27.482 ************************************ 00:05:27.482 END TEST locking_app_on_locked_coremask 00:05:27.482 ************************************ 00:05:27.482 20:22:45 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:27.482 20:22:45 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:27.482 20:22:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:27.482 20:22:45 -- common/autotest_common.sh@10 -- # set +x 00:05:27.482 ************************************ 00:05:27.482 START TEST locking_overlapped_coremask 00:05:27.482 ************************************ 00:05:27.482 20:22:45 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask 00:05:27.482 20:22:45 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3841831 00:05:27.482 20:22:45 -- event/cpu_locks.sh@133 -- # waitforlisten 3841831 /var/tmp/spdk.sock 00:05:27.482 20:22:45 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:27.482 20:22:45 -- common/autotest_common.sh@819 -- # '[' -z 3841831 ']' 00:05:27.482 20:22:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:27.482 20:22:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:27.482 20:22:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:27.482 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:27.482 20:22:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:27.482 20:22:45 -- common/autotest_common.sh@10 -- # set +x 00:05:27.483 [2024-04-26 20:22:45.681651] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:27.483 [2024-04-26 20:22:45.681712] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3841831 ] 00:05:27.483 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.483 [2024-04-26 20:22:45.741917] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:27.483 [2024-04-26 20:22:45.807751] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:27.483 [2024-04-26 20:22:45.807973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:27.483 [2024-04-26 20:22:45.808081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:27.483 [2024-04-26 20:22:45.808084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.425 20:22:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:28.425 20:22:46 -- common/autotest_common.sh@852 -- # return 0 00:05:28.425 20:22:46 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3841970 00:05:28.425 20:22:46 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3841970 /var/tmp/spdk2.sock 00:05:28.425 20:22:46 -- common/autotest_common.sh@640 -- # local es=0 00:05:28.425 20:22:46 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:28.425 20:22:46 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 3841970 /var/tmp/spdk2.sock 00:05:28.425 20:22:46 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:05:28.425 20:22:46 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:28.425 20:22:46 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:05:28.425 20:22:46 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:28.425 20:22:46 -- common/autotest_common.sh@643 -- # waitforlisten 3841970 /var/tmp/spdk2.sock 00:05:28.425 20:22:46 -- common/autotest_common.sh@819 -- # '[' -z 3841970 ']' 00:05:28.425 20:22:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:28.425 20:22:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:28.425 20:22:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:28.425 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:28.425 20:22:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:28.425 20:22:46 -- common/autotest_common.sh@10 -- # set +x 00:05:28.425 [2024-04-26 20:22:46.494122] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:28.425 [2024-04-26 20:22:46.494176] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3841970 ] 00:05:28.425 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.425 [2024-04-26 20:22:46.565155] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3841831 has claimed it. 00:05:28.425 [2024-04-26 20:22:46.565189] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:28.997 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (3841970) - No such process 00:05:28.997 ERROR: process (pid: 3841970) is no longer running 00:05:28.997 20:22:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:28.997 20:22:47 -- common/autotest_common.sh@852 -- # return 1 00:05:28.997 20:22:47 -- common/autotest_common.sh@643 -- # es=1 00:05:28.997 20:22:47 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:28.997 20:22:47 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:28.997 20:22:47 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:28.997 20:22:47 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:28.997 20:22:47 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:28.997 20:22:47 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:28.997 20:22:47 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:28.997 20:22:47 -- event/cpu_locks.sh@141 -- # killprocess 3841831 00:05:28.997 20:22:47 -- common/autotest_common.sh@926 -- # '[' -z 3841831 ']' 00:05:28.997 20:22:47 -- common/autotest_common.sh@930 -- # kill -0 3841831 00:05:28.997 20:22:47 -- common/autotest_common.sh@931 -- # uname 00:05:28.997 20:22:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:28.997 20:22:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3841831 00:05:28.997 20:22:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:28.997 20:22:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:28.997 20:22:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3841831' 00:05:28.997 killing process with pid 3841831 00:05:28.997 20:22:47 -- common/autotest_common.sh@945 -- # kill 3841831 00:05:28.997 20:22:47 -- common/autotest_common.sh@950 -- # wait 3841831 00:05:29.258 00:05:29.258 real 0m1.726s 00:05:29.258 user 0m4.901s 00:05:29.258 sys 0m0.357s 00:05:29.258 20:22:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:29.258 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:05:29.258 ************************************ 00:05:29.258 END TEST locking_overlapped_coremask 00:05:29.258 ************************************ 00:05:29.258 20:22:47 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:29.258 20:22:47 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:29.258 20:22:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:29.259 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:05:29.259 ************************************ 00:05:29.259 START TEST locking_overlapped_coremask_via_rpc 00:05:29.259 ************************************ 00:05:29.259 20:22:47 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask_via_rpc 00:05:29.259 20:22:47 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3842215 00:05:29.259 20:22:47 -- event/cpu_locks.sh@149 -- # waitforlisten 3842215 /var/tmp/spdk.sock 00:05:29.259 20:22:47 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:29.259 20:22:47 -- common/autotest_common.sh@819 -- # '[' -z 3842215 ']' 00:05:29.259 20:22:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:29.259 20:22:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:29.259 20:22:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:29.259 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:29.259 20:22:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:29.259 20:22:47 -- common/autotest_common.sh@10 -- # set +x 00:05:29.259 [2024-04-26 20:22:47.453422] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:29.259 [2024-04-26 20:22:47.453480] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3842215 ] 00:05:29.259 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.259 [2024-04-26 20:22:47.512636] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:29.259 [2024-04-26 20:22:47.512669] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:29.259 [2024-04-26 20:22:47.574227] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:29.259 [2024-04-26 20:22:47.574479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:29.259 [2024-04-26 20:22:47.574671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:29.259 [2024-04-26 20:22:47.574675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.202 20:22:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:30.202 20:22:48 -- common/autotest_common.sh@852 -- # return 0 00:05:30.202 20:22:48 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3842405 00:05:30.202 20:22:48 -- event/cpu_locks.sh@153 -- # waitforlisten 3842405 /var/tmp/spdk2.sock 00:05:30.202 20:22:48 -- common/autotest_common.sh@819 -- # '[' -z 3842405 ']' 00:05:30.202 20:22:48 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:30.202 20:22:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:30.202 20:22:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:30.202 20:22:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:30.202 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:30.202 20:22:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:30.202 20:22:48 -- common/autotest_common.sh@10 -- # set +x 00:05:30.202 [2024-04-26 20:22:48.255919] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:30.202 [2024-04-26 20:22:48.255972] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3842405 ] 00:05:30.202 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.202 [2024-04-26 20:22:48.327928] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:30.202 [2024-04-26 20:22:48.327952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:30.202 [2024-04-26 20:22:48.432779] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:30.202 [2024-04-26 20:22:48.432976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:30.202 [2024-04-26 20:22:48.436399] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:30.202 [2024-04-26 20:22:48.436402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:30.774 20:22:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:30.774 20:22:49 -- common/autotest_common.sh@852 -- # return 0 00:05:30.774 20:22:49 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:30.774 20:22:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:30.774 20:22:49 -- common/autotest_common.sh@10 -- # set +x 00:05:30.774 20:22:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:30.774 20:22:49 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:30.774 20:22:49 -- common/autotest_common.sh@640 -- # local es=0 00:05:30.774 20:22:49 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:30.774 20:22:49 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:05:30.774 20:22:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:30.774 20:22:49 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:05:30.774 20:22:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:30.774 20:22:49 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:30.774 20:22:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:30.774 20:22:49 -- common/autotest_common.sh@10 -- # set +x 00:05:30.774 [2024-04-26 20:22:49.036332] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3842215 has claimed it. 00:05:30.774 request: 00:05:30.774 { 00:05:30.774 "method": "framework_enable_cpumask_locks", 00:05:30.774 "req_id": 1 00:05:30.774 } 00:05:30.774 Got JSON-RPC error response 00:05:30.774 response: 00:05:30.774 { 00:05:30.774 "code": -32603, 00:05:30.774 "message": "Failed to claim CPU core: 2" 00:05:30.774 } 00:05:30.774 20:22:49 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:05:30.774 20:22:49 -- common/autotest_common.sh@643 -- # es=1 00:05:30.774 20:22:49 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:30.774 20:22:49 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:30.774 20:22:49 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:30.774 20:22:49 -- event/cpu_locks.sh@158 -- # waitforlisten 3842215 /var/tmp/spdk.sock 00:05:30.774 20:22:49 -- common/autotest_common.sh@819 -- # '[' -z 3842215 ']' 00:05:30.774 20:22:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:30.774 20:22:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:30.774 20:22:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:30.774 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:30.774 20:22:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:30.774 20:22:49 -- common/autotest_common.sh@10 -- # set +x 00:05:31.035 20:22:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:31.035 20:22:49 -- common/autotest_common.sh@852 -- # return 0 00:05:31.035 20:22:49 -- event/cpu_locks.sh@159 -- # waitforlisten 3842405 /var/tmp/spdk2.sock 00:05:31.035 20:22:49 -- common/autotest_common.sh@819 -- # '[' -z 3842405 ']' 00:05:31.035 20:22:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:31.035 20:22:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:31.035 20:22:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:31.035 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:31.035 20:22:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:31.035 20:22:49 -- common/autotest_common.sh@10 -- # set +x 00:05:31.035 20:22:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:31.035 20:22:49 -- common/autotest_common.sh@852 -- # return 0 00:05:31.035 20:22:49 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:31.035 20:22:49 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:31.297 20:22:49 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:31.297 20:22:49 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:31.297 00:05:31.297 real 0m1.976s 00:05:31.297 user 0m0.757s 00:05:31.297 sys 0m0.143s 00:05:31.297 20:22:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:31.297 20:22:49 -- common/autotest_common.sh@10 -- # set +x 00:05:31.297 ************************************ 00:05:31.297 END TEST locking_overlapped_coremask_via_rpc 00:05:31.297 ************************************ 00:05:31.297 20:22:49 -- event/cpu_locks.sh@174 -- # cleanup 00:05:31.297 20:22:49 -- event/cpu_locks.sh@15 -- # [[ -z 3842215 ]] 00:05:31.297 20:22:49 -- event/cpu_locks.sh@15 -- # killprocess 3842215 00:05:31.297 20:22:49 -- common/autotest_common.sh@926 -- # '[' -z 3842215 ']' 00:05:31.297 20:22:49 -- common/autotest_common.sh@930 -- # kill -0 3842215 00:05:31.297 20:22:49 -- common/autotest_common.sh@931 -- # uname 00:05:31.297 20:22:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:31.297 20:22:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3842215 00:05:31.297 20:22:49 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:31.297 20:22:49 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:31.297 20:22:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3842215' 00:05:31.297 killing process with pid 3842215 00:05:31.297 20:22:49 -- common/autotest_common.sh@945 -- # kill 3842215 00:05:31.297 20:22:49 -- common/autotest_common.sh@950 -- # wait 3842215 00:05:31.559 20:22:49 -- event/cpu_locks.sh@16 -- # [[ -z 3842405 ]] 00:05:31.559 20:22:49 -- event/cpu_locks.sh@16 -- # killprocess 3842405 00:05:31.559 20:22:49 -- common/autotest_common.sh@926 -- # '[' -z 3842405 ']' 00:05:31.559 20:22:49 -- common/autotest_common.sh@930 -- # kill -0 3842405 00:05:31.559 20:22:49 -- common/autotest_common.sh@931 -- # uname 00:05:31.559 20:22:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:31.559 20:22:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3842405 00:05:31.559 20:22:49 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:05:31.559 20:22:49 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:05:31.559 20:22:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3842405' 00:05:31.559 killing process with pid 3842405 00:05:31.559 20:22:49 -- common/autotest_common.sh@945 -- # kill 3842405 00:05:31.559 20:22:49 -- common/autotest_common.sh@950 -- # wait 3842405 00:05:31.820 20:22:49 -- event/cpu_locks.sh@18 -- # rm -f 00:05:31.820 20:22:49 -- event/cpu_locks.sh@1 -- # cleanup 00:05:31.820 20:22:49 -- event/cpu_locks.sh@15 -- # [[ -z 3842215 ]] 00:05:31.820 20:22:49 -- event/cpu_locks.sh@15 -- # killprocess 3842215 00:05:31.820 20:22:49 -- common/autotest_common.sh@926 -- # '[' -z 3842215 ']' 00:05:31.820 20:22:49 -- common/autotest_common.sh@930 -- # kill -0 3842215 00:05:31.820 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (3842215) - No such process 00:05:31.820 20:22:49 -- common/autotest_common.sh@953 -- # echo 'Process with pid 3842215 is not found' 00:05:31.820 Process with pid 3842215 is not found 00:05:31.820 20:22:49 -- event/cpu_locks.sh@16 -- # [[ -z 3842405 ]] 00:05:31.820 20:22:49 -- event/cpu_locks.sh@16 -- # killprocess 3842405 00:05:31.820 20:22:49 -- common/autotest_common.sh@926 -- # '[' -z 3842405 ']' 00:05:31.820 20:22:49 -- common/autotest_common.sh@930 -- # kill -0 3842405 00:05:31.820 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (3842405) - No such process 00:05:31.820 20:22:49 -- common/autotest_common.sh@953 -- # echo 'Process with pid 3842405 is not found' 00:05:31.820 Process with pid 3842405 is not found 00:05:31.820 20:22:49 -- event/cpu_locks.sh@18 -- # rm -f 00:05:31.820 00:05:31.820 real 0m15.381s 00:05:31.820 user 0m26.808s 00:05:31.820 sys 0m4.396s 00:05:31.820 20:22:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:31.820 20:22:49 -- common/autotest_common.sh@10 -- # set +x 00:05:31.820 ************************************ 00:05:31.820 END TEST cpu_locks 00:05:31.820 ************************************ 00:05:31.820 00:05:31.820 real 0m41.301s 00:05:31.820 user 1m21.903s 00:05:31.820 sys 0m7.278s 00:05:31.820 20:22:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:31.820 20:22:49 -- common/autotest_common.sh@10 -- # set +x 00:05:31.820 ************************************ 00:05:31.820 END TEST event 00:05:31.820 ************************************ 00:05:31.820 20:22:50 -- spdk/autotest.sh@188 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:31.820 20:22:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:31.820 20:22:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:31.820 20:22:50 -- common/autotest_common.sh@10 -- # set +x 00:05:31.820 ************************************ 00:05:31.820 START TEST thread 00:05:31.820 ************************************ 00:05:31.820 20:22:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:31.820 * Looking for test storage... 00:05:31.820 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:31.821 20:22:50 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:31.821 20:22:50 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:05:31.821 20:22:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:31.821 20:22:50 -- common/autotest_common.sh@10 -- # set +x 00:05:31.821 ************************************ 00:05:31.821 START TEST thread_poller_perf 00:05:31.821 ************************************ 00:05:31.821 20:22:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:31.821 [2024-04-26 20:22:50.131136] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:31.821 [2024-04-26 20:22:50.131205] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3842984 ] 00:05:31.821 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.080 [2024-04-26 20:22:50.190513] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.080 [2024-04-26 20:22:50.257194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.080 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:33.023 ====================================== 00:05:33.023 busy:2413464312 (cyc) 00:05:33.023 total_run_count: 276000 00:05:33.023 tsc_hz: 2400000000 (cyc) 00:05:33.023 ====================================== 00:05:33.023 poller_cost: 8744 (cyc), 3643 (nsec) 00:05:33.023 00:05:33.023 real 0m1.198s 00:05:33.023 user 0m1.134s 00:05:33.023 sys 0m0.060s 00:05:33.023 20:22:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:33.023 20:22:51 -- common/autotest_common.sh@10 -- # set +x 00:05:33.023 ************************************ 00:05:33.023 END TEST thread_poller_perf 00:05:33.023 ************************************ 00:05:33.023 20:22:51 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:33.023 20:22:51 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:05:33.023 20:22:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:33.023 20:22:51 -- common/autotest_common.sh@10 -- # set +x 00:05:33.023 ************************************ 00:05:33.023 START TEST thread_poller_perf 00:05:33.023 ************************************ 00:05:33.023 20:22:51 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:33.285 [2024-04-26 20:22:51.380623] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:33.285 [2024-04-26 20:22:51.380712] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3843130 ] 00:05:33.285 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.285 [2024-04-26 20:22:51.443327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.285 [2024-04-26 20:22:51.507317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.285 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:34.227 ====================================== 00:05:34.227 busy:2402485824 (cyc) 00:05:34.227 total_run_count: 3804000 00:05:34.227 tsc_hz: 2400000000 (cyc) 00:05:34.227 ====================================== 00:05:34.227 poller_cost: 631 (cyc), 262 (nsec) 00:05:34.227 00:05:34.227 real 0m1.202s 00:05:34.227 user 0m1.132s 00:05:34.227 sys 0m0.065s 00:05:34.227 20:22:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:34.227 20:22:52 -- common/autotest_common.sh@10 -- # set +x 00:05:34.227 ************************************ 00:05:34.227 END TEST thread_poller_perf 00:05:34.227 ************************************ 00:05:34.488 20:22:52 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:34.488 00:05:34.488 real 0m2.577s 00:05:34.488 user 0m2.332s 00:05:34.488 sys 0m0.254s 00:05:34.488 20:22:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:34.488 20:22:52 -- common/autotest_common.sh@10 -- # set +x 00:05:34.488 ************************************ 00:05:34.488 END TEST thread 00:05:34.488 ************************************ 00:05:34.488 20:22:52 -- spdk/autotest.sh@189 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:34.488 20:22:52 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:34.488 20:22:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:34.488 20:22:52 -- common/autotest_common.sh@10 -- # set +x 00:05:34.488 ************************************ 00:05:34.488 START TEST accel 00:05:34.488 ************************************ 00:05:34.488 20:22:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:34.488 * Looking for test storage... 00:05:34.488 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:34.488 20:22:52 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:34.488 20:22:52 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:34.488 20:22:52 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:34.488 20:22:52 -- accel/accel.sh@59 -- # spdk_tgt_pid=3843409 00:05:34.488 20:22:52 -- accel/accel.sh@60 -- # waitforlisten 3843409 00:05:34.488 20:22:52 -- common/autotest_common.sh@819 -- # '[' -z 3843409 ']' 00:05:34.488 20:22:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:34.488 20:22:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:34.488 20:22:52 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:34.488 20:22:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:34.488 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:34.488 20:22:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:34.488 20:22:52 -- accel/accel.sh@58 -- # build_accel_config 00:05:34.488 20:22:52 -- common/autotest_common.sh@10 -- # set +x 00:05:34.488 20:22:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.488 20:22:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.488 20:22:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.488 20:22:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.488 20:22:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.488 20:22:52 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.488 20:22:52 -- accel/accel.sh@42 -- # jq -r . 00:05:34.488 [2024-04-26 20:22:52.788286] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:34.488 [2024-04-26 20:22:52.788347] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3843409 ] 00:05:34.488 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.750 [2024-04-26 20:22:52.849164] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.750 [2024-04-26 20:22:52.913786] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:34.750 [2024-04-26 20:22:52.913913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.322 20:22:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:35.322 20:22:53 -- common/autotest_common.sh@852 -- # return 0 00:05:35.322 20:22:53 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:35.322 20:22:53 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:35.322 20:22:53 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:35.322 20:22:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.322 20:22:53 -- common/autotest_common.sh@10 -- # set +x 00:05:35.322 20:22:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # IFS== 00:05:35.322 20:22:53 -- accel/accel.sh@64 -- # read -r opc module 00:05:35.322 20:22:53 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:35.322 20:22:53 -- accel/accel.sh@67 -- # killprocess 3843409 00:05:35.322 20:22:53 -- common/autotest_common.sh@926 -- # '[' -z 3843409 ']' 00:05:35.323 20:22:53 -- common/autotest_common.sh@930 -- # kill -0 3843409 00:05:35.323 20:22:53 -- common/autotest_common.sh@931 -- # uname 00:05:35.323 20:22:53 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:35.323 20:22:53 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3843409 00:05:35.323 20:22:53 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:35.323 20:22:53 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:35.323 20:22:53 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3843409' 00:05:35.323 killing process with pid 3843409 00:05:35.323 20:22:53 -- common/autotest_common.sh@945 -- # kill 3843409 00:05:35.323 20:22:53 -- common/autotest_common.sh@950 -- # wait 3843409 00:05:35.583 20:22:53 -- accel/accel.sh@68 -- # trap - ERR 00:05:35.583 20:22:53 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:35.583 20:22:53 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:05:35.583 20:22:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:35.583 20:22:53 -- common/autotest_common.sh@10 -- # set +x 00:05:35.583 20:22:53 -- common/autotest_common.sh@1104 -- # accel_perf -h 00:05:35.583 20:22:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:35.583 20:22:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.583 20:22:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.583 20:22:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.583 20:22:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.583 20:22:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.583 20:22:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.583 20:22:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.583 20:22:53 -- accel/accel.sh@42 -- # jq -r . 00:05:35.583 20:22:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:35.583 20:22:53 -- common/autotest_common.sh@10 -- # set +x 00:05:35.583 20:22:53 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:35.583 20:22:53 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:35.583 20:22:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:35.583 20:22:53 -- common/autotest_common.sh@10 -- # set +x 00:05:35.583 ************************************ 00:05:35.583 START TEST accel_missing_filename 00:05:35.583 ************************************ 00:05:35.584 20:22:53 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress 00:05:35.844 20:22:53 -- common/autotest_common.sh@640 -- # local es=0 00:05:35.844 20:22:53 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:35.844 20:22:53 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:35.844 20:22:53 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:35.844 20:22:53 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:35.844 20:22:53 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:35.844 20:22:53 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress 00:05:35.844 20:22:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:35.844 20:22:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.844 20:22:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.844 20:22:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.844 20:22:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.844 20:22:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.844 20:22:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.844 20:22:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.844 20:22:53 -- accel/accel.sh@42 -- # jq -r . 00:05:35.844 [2024-04-26 20:22:53.956631] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:35.844 [2024-04-26 20:22:53.956708] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3843778 ] 00:05:35.844 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.844 [2024-04-26 20:22:54.018323] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.844 [2024-04-26 20:22:54.082674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.844 [2024-04-26 20:22:54.114270] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:35.844 [2024-04-26 20:22:54.151141] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:36.106 A filename is required. 00:05:36.106 20:22:54 -- common/autotest_common.sh@643 -- # es=234 00:05:36.106 20:22:54 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:36.106 20:22:54 -- common/autotest_common.sh@652 -- # es=106 00:05:36.106 20:22:54 -- common/autotest_common.sh@653 -- # case "$es" in 00:05:36.106 20:22:54 -- common/autotest_common.sh@660 -- # es=1 00:05:36.106 20:22:54 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:36.106 00:05:36.106 real 0m0.276s 00:05:36.106 user 0m0.217s 00:05:36.106 sys 0m0.100s 00:05:36.106 20:22:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:36.106 20:22:54 -- common/autotest_common.sh@10 -- # set +x 00:05:36.106 ************************************ 00:05:36.106 END TEST accel_missing_filename 00:05:36.106 ************************************ 00:05:36.106 20:22:54 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:36.106 20:22:54 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:05:36.106 20:22:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:36.106 20:22:54 -- common/autotest_common.sh@10 -- # set +x 00:05:36.106 ************************************ 00:05:36.106 START TEST accel_compress_verify 00:05:36.106 ************************************ 00:05:36.106 20:22:54 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:36.106 20:22:54 -- common/autotest_common.sh@640 -- # local es=0 00:05:36.106 20:22:54 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:36.106 20:22:54 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:36.106 20:22:54 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:36.106 20:22:54 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:36.106 20:22:54 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:36.106 20:22:54 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:36.106 20:22:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:36.106 20:22:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.106 20:22:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.106 20:22:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.106 20:22:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.106 20:22:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.106 20:22:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.106 20:22:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.106 20:22:54 -- accel/accel.sh@42 -- # jq -r . 00:05:36.106 [2024-04-26 20:22:54.277448] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:36.106 [2024-04-26 20:22:54.277518] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3843803 ] 00:05:36.106 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.106 [2024-04-26 20:22:54.338274] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.106 [2024-04-26 20:22:54.399248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.106 [2024-04-26 20:22:54.431087] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:36.369 [2024-04-26 20:22:54.468174] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:36.369 00:05:36.369 Compression does not support the verify option, aborting. 00:05:36.369 20:22:54 -- common/autotest_common.sh@643 -- # es=161 00:05:36.369 20:22:54 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:36.369 20:22:54 -- common/autotest_common.sh@652 -- # es=33 00:05:36.369 20:22:54 -- common/autotest_common.sh@653 -- # case "$es" in 00:05:36.369 20:22:54 -- common/autotest_common.sh@660 -- # es=1 00:05:36.369 20:22:54 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:36.369 00:05:36.369 real 0m0.274s 00:05:36.369 user 0m0.218s 00:05:36.369 sys 0m0.096s 00:05:36.369 20:22:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:36.369 20:22:54 -- common/autotest_common.sh@10 -- # set +x 00:05:36.369 ************************************ 00:05:36.369 END TEST accel_compress_verify 00:05:36.369 ************************************ 00:05:36.369 20:22:54 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:36.369 20:22:54 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:36.369 20:22:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:36.369 20:22:54 -- common/autotest_common.sh@10 -- # set +x 00:05:36.369 ************************************ 00:05:36.369 START TEST accel_wrong_workload 00:05:36.369 ************************************ 00:05:36.369 20:22:54 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w foobar 00:05:36.369 20:22:54 -- common/autotest_common.sh@640 -- # local es=0 00:05:36.369 20:22:54 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:36.369 20:22:54 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:36.369 20:22:54 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:36.369 20:22:54 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:36.369 20:22:54 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:36.369 20:22:54 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w foobar 00:05:36.369 20:22:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:36.369 20:22:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.369 20:22:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.369 20:22:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.369 20:22:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.369 20:22:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.369 20:22:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.369 20:22:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.369 20:22:54 -- accel/accel.sh@42 -- # jq -r . 00:05:36.369 Unsupported workload type: foobar 00:05:36.369 [2024-04-26 20:22:54.595032] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:36.369 accel_perf options: 00:05:36.369 [-h help message] 00:05:36.369 [-q queue depth per core] 00:05:36.369 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:36.369 [-T number of threads per core 00:05:36.369 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:36.369 [-t time in seconds] 00:05:36.369 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:36.369 [ dif_verify, , dif_generate, dif_generate_copy 00:05:36.369 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:36.369 [-l for compress/decompress workloads, name of uncompressed input file 00:05:36.369 [-S for crc32c workload, use this seed value (default 0) 00:05:36.369 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:36.369 [-f for fill workload, use this BYTE value (default 255) 00:05:36.369 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:36.369 [-y verify result if this switch is on] 00:05:36.369 [-a tasks to allocate per core (default: same value as -q)] 00:05:36.369 Can be used to spread operations across a wider range of memory. 00:05:36.369 20:22:54 -- common/autotest_common.sh@643 -- # es=1 00:05:36.369 20:22:54 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:36.369 20:22:54 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:36.369 20:22:54 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:36.369 00:05:36.369 real 0m0.040s 00:05:36.369 user 0m0.022s 00:05:36.369 sys 0m0.018s 00:05:36.369 20:22:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:36.369 20:22:54 -- common/autotest_common.sh@10 -- # set +x 00:05:36.369 ************************************ 00:05:36.369 END TEST accel_wrong_workload 00:05:36.369 ************************************ 00:05:36.369 Error: writing output failed: Broken pipe 00:05:36.369 20:22:54 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:36.369 20:22:54 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:05:36.369 20:22:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:36.369 20:22:54 -- common/autotest_common.sh@10 -- # set +x 00:05:36.369 ************************************ 00:05:36.369 START TEST accel_negative_buffers 00:05:36.369 ************************************ 00:05:36.369 20:22:54 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:36.369 20:22:54 -- common/autotest_common.sh@640 -- # local es=0 00:05:36.369 20:22:54 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:36.369 20:22:54 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:36.369 20:22:54 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:36.369 20:22:54 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:36.369 20:22:54 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:36.369 20:22:54 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w xor -y -x -1 00:05:36.369 20:22:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:36.369 20:22:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.369 20:22:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.369 20:22:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.369 20:22:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.369 20:22:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.369 20:22:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.369 20:22:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.369 20:22:54 -- accel/accel.sh@42 -- # jq -r . 00:05:36.369 -x option must be non-negative. 00:05:36.369 [2024-04-26 20:22:54.672666] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:36.369 accel_perf options: 00:05:36.369 [-h help message] 00:05:36.369 [-q queue depth per core] 00:05:36.369 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:36.369 [-T number of threads per core 00:05:36.369 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:36.369 [-t time in seconds] 00:05:36.369 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:36.369 [ dif_verify, , dif_generate, dif_generate_copy 00:05:36.369 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:36.369 [-l for compress/decompress workloads, name of uncompressed input file 00:05:36.369 [-S for crc32c workload, use this seed value (default 0) 00:05:36.369 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:36.369 [-f for fill workload, use this BYTE value (default 255) 00:05:36.369 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:36.369 [-y verify result if this switch is on] 00:05:36.369 [-a tasks to allocate per core (default: same value as -q)] 00:05:36.369 Can be used to spread operations across a wider range of memory. 00:05:36.369 20:22:54 -- common/autotest_common.sh@643 -- # es=1 00:05:36.369 20:22:54 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:36.369 20:22:54 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:36.369 20:22:54 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:36.369 00:05:36.369 real 0m0.035s 00:05:36.369 user 0m0.019s 00:05:36.369 sys 0m0.015s 00:05:36.369 20:22:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:36.369 20:22:54 -- common/autotest_common.sh@10 -- # set +x 00:05:36.369 ************************************ 00:05:36.369 END TEST accel_negative_buffers 00:05:36.369 ************************************ 00:05:36.369 Error: writing output failed: Broken pipe 00:05:36.631 20:22:54 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:36.631 20:22:54 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:36.631 20:22:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:36.631 20:22:54 -- common/autotest_common.sh@10 -- # set +x 00:05:36.631 ************************************ 00:05:36.631 START TEST accel_crc32c 00:05:36.631 ************************************ 00:05:36.631 20:22:54 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:36.631 20:22:54 -- accel/accel.sh@16 -- # local accel_opc 00:05:36.631 20:22:54 -- accel/accel.sh@17 -- # local accel_module 00:05:36.631 20:22:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:36.631 20:22:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:36.631 20:22:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.631 20:22:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.631 20:22:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.631 20:22:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.631 20:22:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.631 20:22:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.631 20:22:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.631 20:22:54 -- accel/accel.sh@42 -- # jq -r . 00:05:36.631 [2024-04-26 20:22:54.751840] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:36.631 [2024-04-26 20:22:54.751910] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3844005 ] 00:05:36.631 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.631 [2024-04-26 20:22:54.817580] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.631 [2024-04-26 20:22:54.889003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.017 20:22:56 -- accel/accel.sh@18 -- # out=' 00:05:38.017 SPDK Configuration: 00:05:38.017 Core mask: 0x1 00:05:38.017 00:05:38.017 Accel Perf Configuration: 00:05:38.017 Workload Type: crc32c 00:05:38.017 CRC-32C seed: 32 00:05:38.017 Transfer size: 4096 bytes 00:05:38.017 Vector count 1 00:05:38.017 Module: software 00:05:38.017 Queue depth: 32 00:05:38.017 Allocate depth: 32 00:05:38.017 # threads/core: 1 00:05:38.017 Run time: 1 seconds 00:05:38.017 Verify: Yes 00:05:38.017 00:05:38.017 Running for 1 seconds... 00:05:38.017 00:05:38.017 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:38.017 ------------------------------------------------------------------------------------ 00:05:38.017 0,0 449600/s 1756 MiB/s 0 0 00:05:38.017 ==================================================================================== 00:05:38.017 Total 449600/s 1756 MiB/s 0 0' 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:38.017 20:22:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:38.017 20:22:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.017 20:22:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.017 20:22:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.017 20:22:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.017 20:22:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.017 20:22:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.017 20:22:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.017 20:22:56 -- accel/accel.sh@42 -- # jq -r . 00:05:38.017 [2024-04-26 20:22:56.041583] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:38.017 [2024-04-26 20:22:56.041658] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3844192 ] 00:05:38.017 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.017 [2024-04-26 20:22:56.102417] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.017 [2024-04-26 20:22:56.165136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val= 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val= 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val=0x1 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val= 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val= 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val=crc32c 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val=32 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val= 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val=software 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@23 -- # accel_module=software 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val=32 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val=32 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val=1 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val=Yes 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val= 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.017 20:22:56 -- accel/accel.sh@21 -- # val= 00:05:38.017 20:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.017 20:22:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.958 20:22:57 -- accel/accel.sh@21 -- # val= 00:05:38.958 20:22:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.958 20:22:57 -- accel/accel.sh@20 -- # IFS=: 00:05:38.958 20:22:57 -- accel/accel.sh@20 -- # read -r var val 00:05:38.958 20:22:57 -- accel/accel.sh@21 -- # val= 00:05:38.958 20:22:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.958 20:22:57 -- accel/accel.sh@20 -- # IFS=: 00:05:38.958 20:22:57 -- accel/accel.sh@20 -- # read -r var val 00:05:38.958 20:22:57 -- accel/accel.sh@21 -- # val= 00:05:38.958 20:22:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.958 20:22:57 -- accel/accel.sh@20 -- # IFS=: 00:05:38.958 20:22:57 -- accel/accel.sh@20 -- # read -r var val 00:05:38.958 20:22:57 -- accel/accel.sh@21 -- # val= 00:05:38.958 20:22:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.958 20:22:57 -- accel/accel.sh@20 -- # IFS=: 00:05:38.958 20:22:57 -- accel/accel.sh@20 -- # read -r var val 00:05:38.958 20:22:57 -- accel/accel.sh@21 -- # val= 00:05:38.958 20:22:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.958 20:22:57 -- accel/accel.sh@20 -- # IFS=: 00:05:38.958 20:22:57 -- accel/accel.sh@20 -- # read -r var val 00:05:38.958 20:22:57 -- accel/accel.sh@21 -- # val= 00:05:38.958 20:22:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.958 20:22:57 -- accel/accel.sh@20 -- # IFS=: 00:05:38.958 20:22:57 -- accel/accel.sh@20 -- # read -r var val 00:05:38.958 20:22:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:38.958 20:22:57 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:38.958 20:22:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:38.958 00:05:38.958 real 0m2.570s 00:05:38.958 user 0m2.367s 00:05:38.958 sys 0m0.210s 00:05:38.958 20:22:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:38.958 20:22:57 -- common/autotest_common.sh@10 -- # set +x 00:05:38.958 ************************************ 00:05:38.958 END TEST accel_crc32c 00:05:38.958 ************************************ 00:05:39.326 20:22:57 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:39.326 20:22:57 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:39.326 20:22:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:39.326 20:22:57 -- common/autotest_common.sh@10 -- # set +x 00:05:39.326 ************************************ 00:05:39.326 START TEST accel_crc32c_C2 00:05:39.326 ************************************ 00:05:39.326 20:22:57 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:39.326 20:22:57 -- accel/accel.sh@16 -- # local accel_opc 00:05:39.326 20:22:57 -- accel/accel.sh@17 -- # local accel_module 00:05:39.326 20:22:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:39.326 20:22:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:39.326 20:22:57 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.326 20:22:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.326 20:22:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.326 20:22:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.326 20:22:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.326 20:22:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.326 20:22:57 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.326 20:22:57 -- accel/accel.sh@42 -- # jq -r . 00:05:39.326 [2024-04-26 20:22:57.364068] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:39.326 [2024-04-26 20:22:57.364143] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3844550 ] 00:05:39.326 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.326 [2024-04-26 20:22:57.423982] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.326 [2024-04-26 20:22:57.487325] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.709 20:22:58 -- accel/accel.sh@18 -- # out=' 00:05:40.709 SPDK Configuration: 00:05:40.709 Core mask: 0x1 00:05:40.709 00:05:40.709 Accel Perf Configuration: 00:05:40.709 Workload Type: crc32c 00:05:40.709 CRC-32C seed: 0 00:05:40.709 Transfer size: 4096 bytes 00:05:40.709 Vector count 2 00:05:40.709 Module: software 00:05:40.709 Queue depth: 32 00:05:40.709 Allocate depth: 32 00:05:40.709 # threads/core: 1 00:05:40.709 Run time: 1 seconds 00:05:40.709 Verify: Yes 00:05:40.709 00:05:40.709 Running for 1 seconds... 00:05:40.709 00:05:40.709 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:40.709 ------------------------------------------------------------------------------------ 00:05:40.709 0,0 377600/s 2950 MiB/s 0 0 00:05:40.709 ==================================================================================== 00:05:40.709 Total 377600/s 1475 MiB/s 0 0' 00:05:40.709 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.709 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.709 20:22:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:40.709 20:22:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:40.709 20:22:58 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.709 20:22:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.709 20:22:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.709 20:22:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.709 20:22:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.709 20:22:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.709 20:22:58 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.709 20:22:58 -- accel/accel.sh@42 -- # jq -r . 00:05:40.709 [2024-04-26 20:22:58.639248] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:40.710 [2024-04-26 20:22:58.639370] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3844884 ] 00:05:40.710 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.710 [2024-04-26 20:22:58.704627] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.710 [2024-04-26 20:22:58.767088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val= 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val= 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val=0x1 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val= 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val= 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val=crc32c 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val=0 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val= 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val=software 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@23 -- # accel_module=software 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val=32 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val=32 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val=1 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val=Yes 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val= 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:40.710 20:22:58 -- accel/accel.sh@21 -- # val= 00:05:40.710 20:22:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # IFS=: 00:05:40.710 20:22:58 -- accel/accel.sh@20 -- # read -r var val 00:05:41.654 20:22:59 -- accel/accel.sh@21 -- # val= 00:05:41.654 20:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.654 20:22:59 -- accel/accel.sh@20 -- # IFS=: 00:05:41.654 20:22:59 -- accel/accel.sh@20 -- # read -r var val 00:05:41.654 20:22:59 -- accel/accel.sh@21 -- # val= 00:05:41.654 20:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.654 20:22:59 -- accel/accel.sh@20 -- # IFS=: 00:05:41.654 20:22:59 -- accel/accel.sh@20 -- # read -r var val 00:05:41.654 20:22:59 -- accel/accel.sh@21 -- # val= 00:05:41.654 20:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.654 20:22:59 -- accel/accel.sh@20 -- # IFS=: 00:05:41.654 20:22:59 -- accel/accel.sh@20 -- # read -r var val 00:05:41.654 20:22:59 -- accel/accel.sh@21 -- # val= 00:05:41.654 20:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.654 20:22:59 -- accel/accel.sh@20 -- # IFS=: 00:05:41.654 20:22:59 -- accel/accel.sh@20 -- # read -r var val 00:05:41.654 20:22:59 -- accel/accel.sh@21 -- # val= 00:05:41.654 20:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.654 20:22:59 -- accel/accel.sh@20 -- # IFS=: 00:05:41.654 20:22:59 -- accel/accel.sh@20 -- # read -r var val 00:05:41.654 20:22:59 -- accel/accel.sh@21 -- # val= 00:05:41.654 20:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.654 20:22:59 -- accel/accel.sh@20 -- # IFS=: 00:05:41.654 20:22:59 -- accel/accel.sh@20 -- # read -r var val 00:05:41.654 20:22:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:41.654 20:22:59 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:41.654 20:22:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:41.654 00:05:41.654 real 0m2.558s 00:05:41.654 user 0m2.365s 00:05:41.654 sys 0m0.199s 00:05:41.654 20:22:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:41.654 20:22:59 -- common/autotest_common.sh@10 -- # set +x 00:05:41.654 ************************************ 00:05:41.654 END TEST accel_crc32c_C2 00:05:41.654 ************************************ 00:05:41.654 20:22:59 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:41.654 20:22:59 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:41.654 20:22:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:41.654 20:22:59 -- common/autotest_common.sh@10 -- # set +x 00:05:41.654 ************************************ 00:05:41.654 START TEST accel_copy 00:05:41.654 ************************************ 00:05:41.654 20:22:59 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy -y 00:05:41.654 20:22:59 -- accel/accel.sh@16 -- # local accel_opc 00:05:41.654 20:22:59 -- accel/accel.sh@17 -- # local accel_module 00:05:41.654 20:22:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:41.654 20:22:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:41.654 20:22:59 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.654 20:22:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.654 20:22:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.654 20:22:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.654 20:22:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.654 20:22:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.654 20:22:59 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.654 20:22:59 -- accel/accel.sh@42 -- # jq -r . 00:05:41.654 [2024-04-26 20:22:59.967993] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:41.654 [2024-04-26 20:22:59.968096] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3845196 ] 00:05:41.654 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.916 [2024-04-26 20:23:00.032251] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.916 [2024-04-26 20:23:00.098553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.301 20:23:01 -- accel/accel.sh@18 -- # out=' 00:05:43.301 SPDK Configuration: 00:05:43.301 Core mask: 0x1 00:05:43.301 00:05:43.301 Accel Perf Configuration: 00:05:43.301 Workload Type: copy 00:05:43.301 Transfer size: 4096 bytes 00:05:43.301 Vector count 1 00:05:43.301 Module: software 00:05:43.301 Queue depth: 32 00:05:43.301 Allocate depth: 32 00:05:43.301 # threads/core: 1 00:05:43.301 Run time: 1 seconds 00:05:43.301 Verify: Yes 00:05:43.301 00:05:43.301 Running for 1 seconds... 00:05:43.301 00:05:43.301 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:43.301 ------------------------------------------------------------------------------------ 00:05:43.301 0,0 305280/s 1192 MiB/s 0 0 00:05:43.301 ==================================================================================== 00:05:43.301 Total 305280/s 1192 MiB/s 0 0' 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:43.301 20:23:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:43.301 20:23:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.301 20:23:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.301 20:23:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.301 20:23:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.301 20:23:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.301 20:23:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.301 20:23:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.301 20:23:01 -- accel/accel.sh@42 -- # jq -r . 00:05:43.301 [2024-04-26 20:23:01.251055] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:43.301 [2024-04-26 20:23:01.251131] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3845335 ] 00:05:43.301 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.301 [2024-04-26 20:23:01.311781] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.301 [2024-04-26 20:23:01.375609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val= 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val= 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val=0x1 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val= 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val= 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val=copy 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val= 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val=software 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@23 -- # accel_module=software 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val=32 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val=32 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val=1 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val=Yes 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val= 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:43.301 20:23:01 -- accel/accel.sh@21 -- # val= 00:05:43.301 20:23:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # IFS=: 00:05:43.301 20:23:01 -- accel/accel.sh@20 -- # read -r var val 00:05:44.243 20:23:02 -- accel/accel.sh@21 -- # val= 00:05:44.243 20:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.243 20:23:02 -- accel/accel.sh@20 -- # IFS=: 00:05:44.243 20:23:02 -- accel/accel.sh@20 -- # read -r var val 00:05:44.243 20:23:02 -- accel/accel.sh@21 -- # val= 00:05:44.243 20:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.243 20:23:02 -- accel/accel.sh@20 -- # IFS=: 00:05:44.243 20:23:02 -- accel/accel.sh@20 -- # read -r var val 00:05:44.243 20:23:02 -- accel/accel.sh@21 -- # val= 00:05:44.243 20:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.243 20:23:02 -- accel/accel.sh@20 -- # IFS=: 00:05:44.243 20:23:02 -- accel/accel.sh@20 -- # read -r var val 00:05:44.243 20:23:02 -- accel/accel.sh@21 -- # val= 00:05:44.243 20:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.243 20:23:02 -- accel/accel.sh@20 -- # IFS=: 00:05:44.243 20:23:02 -- accel/accel.sh@20 -- # read -r var val 00:05:44.243 20:23:02 -- accel/accel.sh@21 -- # val= 00:05:44.243 20:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.243 20:23:02 -- accel/accel.sh@20 -- # IFS=: 00:05:44.243 20:23:02 -- accel/accel.sh@20 -- # read -r var val 00:05:44.243 20:23:02 -- accel/accel.sh@21 -- # val= 00:05:44.243 20:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.243 20:23:02 -- accel/accel.sh@20 -- # IFS=: 00:05:44.243 20:23:02 -- accel/accel.sh@20 -- # read -r var val 00:05:44.243 20:23:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:44.243 20:23:02 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:44.243 20:23:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:44.243 00:05:44.243 real 0m2.565s 00:05:44.243 user 0m2.361s 00:05:44.243 sys 0m0.209s 00:05:44.243 20:23:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:44.243 20:23:02 -- common/autotest_common.sh@10 -- # set +x 00:05:44.243 ************************************ 00:05:44.243 END TEST accel_copy 00:05:44.243 ************************************ 00:05:44.243 20:23:02 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:44.243 20:23:02 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:05:44.243 20:23:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:44.243 20:23:02 -- common/autotest_common.sh@10 -- # set +x 00:05:44.243 ************************************ 00:05:44.243 START TEST accel_fill 00:05:44.243 ************************************ 00:05:44.243 20:23:02 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:44.243 20:23:02 -- accel/accel.sh@16 -- # local accel_opc 00:05:44.243 20:23:02 -- accel/accel.sh@17 -- # local accel_module 00:05:44.243 20:23:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:44.243 20:23:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:44.243 20:23:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.243 20:23:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.243 20:23:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.243 20:23:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.243 20:23:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.243 20:23:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.243 20:23:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.243 20:23:02 -- accel/accel.sh@42 -- # jq -r . 00:05:44.243 [2024-04-26 20:23:02.576133] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:44.243 [2024-04-26 20:23:02.576244] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3845611 ] 00:05:44.504 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.504 [2024-04-26 20:23:02.637171] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.504 [2024-04-26 20:23:02.700775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.914 20:23:03 -- accel/accel.sh@18 -- # out=' 00:05:45.914 SPDK Configuration: 00:05:45.914 Core mask: 0x1 00:05:45.914 00:05:45.914 Accel Perf Configuration: 00:05:45.914 Workload Type: fill 00:05:45.914 Fill pattern: 0x80 00:05:45.914 Transfer size: 4096 bytes 00:05:45.914 Vector count 1 00:05:45.914 Module: software 00:05:45.914 Queue depth: 64 00:05:45.914 Allocate depth: 64 00:05:45.914 # threads/core: 1 00:05:45.914 Run time: 1 seconds 00:05:45.914 Verify: Yes 00:05:45.914 00:05:45.914 Running for 1 seconds... 00:05:45.914 00:05:45.914 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:45.914 ------------------------------------------------------------------------------------ 00:05:45.914 0,0 470976/s 1839 MiB/s 0 0 00:05:45.914 ==================================================================================== 00:05:45.914 Total 470976/s 1839 MiB/s 0 0' 00:05:45.914 20:23:03 -- accel/accel.sh@20 -- # IFS=: 00:05:45.914 20:23:03 -- accel/accel.sh@20 -- # read -r var val 00:05:45.914 20:23:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.915 20:23:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.915 20:23:03 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.915 20:23:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.915 20:23:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.915 20:23:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.915 20:23:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.915 20:23:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.915 20:23:03 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.915 20:23:03 -- accel/accel.sh@42 -- # jq -r . 00:05:45.915 [2024-04-26 20:23:03.854801] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:45.915 [2024-04-26 20:23:03.854911] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3845946 ] 00:05:45.915 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.915 [2024-04-26 20:23:03.915282] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.915 [2024-04-26 20:23:03.977520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val= 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val= 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val=0x1 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val= 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val= 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val=fill 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val=0x80 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val= 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val=software 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@23 -- # accel_module=software 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val=64 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val=64 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val=1 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val=Yes 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val= 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.915 20:23:04 -- accel/accel.sh@21 -- # val= 00:05:45.915 20:23:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.915 20:23:04 -- accel/accel.sh@20 -- # read -r var val 00:05:46.859 20:23:05 -- accel/accel.sh@21 -- # val= 00:05:46.859 20:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.859 20:23:05 -- accel/accel.sh@20 -- # IFS=: 00:05:46.859 20:23:05 -- accel/accel.sh@20 -- # read -r var val 00:05:46.859 20:23:05 -- accel/accel.sh@21 -- # val= 00:05:46.859 20:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.859 20:23:05 -- accel/accel.sh@20 -- # IFS=: 00:05:46.859 20:23:05 -- accel/accel.sh@20 -- # read -r var val 00:05:46.859 20:23:05 -- accel/accel.sh@21 -- # val= 00:05:46.859 20:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.859 20:23:05 -- accel/accel.sh@20 -- # IFS=: 00:05:46.859 20:23:05 -- accel/accel.sh@20 -- # read -r var val 00:05:46.859 20:23:05 -- accel/accel.sh@21 -- # val= 00:05:46.859 20:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.859 20:23:05 -- accel/accel.sh@20 -- # IFS=: 00:05:46.859 20:23:05 -- accel/accel.sh@20 -- # read -r var val 00:05:46.859 20:23:05 -- accel/accel.sh@21 -- # val= 00:05:46.860 20:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.860 20:23:05 -- accel/accel.sh@20 -- # IFS=: 00:05:46.860 20:23:05 -- accel/accel.sh@20 -- # read -r var val 00:05:46.860 20:23:05 -- accel/accel.sh@21 -- # val= 00:05:46.860 20:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.860 20:23:05 -- accel/accel.sh@20 -- # IFS=: 00:05:46.860 20:23:05 -- accel/accel.sh@20 -- # read -r var val 00:05:46.860 20:23:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:46.860 20:23:05 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:46.860 20:23:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:46.860 00:05:46.860 real 0m2.558s 00:05:46.860 user 0m2.372s 00:05:46.860 sys 0m0.192s 00:05:46.860 20:23:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:46.860 20:23:05 -- common/autotest_common.sh@10 -- # set +x 00:05:46.860 ************************************ 00:05:46.860 END TEST accel_fill 00:05:46.860 ************************************ 00:05:46.860 20:23:05 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:46.860 20:23:05 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:46.860 20:23:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:46.860 20:23:05 -- common/autotest_common.sh@10 -- # set +x 00:05:46.860 ************************************ 00:05:46.860 START TEST accel_copy_crc32c 00:05:46.860 ************************************ 00:05:46.860 20:23:05 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y 00:05:46.860 20:23:05 -- accel/accel.sh@16 -- # local accel_opc 00:05:46.860 20:23:05 -- accel/accel.sh@17 -- # local accel_module 00:05:46.860 20:23:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:46.860 20:23:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:46.860 20:23:05 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.860 20:23:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.860 20:23:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.860 20:23:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.860 20:23:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.860 20:23:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.860 20:23:05 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.860 20:23:05 -- accel/accel.sh@42 -- # jq -r . 00:05:46.860 [2024-04-26 20:23:05.177139] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:46.860 [2024-04-26 20:23:05.177215] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3846295 ] 00:05:47.120 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.120 [2024-04-26 20:23:05.237647] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.120 [2024-04-26 20:23:05.299894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.504 20:23:06 -- accel/accel.sh@18 -- # out=' 00:05:48.504 SPDK Configuration: 00:05:48.504 Core mask: 0x1 00:05:48.504 00:05:48.504 Accel Perf Configuration: 00:05:48.504 Workload Type: copy_crc32c 00:05:48.504 CRC-32C seed: 0 00:05:48.504 Vector size: 4096 bytes 00:05:48.504 Transfer size: 4096 bytes 00:05:48.504 Vector count 1 00:05:48.504 Module: software 00:05:48.504 Queue depth: 32 00:05:48.504 Allocate depth: 32 00:05:48.504 # threads/core: 1 00:05:48.504 Run time: 1 seconds 00:05:48.504 Verify: Yes 00:05:48.504 00:05:48.504 Running for 1 seconds... 00:05:48.504 00:05:48.504 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:48.504 ------------------------------------------------------------------------------------ 00:05:48.504 0,0 247680/s 967 MiB/s 0 0 00:05:48.504 ==================================================================================== 00:05:48.504 Total 247680/s 967 MiB/s 0 0' 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.504 20:23:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:48.504 20:23:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:48.504 20:23:06 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.504 20:23:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.504 20:23:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.504 20:23:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.504 20:23:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.504 20:23:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.504 20:23:06 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.504 20:23:06 -- accel/accel.sh@42 -- # jq -r . 00:05:48.504 [2024-04-26 20:23:06.451771] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:48.504 [2024-04-26 20:23:06.451877] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3846531 ] 00:05:48.504 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.504 [2024-04-26 20:23:06.512526] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.504 [2024-04-26 20:23:06.575272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.504 20:23:06 -- accel/accel.sh@21 -- # val= 00:05:48.504 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.504 20:23:06 -- accel/accel.sh@21 -- # val= 00:05:48.504 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.504 20:23:06 -- accel/accel.sh@21 -- # val=0x1 00:05:48.504 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.504 20:23:06 -- accel/accel.sh@21 -- # val= 00:05:48.504 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.504 20:23:06 -- accel/accel.sh@21 -- # val= 00:05:48.504 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.504 20:23:06 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:48.504 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.504 20:23:06 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.504 20:23:06 -- accel/accel.sh@21 -- # val=0 00:05:48.504 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.504 20:23:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.504 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.504 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.504 20:23:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.505 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.505 20:23:06 -- accel/accel.sh@21 -- # val= 00:05:48.505 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.505 20:23:06 -- accel/accel.sh@21 -- # val=software 00:05:48.505 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.505 20:23:06 -- accel/accel.sh@23 -- # accel_module=software 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.505 20:23:06 -- accel/accel.sh@21 -- # val=32 00:05:48.505 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.505 20:23:06 -- accel/accel.sh@21 -- # val=32 00:05:48.505 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.505 20:23:06 -- accel/accel.sh@21 -- # val=1 00:05:48.505 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.505 20:23:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:48.505 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.505 20:23:06 -- accel/accel.sh@21 -- # val=Yes 00:05:48.505 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.505 20:23:06 -- accel/accel.sh@21 -- # val= 00:05:48.505 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.505 20:23:06 -- accel/accel.sh@21 -- # val= 00:05:48.505 20:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.505 20:23:06 -- accel/accel.sh@20 -- # read -r var val 00:05:49.448 20:23:07 -- accel/accel.sh@21 -- # val= 00:05:49.448 20:23:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.448 20:23:07 -- accel/accel.sh@20 -- # IFS=: 00:05:49.448 20:23:07 -- accel/accel.sh@20 -- # read -r var val 00:05:49.448 20:23:07 -- accel/accel.sh@21 -- # val= 00:05:49.448 20:23:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.448 20:23:07 -- accel/accel.sh@20 -- # IFS=: 00:05:49.448 20:23:07 -- accel/accel.sh@20 -- # read -r var val 00:05:49.448 20:23:07 -- accel/accel.sh@21 -- # val= 00:05:49.448 20:23:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.448 20:23:07 -- accel/accel.sh@20 -- # IFS=: 00:05:49.448 20:23:07 -- accel/accel.sh@20 -- # read -r var val 00:05:49.448 20:23:07 -- accel/accel.sh@21 -- # val= 00:05:49.448 20:23:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.448 20:23:07 -- accel/accel.sh@20 -- # IFS=: 00:05:49.448 20:23:07 -- accel/accel.sh@20 -- # read -r var val 00:05:49.448 20:23:07 -- accel/accel.sh@21 -- # val= 00:05:49.448 20:23:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.448 20:23:07 -- accel/accel.sh@20 -- # IFS=: 00:05:49.448 20:23:07 -- accel/accel.sh@20 -- # read -r var val 00:05:49.448 20:23:07 -- accel/accel.sh@21 -- # val= 00:05:49.448 20:23:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.448 20:23:07 -- accel/accel.sh@20 -- # IFS=: 00:05:49.448 20:23:07 -- accel/accel.sh@20 -- # read -r var val 00:05:49.448 20:23:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:49.448 20:23:07 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:49.448 20:23:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:49.448 00:05:49.448 real 0m2.555s 00:05:49.448 user 0m2.379s 00:05:49.448 sys 0m0.182s 00:05:49.448 20:23:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:49.448 20:23:07 -- common/autotest_common.sh@10 -- # set +x 00:05:49.448 ************************************ 00:05:49.448 END TEST accel_copy_crc32c 00:05:49.448 ************************************ 00:05:49.448 20:23:07 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:49.448 20:23:07 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:49.448 20:23:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:49.448 20:23:07 -- common/autotest_common.sh@10 -- # set +x 00:05:49.448 ************************************ 00:05:49.448 START TEST accel_copy_crc32c_C2 00:05:49.448 ************************************ 00:05:49.448 20:23:07 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:49.448 20:23:07 -- accel/accel.sh@16 -- # local accel_opc 00:05:49.448 20:23:07 -- accel/accel.sh@17 -- # local accel_module 00:05:49.448 20:23:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:49.448 20:23:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:49.448 20:23:07 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.448 20:23:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.448 20:23:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.448 20:23:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.448 20:23:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.448 20:23:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.448 20:23:07 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.448 20:23:07 -- accel/accel.sh@42 -- # jq -r . 00:05:49.448 [2024-04-26 20:23:07.774579] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:49.448 [2024-04-26 20:23:07.774657] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3846708 ] 00:05:49.709 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.709 [2024-04-26 20:23:07.835212] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.709 [2024-04-26 20:23:07.898888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.097 20:23:09 -- accel/accel.sh@18 -- # out=' 00:05:51.097 SPDK Configuration: 00:05:51.097 Core mask: 0x1 00:05:51.097 00:05:51.097 Accel Perf Configuration: 00:05:51.097 Workload Type: copy_crc32c 00:05:51.097 CRC-32C seed: 0 00:05:51.097 Vector size: 4096 bytes 00:05:51.097 Transfer size: 8192 bytes 00:05:51.097 Vector count 2 00:05:51.097 Module: software 00:05:51.097 Queue depth: 32 00:05:51.097 Allocate depth: 32 00:05:51.097 # threads/core: 1 00:05:51.097 Run time: 1 seconds 00:05:51.097 Verify: Yes 00:05:51.097 00:05:51.097 Running for 1 seconds... 00:05:51.097 00:05:51.097 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:51.097 ------------------------------------------------------------------------------------ 00:05:51.097 0,0 184832/s 1444 MiB/s 0 0 00:05:51.097 ==================================================================================== 00:05:51.097 Total 184832/s 722 MiB/s 0 0' 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:51.097 20:23:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:51.097 20:23:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.097 20:23:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.097 20:23:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.097 20:23:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.097 20:23:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.097 20:23:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.097 20:23:09 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.097 20:23:09 -- accel/accel.sh@42 -- # jq -r . 00:05:51.097 [2024-04-26 20:23:09.051795] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:51.097 [2024-04-26 20:23:09.051904] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3847007 ] 00:05:51.097 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.097 [2024-04-26 20:23:09.125117] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.097 [2024-04-26 20:23:09.188125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val= 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val= 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val=0x1 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val= 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val= 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val=0 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val= 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val=software 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@23 -- # accel_module=software 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val=32 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val=32 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val=1 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val=Yes 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val= 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.097 20:23:09 -- accel/accel.sh@21 -- # val= 00:05:51.097 20:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.097 20:23:09 -- accel/accel.sh@20 -- # read -r var val 00:05:52.039 20:23:10 -- accel/accel.sh@21 -- # val= 00:05:52.039 20:23:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.039 20:23:10 -- accel/accel.sh@20 -- # IFS=: 00:05:52.039 20:23:10 -- accel/accel.sh@20 -- # read -r var val 00:05:52.040 20:23:10 -- accel/accel.sh@21 -- # val= 00:05:52.040 20:23:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.040 20:23:10 -- accel/accel.sh@20 -- # IFS=: 00:05:52.040 20:23:10 -- accel/accel.sh@20 -- # read -r var val 00:05:52.040 20:23:10 -- accel/accel.sh@21 -- # val= 00:05:52.040 20:23:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.040 20:23:10 -- accel/accel.sh@20 -- # IFS=: 00:05:52.040 20:23:10 -- accel/accel.sh@20 -- # read -r var val 00:05:52.040 20:23:10 -- accel/accel.sh@21 -- # val= 00:05:52.040 20:23:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.040 20:23:10 -- accel/accel.sh@20 -- # IFS=: 00:05:52.040 20:23:10 -- accel/accel.sh@20 -- # read -r var val 00:05:52.040 20:23:10 -- accel/accel.sh@21 -- # val= 00:05:52.040 20:23:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.040 20:23:10 -- accel/accel.sh@20 -- # IFS=: 00:05:52.040 20:23:10 -- accel/accel.sh@20 -- # read -r var val 00:05:52.040 20:23:10 -- accel/accel.sh@21 -- # val= 00:05:52.040 20:23:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.040 20:23:10 -- accel/accel.sh@20 -- # IFS=: 00:05:52.040 20:23:10 -- accel/accel.sh@20 -- # read -r var val 00:05:52.040 20:23:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.040 20:23:10 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:52.040 20:23:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.040 00:05:52.040 real 0m2.570s 00:05:52.040 user 0m2.370s 00:05:52.040 sys 0m0.206s 00:05:52.040 20:23:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:52.040 20:23:10 -- common/autotest_common.sh@10 -- # set +x 00:05:52.040 ************************************ 00:05:52.040 END TEST accel_copy_crc32c_C2 00:05:52.040 ************************************ 00:05:52.040 20:23:10 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:52.040 20:23:10 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:52.040 20:23:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:52.040 20:23:10 -- common/autotest_common.sh@10 -- # set +x 00:05:52.040 ************************************ 00:05:52.040 START TEST accel_dualcast 00:05:52.040 ************************************ 00:05:52.040 20:23:10 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dualcast -y 00:05:52.040 20:23:10 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.040 20:23:10 -- accel/accel.sh@17 -- # local accel_module 00:05:52.040 20:23:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:52.040 20:23:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:52.040 20:23:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.040 20:23:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.040 20:23:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.040 20:23:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.040 20:23:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.040 20:23:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.040 20:23:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.040 20:23:10 -- accel/accel.sh@42 -- # jq -r . 00:05:52.301 [2024-04-26 20:23:10.389260] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:52.301 [2024-04-26 20:23:10.389380] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3847357 ] 00:05:52.301 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.301 [2024-04-26 20:23:10.451141] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.301 [2024-04-26 20:23:10.517292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.686 20:23:11 -- accel/accel.sh@18 -- # out=' 00:05:53.686 SPDK Configuration: 00:05:53.686 Core mask: 0x1 00:05:53.686 00:05:53.686 Accel Perf Configuration: 00:05:53.686 Workload Type: dualcast 00:05:53.686 Transfer size: 4096 bytes 00:05:53.686 Vector count 1 00:05:53.686 Module: software 00:05:53.686 Queue depth: 32 00:05:53.686 Allocate depth: 32 00:05:53.686 # threads/core: 1 00:05:53.686 Run time: 1 seconds 00:05:53.686 Verify: Yes 00:05:53.686 00:05:53.686 Running for 1 seconds... 00:05:53.686 00:05:53.686 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:53.686 ------------------------------------------------------------------------------------ 00:05:53.686 0,0 362880/s 1417 MiB/s 0 0 00:05:53.686 ==================================================================================== 00:05:53.686 Total 362880/s 1417 MiB/s 0 0' 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.686 20:23:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:53.686 20:23:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:53.686 20:23:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.686 20:23:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.686 20:23:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.686 20:23:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.686 20:23:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.686 20:23:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.686 20:23:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.686 20:23:11 -- accel/accel.sh@42 -- # jq -r . 00:05:53.686 [2024-04-26 20:23:11.670082] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:53.686 [2024-04-26 20:23:11.670182] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3847699 ] 00:05:53.686 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.686 [2024-04-26 20:23:11.732269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.686 [2024-04-26 20:23:11.794382] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.686 20:23:11 -- accel/accel.sh@21 -- # val= 00:05:53.686 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.686 20:23:11 -- accel/accel.sh@21 -- # val= 00:05:53.686 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.686 20:23:11 -- accel/accel.sh@21 -- # val=0x1 00:05:53.686 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.686 20:23:11 -- accel/accel.sh@21 -- # val= 00:05:53.686 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.686 20:23:11 -- accel/accel.sh@21 -- # val= 00:05:53.686 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.686 20:23:11 -- accel/accel.sh@21 -- # val=dualcast 00:05:53.686 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.686 20:23:11 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.686 20:23:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:53.686 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.686 20:23:11 -- accel/accel.sh@21 -- # val= 00:05:53.686 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.686 20:23:11 -- accel/accel.sh@21 -- # val=software 00:05:53.686 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.686 20:23:11 -- accel/accel.sh@23 -- # accel_module=software 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.686 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.686 20:23:11 -- accel/accel.sh@21 -- # val=32 00:05:53.686 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.687 20:23:11 -- accel/accel.sh@21 -- # val=32 00:05:53.687 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.687 20:23:11 -- accel/accel.sh@21 -- # val=1 00:05:53.687 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.687 20:23:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:53.687 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.687 20:23:11 -- accel/accel.sh@21 -- # val=Yes 00:05:53.687 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.687 20:23:11 -- accel/accel.sh@21 -- # val= 00:05:53.687 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.687 20:23:11 -- accel/accel.sh@21 -- # val= 00:05:53.687 20:23:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.687 20:23:11 -- accel/accel.sh@20 -- # read -r var val 00:05:54.629 20:23:12 -- accel/accel.sh@21 -- # val= 00:05:54.629 20:23:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.629 20:23:12 -- accel/accel.sh@20 -- # IFS=: 00:05:54.629 20:23:12 -- accel/accel.sh@20 -- # read -r var val 00:05:54.629 20:23:12 -- accel/accel.sh@21 -- # val= 00:05:54.629 20:23:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.629 20:23:12 -- accel/accel.sh@20 -- # IFS=: 00:05:54.629 20:23:12 -- accel/accel.sh@20 -- # read -r var val 00:05:54.629 20:23:12 -- accel/accel.sh@21 -- # val= 00:05:54.629 20:23:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.629 20:23:12 -- accel/accel.sh@20 -- # IFS=: 00:05:54.629 20:23:12 -- accel/accel.sh@20 -- # read -r var val 00:05:54.629 20:23:12 -- accel/accel.sh@21 -- # val= 00:05:54.629 20:23:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.629 20:23:12 -- accel/accel.sh@20 -- # IFS=: 00:05:54.629 20:23:12 -- accel/accel.sh@20 -- # read -r var val 00:05:54.629 20:23:12 -- accel/accel.sh@21 -- # val= 00:05:54.629 20:23:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.629 20:23:12 -- accel/accel.sh@20 -- # IFS=: 00:05:54.629 20:23:12 -- accel/accel.sh@20 -- # read -r var val 00:05:54.629 20:23:12 -- accel/accel.sh@21 -- # val= 00:05:54.629 20:23:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.629 20:23:12 -- accel/accel.sh@20 -- # IFS=: 00:05:54.629 20:23:12 -- accel/accel.sh@20 -- # read -r var val 00:05:54.629 20:23:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:54.629 20:23:12 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:54.629 20:23:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:54.629 00:05:54.629 real 0m2.562s 00:05:54.629 user 0m2.367s 00:05:54.629 sys 0m0.201s 00:05:54.629 20:23:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:54.629 20:23:12 -- common/autotest_common.sh@10 -- # set +x 00:05:54.629 ************************************ 00:05:54.629 END TEST accel_dualcast 00:05:54.629 ************************************ 00:05:54.629 20:23:12 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:54.629 20:23:12 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:54.629 20:23:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:54.629 20:23:12 -- common/autotest_common.sh@10 -- # set +x 00:05:54.629 ************************************ 00:05:54.629 START TEST accel_compare 00:05:54.629 ************************************ 00:05:54.629 20:23:12 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compare -y 00:05:54.629 20:23:12 -- accel/accel.sh@16 -- # local accel_opc 00:05:54.629 20:23:12 -- accel/accel.sh@17 -- # local accel_module 00:05:54.629 20:23:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:54.629 20:23:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:54.629 20:23:12 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.629 20:23:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.629 20:23:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.629 20:23:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.890 20:23:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.890 20:23:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.890 20:23:12 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.890 20:23:12 -- accel/accel.sh@42 -- # jq -r . 00:05:54.891 [2024-04-26 20:23:12.996207] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:54.891 [2024-04-26 20:23:12.996288] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3847902 ] 00:05:54.891 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.891 [2024-04-26 20:23:13.057349] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.891 [2024-04-26 20:23:13.123605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.275 20:23:14 -- accel/accel.sh@18 -- # out=' 00:05:56.275 SPDK Configuration: 00:05:56.275 Core mask: 0x1 00:05:56.275 00:05:56.275 Accel Perf Configuration: 00:05:56.275 Workload Type: compare 00:05:56.275 Transfer size: 4096 bytes 00:05:56.275 Vector count 1 00:05:56.275 Module: software 00:05:56.275 Queue depth: 32 00:05:56.275 Allocate depth: 32 00:05:56.275 # threads/core: 1 00:05:56.275 Run time: 1 seconds 00:05:56.275 Verify: Yes 00:05:56.275 00:05:56.275 Running for 1 seconds... 00:05:56.275 00:05:56.275 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:56.275 ------------------------------------------------------------------------------------ 00:05:56.275 0,0 436512/s 1705 MiB/s 0 0 00:05:56.275 ==================================================================================== 00:05:56.275 Total 436512/s 1705 MiB/s 0 0' 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:56.275 20:23:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:56.275 20:23:14 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.275 20:23:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:56.275 20:23:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.275 20:23:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.275 20:23:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:56.275 20:23:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:56.275 20:23:14 -- accel/accel.sh@41 -- # local IFS=, 00:05:56.275 20:23:14 -- accel/accel.sh@42 -- # jq -r . 00:05:56.275 [2024-04-26 20:23:14.274113] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:56.275 [2024-04-26 20:23:14.274201] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3848071 ] 00:05:56.275 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.275 [2024-04-26 20:23:14.335201] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.275 [2024-04-26 20:23:14.398229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val= 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val= 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val=0x1 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val= 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val= 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val=compare 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val= 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val=software 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@23 -- # accel_module=software 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val=32 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val=32 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val=1 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val=Yes 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val= 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.275 20:23:14 -- accel/accel.sh@21 -- # val= 00:05:56.275 20:23:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.275 20:23:14 -- accel/accel.sh@20 -- # read -r var val 00:05:57.315 20:23:15 -- accel/accel.sh@21 -- # val= 00:05:57.315 20:23:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.315 20:23:15 -- accel/accel.sh@20 -- # IFS=: 00:05:57.315 20:23:15 -- accel/accel.sh@20 -- # read -r var val 00:05:57.315 20:23:15 -- accel/accel.sh@21 -- # val= 00:05:57.315 20:23:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.315 20:23:15 -- accel/accel.sh@20 -- # IFS=: 00:05:57.315 20:23:15 -- accel/accel.sh@20 -- # read -r var val 00:05:57.315 20:23:15 -- accel/accel.sh@21 -- # val= 00:05:57.315 20:23:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.315 20:23:15 -- accel/accel.sh@20 -- # IFS=: 00:05:57.315 20:23:15 -- accel/accel.sh@20 -- # read -r var val 00:05:57.315 20:23:15 -- accel/accel.sh@21 -- # val= 00:05:57.315 20:23:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.315 20:23:15 -- accel/accel.sh@20 -- # IFS=: 00:05:57.315 20:23:15 -- accel/accel.sh@20 -- # read -r var val 00:05:57.315 20:23:15 -- accel/accel.sh@21 -- # val= 00:05:57.315 20:23:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.315 20:23:15 -- accel/accel.sh@20 -- # IFS=: 00:05:57.315 20:23:15 -- accel/accel.sh@20 -- # read -r var val 00:05:57.315 20:23:15 -- accel/accel.sh@21 -- # val= 00:05:57.315 20:23:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.315 20:23:15 -- accel/accel.sh@20 -- # IFS=: 00:05:57.315 20:23:15 -- accel/accel.sh@20 -- # read -r var val 00:05:57.315 20:23:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:57.315 20:23:15 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:57.315 20:23:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:57.315 00:05:57.315 real 0m2.560s 00:05:57.315 user 0m2.372s 00:05:57.315 sys 0m0.194s 00:05:57.315 20:23:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:57.315 20:23:15 -- common/autotest_common.sh@10 -- # set +x 00:05:57.315 ************************************ 00:05:57.315 END TEST accel_compare 00:05:57.315 ************************************ 00:05:57.315 20:23:15 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:57.315 20:23:15 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:57.315 20:23:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:57.315 20:23:15 -- common/autotest_common.sh@10 -- # set +x 00:05:57.315 ************************************ 00:05:57.315 START TEST accel_xor 00:05:57.315 ************************************ 00:05:57.315 20:23:15 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y 00:05:57.315 20:23:15 -- accel/accel.sh@16 -- # local accel_opc 00:05:57.315 20:23:15 -- accel/accel.sh@17 -- # local accel_module 00:05:57.315 20:23:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:57.315 20:23:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:57.315 20:23:15 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.315 20:23:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.315 20:23:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.315 20:23:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.315 20:23:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.315 20:23:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.315 20:23:15 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.315 20:23:15 -- accel/accel.sh@42 -- # jq -r . 00:05:57.315 [2024-04-26 20:23:15.599995] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:57.315 [2024-04-26 20:23:15.600073] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3848422 ] 00:05:57.315 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.577 [2024-04-26 20:23:15.662248] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.577 [2024-04-26 20:23:15.728116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.519 20:23:16 -- accel/accel.sh@18 -- # out=' 00:05:58.519 SPDK Configuration: 00:05:58.519 Core mask: 0x1 00:05:58.519 00:05:58.519 Accel Perf Configuration: 00:05:58.519 Workload Type: xor 00:05:58.519 Source buffers: 2 00:05:58.519 Transfer size: 4096 bytes 00:05:58.519 Vector count 1 00:05:58.519 Module: software 00:05:58.519 Queue depth: 32 00:05:58.519 Allocate depth: 32 00:05:58.519 # threads/core: 1 00:05:58.519 Run time: 1 seconds 00:05:58.519 Verify: Yes 00:05:58.519 00:05:58.519 Running for 1 seconds... 00:05:58.519 00:05:58.519 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:58.519 ------------------------------------------------------------------------------------ 00:05:58.519 0,0 360352/s 1407 MiB/s 0 0 00:05:58.519 ==================================================================================== 00:05:58.519 Total 360352/s 1407 MiB/s 0 0' 00:05:58.519 20:23:16 -- accel/accel.sh@20 -- # IFS=: 00:05:58.519 20:23:16 -- accel/accel.sh@20 -- # read -r var val 00:05:58.519 20:23:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:58.519 20:23:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:58.519 20:23:16 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.519 20:23:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.519 20:23:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.519 20:23:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.519 20:23:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.520 20:23:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.520 20:23:16 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.520 20:23:16 -- accel/accel.sh@42 -- # jq -r . 00:05:58.781 [2024-04-26 20:23:16.879332] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:05:58.781 [2024-04-26 20:23:16.879427] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3848763 ] 00:05:58.781 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.781 [2024-04-26 20:23:16.940001] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.781 [2024-04-26 20:23:17.001705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val= 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val= 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val=0x1 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val= 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val= 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val=xor 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val=2 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val= 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val=software 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@23 -- # accel_module=software 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val=32 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val=32 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val=1 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val=Yes 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val= 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:05:58.781 20:23:17 -- accel/accel.sh@21 -- # val= 00:05:58.781 20:23:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # IFS=: 00:05:58.781 20:23:17 -- accel/accel.sh@20 -- # read -r var val 00:06:00.169 20:23:18 -- accel/accel.sh@21 -- # val= 00:06:00.169 20:23:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.169 20:23:18 -- accel/accel.sh@20 -- # IFS=: 00:06:00.169 20:23:18 -- accel/accel.sh@20 -- # read -r var val 00:06:00.169 20:23:18 -- accel/accel.sh@21 -- # val= 00:06:00.169 20:23:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.169 20:23:18 -- accel/accel.sh@20 -- # IFS=: 00:06:00.169 20:23:18 -- accel/accel.sh@20 -- # read -r var val 00:06:00.169 20:23:18 -- accel/accel.sh@21 -- # val= 00:06:00.169 20:23:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.169 20:23:18 -- accel/accel.sh@20 -- # IFS=: 00:06:00.169 20:23:18 -- accel/accel.sh@20 -- # read -r var val 00:06:00.169 20:23:18 -- accel/accel.sh@21 -- # val= 00:06:00.169 20:23:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.169 20:23:18 -- accel/accel.sh@20 -- # IFS=: 00:06:00.169 20:23:18 -- accel/accel.sh@20 -- # read -r var val 00:06:00.169 20:23:18 -- accel/accel.sh@21 -- # val= 00:06:00.169 20:23:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.169 20:23:18 -- accel/accel.sh@20 -- # IFS=: 00:06:00.169 20:23:18 -- accel/accel.sh@20 -- # read -r var val 00:06:00.169 20:23:18 -- accel/accel.sh@21 -- # val= 00:06:00.169 20:23:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.169 20:23:18 -- accel/accel.sh@20 -- # IFS=: 00:06:00.169 20:23:18 -- accel/accel.sh@20 -- # read -r var val 00:06:00.169 20:23:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:00.169 20:23:18 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:00.169 20:23:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:00.169 00:06:00.169 real 0m2.560s 00:06:00.169 user 0m2.367s 00:06:00.169 sys 0m0.198s 00:06:00.169 20:23:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:00.169 20:23:18 -- common/autotest_common.sh@10 -- # set +x 00:06:00.169 ************************************ 00:06:00.169 END TEST accel_xor 00:06:00.169 ************************************ 00:06:00.169 20:23:18 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:00.169 20:23:18 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:00.169 20:23:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:00.169 20:23:18 -- common/autotest_common.sh@10 -- # set +x 00:06:00.169 ************************************ 00:06:00.169 START TEST accel_xor 00:06:00.169 ************************************ 00:06:00.169 20:23:18 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y -x 3 00:06:00.169 20:23:18 -- accel/accel.sh@16 -- # local accel_opc 00:06:00.169 20:23:18 -- accel/accel.sh@17 -- # local accel_module 00:06:00.169 20:23:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:00.169 20:23:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:00.169 20:23:18 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.169 20:23:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.169 20:23:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.169 20:23:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.169 20:23:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.169 20:23:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.169 20:23:18 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.169 20:23:18 -- accel/accel.sh@42 -- # jq -r . 00:06:00.169 [2024-04-26 20:23:18.203934] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:00.169 [2024-04-26 20:23:18.204037] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3849066 ] 00:06:00.169 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.169 [2024-04-26 20:23:18.265556] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.169 [2024-04-26 20:23:18.329144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.111 20:23:19 -- accel/accel.sh@18 -- # out=' 00:06:01.111 SPDK Configuration: 00:06:01.111 Core mask: 0x1 00:06:01.111 00:06:01.111 Accel Perf Configuration: 00:06:01.111 Workload Type: xor 00:06:01.111 Source buffers: 3 00:06:01.111 Transfer size: 4096 bytes 00:06:01.111 Vector count 1 00:06:01.111 Module: software 00:06:01.111 Queue depth: 32 00:06:01.111 Allocate depth: 32 00:06:01.111 # threads/core: 1 00:06:01.111 Run time: 1 seconds 00:06:01.111 Verify: Yes 00:06:01.111 00:06:01.111 Running for 1 seconds... 00:06:01.111 00:06:01.111 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:01.111 ------------------------------------------------------------------------------------ 00:06:01.112 0,0 340928/s 1331 MiB/s 0 0 00:06:01.112 ==================================================================================== 00:06:01.112 Total 340928/s 1331 MiB/s 0 0' 00:06:01.112 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:01.374 20:23:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:01.374 20:23:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.374 20:23:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.374 20:23:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.374 20:23:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.374 20:23:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.374 20:23:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.374 20:23:19 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.374 20:23:19 -- accel/accel.sh@42 -- # jq -r . 00:06:01.374 [2024-04-26 20:23:19.480338] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:01.374 [2024-04-26 20:23:19.480411] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3849220 ] 00:06:01.374 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.374 [2024-04-26 20:23:19.540099] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.374 [2024-04-26 20:23:19.603751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val= 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val= 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val=0x1 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val= 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val= 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val=xor 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val=3 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val= 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val=software 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@23 -- # accel_module=software 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val=32 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val=32 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val=1 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val=Yes 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val= 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:01.374 20:23:19 -- accel/accel.sh@21 -- # val= 00:06:01.374 20:23:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # IFS=: 00:06:01.374 20:23:19 -- accel/accel.sh@20 -- # read -r var val 00:06:02.760 20:23:20 -- accel/accel.sh@21 -- # val= 00:06:02.760 20:23:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.760 20:23:20 -- accel/accel.sh@20 -- # IFS=: 00:06:02.760 20:23:20 -- accel/accel.sh@20 -- # read -r var val 00:06:02.760 20:23:20 -- accel/accel.sh@21 -- # val= 00:06:02.760 20:23:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.760 20:23:20 -- accel/accel.sh@20 -- # IFS=: 00:06:02.760 20:23:20 -- accel/accel.sh@20 -- # read -r var val 00:06:02.760 20:23:20 -- accel/accel.sh@21 -- # val= 00:06:02.760 20:23:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.760 20:23:20 -- accel/accel.sh@20 -- # IFS=: 00:06:02.760 20:23:20 -- accel/accel.sh@20 -- # read -r var val 00:06:02.760 20:23:20 -- accel/accel.sh@21 -- # val= 00:06:02.760 20:23:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.760 20:23:20 -- accel/accel.sh@20 -- # IFS=: 00:06:02.760 20:23:20 -- accel/accel.sh@20 -- # read -r var val 00:06:02.760 20:23:20 -- accel/accel.sh@21 -- # val= 00:06:02.760 20:23:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.760 20:23:20 -- accel/accel.sh@20 -- # IFS=: 00:06:02.760 20:23:20 -- accel/accel.sh@20 -- # read -r var val 00:06:02.760 20:23:20 -- accel/accel.sh@21 -- # val= 00:06:02.760 20:23:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.760 20:23:20 -- accel/accel.sh@20 -- # IFS=: 00:06:02.760 20:23:20 -- accel/accel.sh@20 -- # read -r var val 00:06:02.760 20:23:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:02.760 20:23:20 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:02.760 20:23:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:02.760 00:06:02.760 real 0m2.559s 00:06:02.760 user 0m2.362s 00:06:02.760 sys 0m0.203s 00:06:02.760 20:23:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:02.760 20:23:20 -- common/autotest_common.sh@10 -- # set +x 00:06:02.760 ************************************ 00:06:02.760 END TEST accel_xor 00:06:02.760 ************************************ 00:06:02.760 20:23:20 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:02.760 20:23:20 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:06:02.760 20:23:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:02.760 20:23:20 -- common/autotest_common.sh@10 -- # set +x 00:06:02.760 ************************************ 00:06:02.760 START TEST accel_dif_verify 00:06:02.760 ************************************ 00:06:02.760 20:23:20 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_verify 00:06:02.760 20:23:20 -- accel/accel.sh@16 -- # local accel_opc 00:06:02.760 20:23:20 -- accel/accel.sh@17 -- # local accel_module 00:06:02.760 20:23:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:02.760 20:23:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:02.760 20:23:20 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.760 20:23:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.760 20:23:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.760 20:23:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.760 20:23:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.760 20:23:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.760 20:23:20 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.760 20:23:20 -- accel/accel.sh@42 -- # jq -r . 00:06:02.760 [2024-04-26 20:23:20.805766] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:02.760 [2024-04-26 20:23:20.805877] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3849487 ] 00:06:02.760 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.760 [2024-04-26 20:23:20.867249] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.760 [2024-04-26 20:23:20.933589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.146 20:23:22 -- accel/accel.sh@18 -- # out=' 00:06:04.147 SPDK Configuration: 00:06:04.147 Core mask: 0x1 00:06:04.147 00:06:04.147 Accel Perf Configuration: 00:06:04.147 Workload Type: dif_verify 00:06:04.147 Vector size: 4096 bytes 00:06:04.147 Transfer size: 4096 bytes 00:06:04.147 Block size: 512 bytes 00:06:04.147 Metadata size: 8 bytes 00:06:04.147 Vector count 1 00:06:04.147 Module: software 00:06:04.147 Queue depth: 32 00:06:04.147 Allocate depth: 32 00:06:04.147 # threads/core: 1 00:06:04.147 Run time: 1 seconds 00:06:04.147 Verify: No 00:06:04.147 00:06:04.147 Running for 1 seconds... 00:06:04.147 00:06:04.147 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:04.147 ------------------------------------------------------------------------------------ 00:06:04.147 0,0 93600/s 371 MiB/s 0 0 00:06:04.147 ==================================================================================== 00:06:04.147 Total 93600/s 365 MiB/s 0 0' 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:04.147 20:23:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:04.147 20:23:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.147 20:23:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.147 20:23:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.147 20:23:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.147 20:23:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.147 20:23:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.147 20:23:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.147 20:23:22 -- accel/accel.sh@42 -- # jq -r . 00:06:04.147 [2024-04-26 20:23:22.085814] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:04.147 [2024-04-26 20:23:22.085888] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3849824 ] 00:06:04.147 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.147 [2024-04-26 20:23:22.146212] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.147 [2024-04-26 20:23:22.208964] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val= 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val= 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val=0x1 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val= 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val= 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val=dif_verify 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val= 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val=software 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@23 -- # accel_module=software 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val=32 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val=32 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val=1 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val=No 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val= 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:04.147 20:23:22 -- accel/accel.sh@21 -- # val= 00:06:04.147 20:23:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # IFS=: 00:06:04.147 20:23:22 -- accel/accel.sh@20 -- # read -r var val 00:06:05.091 20:23:23 -- accel/accel.sh@21 -- # val= 00:06:05.091 20:23:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.091 20:23:23 -- accel/accel.sh@20 -- # IFS=: 00:06:05.091 20:23:23 -- accel/accel.sh@20 -- # read -r var val 00:06:05.091 20:23:23 -- accel/accel.sh@21 -- # val= 00:06:05.091 20:23:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.091 20:23:23 -- accel/accel.sh@20 -- # IFS=: 00:06:05.091 20:23:23 -- accel/accel.sh@20 -- # read -r var val 00:06:05.091 20:23:23 -- accel/accel.sh@21 -- # val= 00:06:05.091 20:23:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.091 20:23:23 -- accel/accel.sh@20 -- # IFS=: 00:06:05.091 20:23:23 -- accel/accel.sh@20 -- # read -r var val 00:06:05.091 20:23:23 -- accel/accel.sh@21 -- # val= 00:06:05.091 20:23:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.091 20:23:23 -- accel/accel.sh@20 -- # IFS=: 00:06:05.091 20:23:23 -- accel/accel.sh@20 -- # read -r var val 00:06:05.091 20:23:23 -- accel/accel.sh@21 -- # val= 00:06:05.091 20:23:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.091 20:23:23 -- accel/accel.sh@20 -- # IFS=: 00:06:05.091 20:23:23 -- accel/accel.sh@20 -- # read -r var val 00:06:05.091 20:23:23 -- accel/accel.sh@21 -- # val= 00:06:05.091 20:23:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.091 20:23:23 -- accel/accel.sh@20 -- # IFS=: 00:06:05.091 20:23:23 -- accel/accel.sh@20 -- # read -r var val 00:06:05.092 20:23:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:05.092 20:23:23 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:05.092 20:23:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:05.092 00:06:05.092 real 0m2.561s 00:06:05.092 user 0m2.378s 00:06:05.092 sys 0m0.190s 00:06:05.092 20:23:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:05.092 20:23:23 -- common/autotest_common.sh@10 -- # set +x 00:06:05.092 ************************************ 00:06:05.092 END TEST accel_dif_verify 00:06:05.092 ************************************ 00:06:05.092 20:23:23 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:05.092 20:23:23 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:06:05.092 20:23:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:05.092 20:23:23 -- common/autotest_common.sh@10 -- # set +x 00:06:05.092 ************************************ 00:06:05.092 START TEST accel_dif_generate 00:06:05.092 ************************************ 00:06:05.092 20:23:23 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate 00:06:05.092 20:23:23 -- accel/accel.sh@16 -- # local accel_opc 00:06:05.092 20:23:23 -- accel/accel.sh@17 -- # local accel_module 00:06:05.092 20:23:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:05.092 20:23:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:05.092 20:23:23 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.092 20:23:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.092 20:23:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.092 20:23:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.092 20:23:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.092 20:23:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.092 20:23:23 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.092 20:23:23 -- accel/accel.sh@42 -- # jq -r . 00:06:05.092 [2024-04-26 20:23:23.409714] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:05.092 [2024-04-26 20:23:23.409788] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3850175 ] 00:06:05.352 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.352 [2024-04-26 20:23:23.470823] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.352 [2024-04-26 20:23:23.535042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.737 20:23:24 -- accel/accel.sh@18 -- # out=' 00:06:06.737 SPDK Configuration: 00:06:06.737 Core mask: 0x1 00:06:06.737 00:06:06.737 Accel Perf Configuration: 00:06:06.737 Workload Type: dif_generate 00:06:06.737 Vector size: 4096 bytes 00:06:06.737 Transfer size: 4096 bytes 00:06:06.737 Block size: 512 bytes 00:06:06.737 Metadata size: 8 bytes 00:06:06.737 Vector count 1 00:06:06.737 Module: software 00:06:06.737 Queue depth: 32 00:06:06.737 Allocate depth: 32 00:06:06.737 # threads/core: 1 00:06:06.737 Run time: 1 seconds 00:06:06.737 Verify: No 00:06:06.737 00:06:06.737 Running for 1 seconds... 00:06:06.737 00:06:06.737 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:06.737 ------------------------------------------------------------------------------------ 00:06:06.737 0,0 113888/s 451 MiB/s 0 0 00:06:06.737 ==================================================================================== 00:06:06.737 Total 113888/s 444 MiB/s 0 0' 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:06.737 20:23:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:06.737 20:23:24 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.737 20:23:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.737 20:23:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.737 20:23:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.737 20:23:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.737 20:23:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.737 20:23:24 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.737 20:23:24 -- accel/accel.sh@42 -- # jq -r . 00:06:06.737 [2024-04-26 20:23:24.687591] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:06.737 [2024-04-26 20:23:24.687698] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3850376 ] 00:06:06.737 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.737 [2024-04-26 20:23:24.748181] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.737 [2024-04-26 20:23:24.810427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val= 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val= 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val=0x1 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val= 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val= 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val=dif_generate 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val= 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val=software 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@23 -- # accel_module=software 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val=32 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val=32 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val=1 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val=No 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val= 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.737 20:23:24 -- accel/accel.sh@21 -- # val= 00:06:06.737 20:23:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.737 20:23:24 -- accel/accel.sh@20 -- # read -r var val 00:06:07.680 20:23:25 -- accel/accel.sh@21 -- # val= 00:06:07.680 20:23:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.680 20:23:25 -- accel/accel.sh@20 -- # IFS=: 00:06:07.680 20:23:25 -- accel/accel.sh@20 -- # read -r var val 00:06:07.680 20:23:25 -- accel/accel.sh@21 -- # val= 00:06:07.680 20:23:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.680 20:23:25 -- accel/accel.sh@20 -- # IFS=: 00:06:07.680 20:23:25 -- accel/accel.sh@20 -- # read -r var val 00:06:07.680 20:23:25 -- accel/accel.sh@21 -- # val= 00:06:07.680 20:23:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.680 20:23:25 -- accel/accel.sh@20 -- # IFS=: 00:06:07.680 20:23:25 -- accel/accel.sh@20 -- # read -r var val 00:06:07.680 20:23:25 -- accel/accel.sh@21 -- # val= 00:06:07.680 20:23:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.680 20:23:25 -- accel/accel.sh@20 -- # IFS=: 00:06:07.680 20:23:25 -- accel/accel.sh@20 -- # read -r var val 00:06:07.680 20:23:25 -- accel/accel.sh@21 -- # val= 00:06:07.680 20:23:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.680 20:23:25 -- accel/accel.sh@20 -- # IFS=: 00:06:07.680 20:23:25 -- accel/accel.sh@20 -- # read -r var val 00:06:07.680 20:23:25 -- accel/accel.sh@21 -- # val= 00:06:07.680 20:23:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.680 20:23:25 -- accel/accel.sh@20 -- # IFS=: 00:06:07.680 20:23:25 -- accel/accel.sh@20 -- # read -r var val 00:06:07.680 20:23:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:07.680 20:23:25 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:07.680 20:23:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:07.680 00:06:07.680 real 0m2.557s 00:06:07.680 user 0m2.371s 00:06:07.680 sys 0m0.195s 00:06:07.680 20:23:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:07.680 20:23:25 -- common/autotest_common.sh@10 -- # set +x 00:06:07.680 ************************************ 00:06:07.680 END TEST accel_dif_generate 00:06:07.680 ************************************ 00:06:07.680 20:23:25 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:07.680 20:23:25 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:06:07.680 20:23:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:07.680 20:23:25 -- common/autotest_common.sh@10 -- # set +x 00:06:07.680 ************************************ 00:06:07.680 START TEST accel_dif_generate_copy 00:06:07.680 ************************************ 00:06:07.680 20:23:25 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate_copy 00:06:07.680 20:23:25 -- accel/accel.sh@16 -- # local accel_opc 00:06:07.680 20:23:25 -- accel/accel.sh@17 -- # local accel_module 00:06:07.680 20:23:25 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:07.680 20:23:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:07.680 20:23:25 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.680 20:23:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.681 20:23:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.681 20:23:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.681 20:23:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.681 20:23:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.681 20:23:25 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.681 20:23:25 -- accel/accel.sh@42 -- # jq -r . 00:06:07.681 [2024-04-26 20:23:26.010647] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:07.681 [2024-04-26 20:23:26.010722] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3850571 ] 00:06:07.942 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.942 [2024-04-26 20:23:26.071961] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.942 [2024-04-26 20:23:26.136168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.326 20:23:27 -- accel/accel.sh@18 -- # out=' 00:06:09.326 SPDK Configuration: 00:06:09.326 Core mask: 0x1 00:06:09.326 00:06:09.326 Accel Perf Configuration: 00:06:09.326 Workload Type: dif_generate_copy 00:06:09.326 Vector size: 4096 bytes 00:06:09.326 Transfer size: 4096 bytes 00:06:09.326 Vector count 1 00:06:09.326 Module: software 00:06:09.326 Queue depth: 32 00:06:09.326 Allocate depth: 32 00:06:09.326 # threads/core: 1 00:06:09.326 Run time: 1 seconds 00:06:09.326 Verify: No 00:06:09.326 00:06:09.326 Running for 1 seconds... 00:06:09.326 00:06:09.326 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:09.326 ------------------------------------------------------------------------------------ 00:06:09.326 0,0 87744/s 348 MiB/s 0 0 00:06:09.326 ==================================================================================== 00:06:09.326 Total 87744/s 342 MiB/s 0 0' 00:06:09.326 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.326 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.326 20:23:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:09.326 20:23:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:09.326 20:23:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.326 20:23:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.326 20:23:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.326 20:23:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.326 20:23:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.326 20:23:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.326 20:23:27 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.326 20:23:27 -- accel/accel.sh@42 -- # jq -r . 00:06:09.327 [2024-04-26 20:23:27.288891] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:09.327 [2024-04-26 20:23:27.288993] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3850879 ] 00:06:09.327 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.327 [2024-04-26 20:23:27.349702] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.327 [2024-04-26 20:23:27.412498] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val= 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val= 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val=0x1 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val= 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val= 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val= 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val=software 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@23 -- # accel_module=software 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val=32 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val=32 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val=1 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val=No 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val= 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.327 20:23:27 -- accel/accel.sh@21 -- # val= 00:06:09.327 20:23:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.327 20:23:27 -- accel/accel.sh@20 -- # read -r var val 00:06:10.269 20:23:28 -- accel/accel.sh@21 -- # val= 00:06:10.269 20:23:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.269 20:23:28 -- accel/accel.sh@20 -- # IFS=: 00:06:10.270 20:23:28 -- accel/accel.sh@20 -- # read -r var val 00:06:10.270 20:23:28 -- accel/accel.sh@21 -- # val= 00:06:10.270 20:23:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.270 20:23:28 -- accel/accel.sh@20 -- # IFS=: 00:06:10.270 20:23:28 -- accel/accel.sh@20 -- # read -r var val 00:06:10.270 20:23:28 -- accel/accel.sh@21 -- # val= 00:06:10.270 20:23:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.270 20:23:28 -- accel/accel.sh@20 -- # IFS=: 00:06:10.270 20:23:28 -- accel/accel.sh@20 -- # read -r var val 00:06:10.270 20:23:28 -- accel/accel.sh@21 -- # val= 00:06:10.270 20:23:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.270 20:23:28 -- accel/accel.sh@20 -- # IFS=: 00:06:10.270 20:23:28 -- accel/accel.sh@20 -- # read -r var val 00:06:10.270 20:23:28 -- accel/accel.sh@21 -- # val= 00:06:10.270 20:23:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.270 20:23:28 -- accel/accel.sh@20 -- # IFS=: 00:06:10.270 20:23:28 -- accel/accel.sh@20 -- # read -r var val 00:06:10.270 20:23:28 -- accel/accel.sh@21 -- # val= 00:06:10.270 20:23:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.270 20:23:28 -- accel/accel.sh@20 -- # IFS=: 00:06:10.270 20:23:28 -- accel/accel.sh@20 -- # read -r var val 00:06:10.270 20:23:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:10.270 20:23:28 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:10.270 20:23:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:10.270 00:06:10.270 real 0m2.558s 00:06:10.270 user 0m2.374s 00:06:10.270 sys 0m0.191s 00:06:10.270 20:23:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:10.270 20:23:28 -- common/autotest_common.sh@10 -- # set +x 00:06:10.270 ************************************ 00:06:10.270 END TEST accel_dif_generate_copy 00:06:10.270 ************************************ 00:06:10.270 20:23:28 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:10.270 20:23:28 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:10.270 20:23:28 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:06:10.270 20:23:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:10.270 20:23:28 -- common/autotest_common.sh@10 -- # set +x 00:06:10.270 ************************************ 00:06:10.270 START TEST accel_comp 00:06:10.270 ************************************ 00:06:10.270 20:23:28 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:10.270 20:23:28 -- accel/accel.sh@16 -- # local accel_opc 00:06:10.270 20:23:28 -- accel/accel.sh@17 -- # local accel_module 00:06:10.270 20:23:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:10.270 20:23:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:10.270 20:23:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.270 20:23:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:10.270 20:23:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.270 20:23:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.270 20:23:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:10.270 20:23:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:10.270 20:23:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:10.270 20:23:28 -- accel/accel.sh@42 -- # jq -r . 00:06:10.270 [2024-04-26 20:23:28.611946] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:10.270 [2024-04-26 20:23:28.612016] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3851231 ] 00:06:10.531 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.531 [2024-04-26 20:23:28.671512] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.531 [2024-04-26 20:23:28.734981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.917 20:23:29 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:11.917 00:06:11.917 SPDK Configuration: 00:06:11.917 Core mask: 0x1 00:06:11.917 00:06:11.917 Accel Perf Configuration: 00:06:11.917 Workload Type: compress 00:06:11.917 Transfer size: 4096 bytes 00:06:11.917 Vector count 1 00:06:11.917 Module: software 00:06:11.917 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:11.917 Queue depth: 32 00:06:11.917 Allocate depth: 32 00:06:11.917 # threads/core: 1 00:06:11.917 Run time: 1 seconds 00:06:11.917 Verify: No 00:06:11.917 00:06:11.917 Running for 1 seconds... 00:06:11.917 00:06:11.917 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:11.917 ------------------------------------------------------------------------------------ 00:06:11.917 0,0 47616/s 198 MiB/s 0 0 00:06:11.917 ==================================================================================== 00:06:11.917 Total 47616/s 186 MiB/s 0 0' 00:06:11.917 20:23:29 -- accel/accel.sh@20 -- # IFS=: 00:06:11.917 20:23:29 -- accel/accel.sh@20 -- # read -r var val 00:06:11.917 20:23:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:11.917 20:23:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:11.917 20:23:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:11.917 20:23:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:11.917 20:23:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:11.917 20:23:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:11.917 20:23:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:11.917 20:23:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:11.917 20:23:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:11.917 20:23:29 -- accel/accel.sh@42 -- # jq -r . 00:06:11.917 [2024-04-26 20:23:29.890862] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:11.917 [2024-04-26 20:23:29.890964] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3851548 ] 00:06:11.917 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.917 [2024-04-26 20:23:29.960053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.918 [2024-04-26 20:23:30.025577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val= 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val= 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val= 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val=0x1 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val= 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val= 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val=compress 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val= 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val=software 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@23 -- # accel_module=software 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val=32 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val=32 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val=1 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val=No 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val= 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:11.918 20:23:30 -- accel/accel.sh@21 -- # val= 00:06:11.918 20:23:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # IFS=: 00:06:11.918 20:23:30 -- accel/accel.sh@20 -- # read -r var val 00:06:12.863 20:23:31 -- accel/accel.sh@21 -- # val= 00:06:12.863 20:23:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.863 20:23:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.863 20:23:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.863 20:23:31 -- accel/accel.sh@21 -- # val= 00:06:12.863 20:23:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.863 20:23:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.863 20:23:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.863 20:23:31 -- accel/accel.sh@21 -- # val= 00:06:12.863 20:23:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.863 20:23:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.863 20:23:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.863 20:23:31 -- accel/accel.sh@21 -- # val= 00:06:12.863 20:23:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.863 20:23:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.863 20:23:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.863 20:23:31 -- accel/accel.sh@21 -- # val= 00:06:12.863 20:23:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.863 20:23:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.863 20:23:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.863 20:23:31 -- accel/accel.sh@21 -- # val= 00:06:12.863 20:23:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.863 20:23:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.863 20:23:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.863 20:23:31 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:12.863 20:23:31 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:12.863 20:23:31 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:12.863 00:06:12.863 real 0m2.574s 00:06:12.863 user 0m2.378s 00:06:12.863 sys 0m0.203s 00:06:12.863 20:23:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:12.863 20:23:31 -- common/autotest_common.sh@10 -- # set +x 00:06:12.863 ************************************ 00:06:12.863 END TEST accel_comp 00:06:12.863 ************************************ 00:06:12.863 20:23:31 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:12.863 20:23:31 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:12.863 20:23:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:12.863 20:23:31 -- common/autotest_common.sh@10 -- # set +x 00:06:12.863 ************************************ 00:06:12.863 START TEST accel_decomp 00:06:12.863 ************************************ 00:06:12.863 20:23:31 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:12.863 20:23:31 -- accel/accel.sh@16 -- # local accel_opc 00:06:12.863 20:23:31 -- accel/accel.sh@17 -- # local accel_module 00:06:12.863 20:23:31 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:12.863 20:23:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:12.863 20:23:31 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.863 20:23:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.125 20:23:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.125 20:23:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.125 20:23:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.125 20:23:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.125 20:23:31 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.125 20:23:31 -- accel/accel.sh@42 -- # jq -r . 00:06:13.125 [2024-04-26 20:23:31.230769] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:13.125 [2024-04-26 20:23:31.230878] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3851733 ] 00:06:13.125 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.125 [2024-04-26 20:23:31.292937] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.125 [2024-04-26 20:23:31.358717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.511 20:23:32 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:14.511 00:06:14.511 SPDK Configuration: 00:06:14.511 Core mask: 0x1 00:06:14.511 00:06:14.511 Accel Perf Configuration: 00:06:14.511 Workload Type: decompress 00:06:14.511 Transfer size: 4096 bytes 00:06:14.511 Vector count 1 00:06:14.511 Module: software 00:06:14.511 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.511 Queue depth: 32 00:06:14.511 Allocate depth: 32 00:06:14.511 # threads/core: 1 00:06:14.511 Run time: 1 seconds 00:06:14.511 Verify: Yes 00:06:14.511 00:06:14.511 Running for 1 seconds... 00:06:14.511 00:06:14.511 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:14.511 ------------------------------------------------------------------------------------ 00:06:14.511 0,0 63104/s 116 MiB/s 0 0 00:06:14.511 ==================================================================================== 00:06:14.511 Total 63104/s 246 MiB/s 0 0' 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.511 20:23:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:14.511 20:23:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:14.511 20:23:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:14.511 20:23:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:14.511 20:23:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:14.511 20:23:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:14.511 20:23:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:14.511 20:23:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:14.511 20:23:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:14.511 20:23:32 -- accel/accel.sh@42 -- # jq -r . 00:06:14.511 [2024-04-26 20:23:32.514048] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:14.511 [2024-04-26 20:23:32.514150] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3851941 ] 00:06:14.511 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.511 [2024-04-26 20:23:32.575601] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.511 [2024-04-26 20:23:32.638432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.511 20:23:32 -- accel/accel.sh@21 -- # val= 00:06:14.511 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.511 20:23:32 -- accel/accel.sh@21 -- # val= 00:06:14.511 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.511 20:23:32 -- accel/accel.sh@21 -- # val= 00:06:14.511 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.511 20:23:32 -- accel/accel.sh@21 -- # val=0x1 00:06:14.511 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.511 20:23:32 -- accel/accel.sh@21 -- # val= 00:06:14.511 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.511 20:23:32 -- accel/accel.sh@21 -- # val= 00:06:14.511 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.511 20:23:32 -- accel/accel.sh@21 -- # val=decompress 00:06:14.511 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.511 20:23:32 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.511 20:23:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:14.511 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.511 20:23:32 -- accel/accel.sh@21 -- # val= 00:06:14.511 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.511 20:23:32 -- accel/accel.sh@21 -- # val=software 00:06:14.511 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.511 20:23:32 -- accel/accel.sh@23 -- # accel_module=software 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.511 20:23:32 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.511 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.511 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.511 20:23:32 -- accel/accel.sh@21 -- # val=32 00:06:14.511 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.512 20:23:32 -- accel/accel.sh@21 -- # val=32 00:06:14.512 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.512 20:23:32 -- accel/accel.sh@21 -- # val=1 00:06:14.512 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.512 20:23:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:14.512 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.512 20:23:32 -- accel/accel.sh@21 -- # val=Yes 00:06:14.512 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.512 20:23:32 -- accel/accel.sh@21 -- # val= 00:06:14.512 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:14.512 20:23:32 -- accel/accel.sh@21 -- # val= 00:06:14.512 20:23:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # IFS=: 00:06:14.512 20:23:32 -- accel/accel.sh@20 -- # read -r var val 00:06:15.470 20:23:33 -- accel/accel.sh@21 -- # val= 00:06:15.470 20:23:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.470 20:23:33 -- accel/accel.sh@20 -- # IFS=: 00:06:15.470 20:23:33 -- accel/accel.sh@20 -- # read -r var val 00:06:15.470 20:23:33 -- accel/accel.sh@21 -- # val= 00:06:15.470 20:23:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.470 20:23:33 -- accel/accel.sh@20 -- # IFS=: 00:06:15.470 20:23:33 -- accel/accel.sh@20 -- # read -r var val 00:06:15.470 20:23:33 -- accel/accel.sh@21 -- # val= 00:06:15.470 20:23:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.470 20:23:33 -- accel/accel.sh@20 -- # IFS=: 00:06:15.470 20:23:33 -- accel/accel.sh@20 -- # read -r var val 00:06:15.470 20:23:33 -- accel/accel.sh@21 -- # val= 00:06:15.470 20:23:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.470 20:23:33 -- accel/accel.sh@20 -- # IFS=: 00:06:15.470 20:23:33 -- accel/accel.sh@20 -- # read -r var val 00:06:15.470 20:23:33 -- accel/accel.sh@21 -- # val= 00:06:15.470 20:23:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.470 20:23:33 -- accel/accel.sh@20 -- # IFS=: 00:06:15.470 20:23:33 -- accel/accel.sh@20 -- # read -r var val 00:06:15.470 20:23:33 -- accel/accel.sh@21 -- # val= 00:06:15.470 20:23:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.470 20:23:33 -- accel/accel.sh@20 -- # IFS=: 00:06:15.470 20:23:33 -- accel/accel.sh@20 -- # read -r var val 00:06:15.470 20:23:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:15.470 20:23:33 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:15.470 20:23:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:15.470 00:06:15.470 real 0m2.569s 00:06:15.470 user 0m2.368s 00:06:15.470 sys 0m0.208s 00:06:15.470 20:23:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:15.470 20:23:33 -- common/autotest_common.sh@10 -- # set +x 00:06:15.470 ************************************ 00:06:15.470 END TEST accel_decomp 00:06:15.470 ************************************ 00:06:15.470 20:23:33 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.470 20:23:33 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:06:15.470 20:23:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:15.470 20:23:33 -- common/autotest_common.sh@10 -- # set +x 00:06:15.730 ************************************ 00:06:15.730 START TEST accel_decmop_full 00:06:15.730 ************************************ 00:06:15.730 20:23:33 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.730 20:23:33 -- accel/accel.sh@16 -- # local accel_opc 00:06:15.730 20:23:33 -- accel/accel.sh@17 -- # local accel_module 00:06:15.730 20:23:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.730 20:23:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.730 20:23:33 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.730 20:23:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.730 20:23:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.730 20:23:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.730 20:23:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.730 20:23:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.730 20:23:33 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.730 20:23:33 -- accel/accel.sh@42 -- # jq -r . 00:06:15.730 [2024-04-26 20:23:33.842078] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:15.730 [2024-04-26 20:23:33.842156] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3852292 ] 00:06:15.730 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.730 [2024-04-26 20:23:33.903347] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.730 [2024-04-26 20:23:33.969971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.115 20:23:35 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:17.115 00:06:17.115 SPDK Configuration: 00:06:17.115 Core mask: 0x1 00:06:17.115 00:06:17.115 Accel Perf Configuration: 00:06:17.115 Workload Type: decompress 00:06:17.115 Transfer size: 111250 bytes 00:06:17.115 Vector count 1 00:06:17.115 Module: software 00:06:17.115 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.115 Queue depth: 32 00:06:17.115 Allocate depth: 32 00:06:17.115 # threads/core: 1 00:06:17.115 Run time: 1 seconds 00:06:17.115 Verify: Yes 00:06:17.115 00:06:17.115 Running for 1 seconds... 00:06:17.115 00:06:17.115 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:17.115 ------------------------------------------------------------------------------------ 00:06:17.115 0,0 4064/s 167 MiB/s 0 0 00:06:17.115 ==================================================================================== 00:06:17.115 Total 4064/s 431 MiB/s 0 0' 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.115 20:23:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:17.115 20:23:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:17.115 20:23:35 -- accel/accel.sh@12 -- # build_accel_config 00:06:17.115 20:23:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:17.115 20:23:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:17.115 20:23:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:17.115 20:23:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:17.115 20:23:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:17.115 20:23:35 -- accel/accel.sh@41 -- # local IFS=, 00:06:17.115 20:23:35 -- accel/accel.sh@42 -- # jq -r . 00:06:17.115 [2024-04-26 20:23:35.134335] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:17.115 [2024-04-26 20:23:35.134436] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3852633 ] 00:06:17.115 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.115 [2024-04-26 20:23:35.195730] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.115 [2024-04-26 20:23:35.259034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.115 20:23:35 -- accel/accel.sh@21 -- # val= 00:06:17.115 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.115 20:23:35 -- accel/accel.sh@21 -- # val= 00:06:17.115 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.115 20:23:35 -- accel/accel.sh@21 -- # val= 00:06:17.115 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.115 20:23:35 -- accel/accel.sh@21 -- # val=0x1 00:06:17.115 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.115 20:23:35 -- accel/accel.sh@21 -- # val= 00:06:17.115 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.115 20:23:35 -- accel/accel.sh@21 -- # val= 00:06:17.115 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.115 20:23:35 -- accel/accel.sh@21 -- # val=decompress 00:06:17.115 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.115 20:23:35 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.115 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.116 20:23:35 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:17.116 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.116 20:23:35 -- accel/accel.sh@21 -- # val= 00:06:17.116 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.116 20:23:35 -- accel/accel.sh@21 -- # val=software 00:06:17.116 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.116 20:23:35 -- accel/accel.sh@23 -- # accel_module=software 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.116 20:23:35 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.116 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.116 20:23:35 -- accel/accel.sh@21 -- # val=32 00:06:17.116 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.116 20:23:35 -- accel/accel.sh@21 -- # val=32 00:06:17.116 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.116 20:23:35 -- accel/accel.sh@21 -- # val=1 00:06:17.116 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.116 20:23:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:17.116 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.116 20:23:35 -- accel/accel.sh@21 -- # val=Yes 00:06:17.116 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.116 20:23:35 -- accel/accel.sh@21 -- # val= 00:06:17.116 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.116 20:23:35 -- accel/accel.sh@21 -- # val= 00:06:17.116 20:23:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.116 20:23:35 -- accel/accel.sh@20 -- # read -r var val 00:06:18.057 20:23:36 -- accel/accel.sh@21 -- # val= 00:06:18.057 20:23:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.057 20:23:36 -- accel/accel.sh@20 -- # IFS=: 00:06:18.057 20:23:36 -- accel/accel.sh@20 -- # read -r var val 00:06:18.057 20:23:36 -- accel/accel.sh@21 -- # val= 00:06:18.057 20:23:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.057 20:23:36 -- accel/accel.sh@20 -- # IFS=: 00:06:18.057 20:23:36 -- accel/accel.sh@20 -- # read -r var val 00:06:18.057 20:23:36 -- accel/accel.sh@21 -- # val= 00:06:18.057 20:23:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.057 20:23:36 -- accel/accel.sh@20 -- # IFS=: 00:06:18.057 20:23:36 -- accel/accel.sh@20 -- # read -r var val 00:06:18.057 20:23:36 -- accel/accel.sh@21 -- # val= 00:06:18.057 20:23:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.057 20:23:36 -- accel/accel.sh@20 -- # IFS=: 00:06:18.057 20:23:36 -- accel/accel.sh@20 -- # read -r var val 00:06:18.057 20:23:36 -- accel/accel.sh@21 -- # val= 00:06:18.057 20:23:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.057 20:23:36 -- accel/accel.sh@20 -- # IFS=: 00:06:18.057 20:23:36 -- accel/accel.sh@20 -- # read -r var val 00:06:18.057 20:23:36 -- accel/accel.sh@21 -- # val= 00:06:18.057 20:23:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.057 20:23:36 -- accel/accel.sh@20 -- # IFS=: 00:06:18.057 20:23:36 -- accel/accel.sh@20 -- # read -r var val 00:06:18.057 20:23:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:18.057 20:23:36 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:18.057 20:23:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:18.057 00:06:18.057 real 0m2.585s 00:06:18.057 user 0m2.390s 00:06:18.057 sys 0m0.200s 00:06:18.057 20:23:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:18.057 20:23:36 -- common/autotest_common.sh@10 -- # set +x 00:06:18.057 ************************************ 00:06:18.057 END TEST accel_decmop_full 00:06:18.057 ************************************ 00:06:18.318 20:23:36 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:18.318 20:23:36 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:06:18.318 20:23:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:18.318 20:23:36 -- common/autotest_common.sh@10 -- # set +x 00:06:18.318 ************************************ 00:06:18.318 START TEST accel_decomp_mcore 00:06:18.318 ************************************ 00:06:18.318 20:23:36 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:18.318 20:23:36 -- accel/accel.sh@16 -- # local accel_opc 00:06:18.318 20:23:36 -- accel/accel.sh@17 -- # local accel_module 00:06:18.318 20:23:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:18.318 20:23:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:18.318 20:23:36 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.318 20:23:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.318 20:23:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.318 20:23:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.318 20:23:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.318 20:23:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.318 20:23:36 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.318 20:23:36 -- accel/accel.sh@42 -- # jq -r . 00:06:18.318 [2024-04-26 20:23:36.471820] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:18.318 [2024-04-26 20:23:36.471926] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3852915 ] 00:06:18.318 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.318 [2024-04-26 20:23:36.534182] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:18.318 [2024-04-26 20:23:36.601616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:18.318 [2024-04-26 20:23:36.601750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:18.318 [2024-04-26 20:23:36.601898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:18.318 [2024-04-26 20:23:36.601901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.705 20:23:37 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:19.706 00:06:19.706 SPDK Configuration: 00:06:19.706 Core mask: 0xf 00:06:19.706 00:06:19.706 Accel Perf Configuration: 00:06:19.706 Workload Type: decompress 00:06:19.706 Transfer size: 4096 bytes 00:06:19.706 Vector count 1 00:06:19.706 Module: software 00:06:19.706 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:19.706 Queue depth: 32 00:06:19.706 Allocate depth: 32 00:06:19.706 # threads/core: 1 00:06:19.706 Run time: 1 seconds 00:06:19.706 Verify: Yes 00:06:19.706 00:06:19.706 Running for 1 seconds... 00:06:19.706 00:06:19.706 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:19.706 ------------------------------------------------------------------------------------ 00:06:19.706 0,0 58400/s 107 MiB/s 0 0 00:06:19.706 3,0 58720/s 108 MiB/s 0 0 00:06:19.706 2,0 86272/s 158 MiB/s 0 0 00:06:19.706 1,0 58592/s 107 MiB/s 0 0 00:06:19.706 ==================================================================================== 00:06:19.706 Total 261984/s 1023 MiB/s 0 0' 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:19.706 20:23:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:19.706 20:23:37 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.706 20:23:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.706 20:23:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.706 20:23:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.706 20:23:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.706 20:23:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.706 20:23:37 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.706 20:23:37 -- accel/accel.sh@42 -- # jq -r . 00:06:19.706 [2024-04-26 20:23:37.762393] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:19.706 [2024-04-26 20:23:37.762462] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3853058 ] 00:06:19.706 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.706 [2024-04-26 20:23:37.823183] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:19.706 [2024-04-26 20:23:37.888265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:19.706 [2024-04-26 20:23:37.888402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:19.706 [2024-04-26 20:23:37.888587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:19.706 [2024-04-26 20:23:37.888591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val= 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val= 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val= 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val=0xf 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val= 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val= 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val=decompress 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val= 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val=software 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@23 -- # accel_module=software 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val=32 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val=32 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val=1 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val=Yes 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val= 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:19.706 20:23:37 -- accel/accel.sh@21 -- # val= 00:06:19.706 20:23:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # IFS=: 00:06:19.706 20:23:37 -- accel/accel.sh@20 -- # read -r var val 00:06:21.090 20:23:39 -- accel/accel.sh@21 -- # val= 00:06:21.090 20:23:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # IFS=: 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # read -r var val 00:06:21.090 20:23:39 -- accel/accel.sh@21 -- # val= 00:06:21.090 20:23:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # IFS=: 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # read -r var val 00:06:21.090 20:23:39 -- accel/accel.sh@21 -- # val= 00:06:21.090 20:23:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # IFS=: 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # read -r var val 00:06:21.090 20:23:39 -- accel/accel.sh@21 -- # val= 00:06:21.090 20:23:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # IFS=: 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # read -r var val 00:06:21.090 20:23:39 -- accel/accel.sh@21 -- # val= 00:06:21.090 20:23:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # IFS=: 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # read -r var val 00:06:21.090 20:23:39 -- accel/accel.sh@21 -- # val= 00:06:21.090 20:23:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # IFS=: 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # read -r var val 00:06:21.090 20:23:39 -- accel/accel.sh@21 -- # val= 00:06:21.090 20:23:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # IFS=: 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # read -r var val 00:06:21.090 20:23:39 -- accel/accel.sh@21 -- # val= 00:06:21.090 20:23:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # IFS=: 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # read -r var val 00:06:21.090 20:23:39 -- accel/accel.sh@21 -- # val= 00:06:21.090 20:23:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # IFS=: 00:06:21.090 20:23:39 -- accel/accel.sh@20 -- # read -r var val 00:06:21.090 20:23:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:21.090 20:23:39 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:21.090 20:23:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:21.090 00:06:21.090 real 0m2.585s 00:06:21.090 user 0m8.861s 00:06:21.090 sys 0m0.201s 00:06:21.090 20:23:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:21.090 20:23:39 -- common/autotest_common.sh@10 -- # set +x 00:06:21.090 ************************************ 00:06:21.090 END TEST accel_decomp_mcore 00:06:21.090 ************************************ 00:06:21.090 20:23:39 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:21.090 20:23:39 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:06:21.090 20:23:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:21.090 20:23:39 -- common/autotest_common.sh@10 -- # set +x 00:06:21.090 ************************************ 00:06:21.091 START TEST accel_decomp_full_mcore 00:06:21.091 ************************************ 00:06:21.091 20:23:39 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:21.091 20:23:39 -- accel/accel.sh@16 -- # local accel_opc 00:06:21.091 20:23:39 -- accel/accel.sh@17 -- # local accel_module 00:06:21.091 20:23:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:21.091 20:23:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:21.091 20:23:39 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.091 20:23:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.091 20:23:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.091 20:23:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.091 20:23:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.091 20:23:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.091 20:23:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.091 20:23:39 -- accel/accel.sh@42 -- # jq -r . 00:06:21.091 [2024-04-26 20:23:39.098014] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:21.091 [2024-04-26 20:23:39.098103] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3853364 ] 00:06:21.091 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.091 [2024-04-26 20:23:39.159968] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:21.091 [2024-04-26 20:23:39.224617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:21.091 [2024-04-26 20:23:39.224749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:21.091 [2024-04-26 20:23:39.224873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:21.091 [2024-04-26 20:23:39.224876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.034 20:23:40 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:22.034 00:06:22.034 SPDK Configuration: 00:06:22.034 Core mask: 0xf 00:06:22.034 00:06:22.034 Accel Perf Configuration: 00:06:22.034 Workload Type: decompress 00:06:22.034 Transfer size: 111250 bytes 00:06:22.034 Vector count 1 00:06:22.034 Module: software 00:06:22.034 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:22.034 Queue depth: 32 00:06:22.034 Allocate depth: 32 00:06:22.034 # threads/core: 1 00:06:22.034 Run time: 1 seconds 00:06:22.034 Verify: Yes 00:06:22.034 00:06:22.034 Running for 1 seconds... 00:06:22.034 00:06:22.034 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:22.034 ------------------------------------------------------------------------------------ 00:06:22.034 0,0 4064/s 167 MiB/s 0 0 00:06:22.034 3,0 4096/s 169 MiB/s 0 0 00:06:22.034 2,0 5920/s 244 MiB/s 0 0 00:06:22.034 1,0 4096/s 169 MiB/s 0 0 00:06:22.034 ==================================================================================== 00:06:22.034 Total 18176/s 1928 MiB/s 0 0' 00:06:22.034 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.034 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.034 20:23:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:22.034 20:23:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:22.034 20:23:40 -- accel/accel.sh@12 -- # build_accel_config 00:06:22.034 20:23:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.034 20:23:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.034 20:23:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.034 20:23:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.034 20:23:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.034 20:23:40 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.294 20:23:40 -- accel/accel.sh@42 -- # jq -r . 00:06:22.294 [2024-04-26 20:23:40.398442] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:22.294 [2024-04-26 20:23:40.398524] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3853704 ] 00:06:22.294 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.294 [2024-04-26 20:23:40.459337] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:22.294 [2024-04-26 20:23:40.524817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:22.294 [2024-04-26 20:23:40.524953] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:22.294 [2024-04-26 20:23:40.525106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:22.294 [2024-04-26 20:23:40.525109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.294 20:23:40 -- accel/accel.sh@21 -- # val= 00:06:22.294 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.294 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.294 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.294 20:23:40 -- accel/accel.sh@21 -- # val= 00:06:22.294 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.294 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val= 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val=0xf 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val= 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val= 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val=decompress 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val= 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val=software 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@23 -- # accel_module=software 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val=32 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val=32 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val=1 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val=Yes 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val= 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:22.295 20:23:40 -- accel/accel.sh@21 -- # val= 00:06:22.295 20:23:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # IFS=: 00:06:22.295 20:23:40 -- accel/accel.sh@20 -- # read -r var val 00:06:23.682 20:23:41 -- accel/accel.sh@21 -- # val= 00:06:23.682 20:23:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.682 20:23:41 -- accel/accel.sh@21 -- # val= 00:06:23.682 20:23:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.682 20:23:41 -- accel/accel.sh@21 -- # val= 00:06:23.682 20:23:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.682 20:23:41 -- accel/accel.sh@21 -- # val= 00:06:23.682 20:23:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.682 20:23:41 -- accel/accel.sh@21 -- # val= 00:06:23.682 20:23:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.682 20:23:41 -- accel/accel.sh@21 -- # val= 00:06:23.682 20:23:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.682 20:23:41 -- accel/accel.sh@21 -- # val= 00:06:23.682 20:23:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.682 20:23:41 -- accel/accel.sh@21 -- # val= 00:06:23.682 20:23:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.682 20:23:41 -- accel/accel.sh@21 -- # val= 00:06:23.682 20:23:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.682 20:23:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.682 20:23:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:23.682 20:23:41 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:23.682 20:23:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:23.682 00:06:23.682 real 0m2.605s 00:06:23.682 user 0m8.924s 00:06:23.682 sys 0m0.226s 00:06:23.682 20:23:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:23.682 20:23:41 -- common/autotest_common.sh@10 -- # set +x 00:06:23.682 ************************************ 00:06:23.682 END TEST accel_decomp_full_mcore 00:06:23.682 ************************************ 00:06:23.682 20:23:41 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:23.682 20:23:41 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:06:23.682 20:23:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:23.682 20:23:41 -- common/autotest_common.sh@10 -- # set +x 00:06:23.682 ************************************ 00:06:23.682 START TEST accel_decomp_mthread 00:06:23.682 ************************************ 00:06:23.682 20:23:41 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:23.682 20:23:41 -- accel/accel.sh@16 -- # local accel_opc 00:06:23.682 20:23:41 -- accel/accel.sh@17 -- # local accel_module 00:06:23.682 20:23:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:23.682 20:23:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:23.682 20:23:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:23.682 20:23:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:23.682 20:23:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:23.682 20:23:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:23.682 20:23:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:23.682 20:23:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:23.682 20:23:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:23.682 20:23:41 -- accel/accel.sh@42 -- # jq -r . 00:06:23.682 [2024-04-26 20:23:41.746797] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:23.682 [2024-04-26 20:23:41.746898] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3854059 ] 00:06:23.682 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.682 [2024-04-26 20:23:41.807274] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.682 [2024-04-26 20:23:41.870185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.073 20:23:42 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:25.073 00:06:25.073 SPDK Configuration: 00:06:25.073 Core mask: 0x1 00:06:25.073 00:06:25.073 Accel Perf Configuration: 00:06:25.073 Workload Type: decompress 00:06:25.073 Transfer size: 4096 bytes 00:06:25.073 Vector count 1 00:06:25.073 Module: software 00:06:25.073 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:25.073 Queue depth: 32 00:06:25.073 Allocate depth: 32 00:06:25.073 # threads/core: 2 00:06:25.073 Run time: 1 seconds 00:06:25.073 Verify: Yes 00:06:25.073 00:06:25.073 Running for 1 seconds... 00:06:25.073 00:06:25.073 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:25.073 ------------------------------------------------------------------------------------ 00:06:25.073 0,1 31840/s 58 MiB/s 0 0 00:06:25.073 0,0 31744/s 58 MiB/s 0 0 00:06:25.073 ==================================================================================== 00:06:25.073 Total 63584/s 248 MiB/s 0 0' 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:25.073 20:23:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:25.073 20:23:43 -- accel/accel.sh@12 -- # build_accel_config 00:06:25.073 20:23:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:25.073 20:23:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:25.073 20:23:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:25.073 20:23:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:25.073 20:23:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:25.073 20:23:43 -- accel/accel.sh@41 -- # local IFS=, 00:06:25.073 20:23:43 -- accel/accel.sh@42 -- # jq -r . 00:06:25.073 [2024-04-26 20:23:43.026434] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:25.073 [2024-04-26 20:23:43.026508] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3854253 ] 00:06:25.073 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.073 [2024-04-26 20:23:43.086630] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.073 [2024-04-26 20:23:43.149959] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val= 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val= 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val= 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val=0x1 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val= 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val= 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val=decompress 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val= 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val=software 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@23 -- # accel_module=software 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val=32 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val=32 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val=2 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val=Yes 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.073 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.073 20:23:43 -- accel/accel.sh@21 -- # val= 00:06:25.073 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.074 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.074 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:25.074 20:23:43 -- accel/accel.sh@21 -- # val= 00:06:25.074 20:23:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.074 20:23:43 -- accel/accel.sh@20 -- # IFS=: 00:06:25.074 20:23:43 -- accel/accel.sh@20 -- # read -r var val 00:06:26.030 20:23:44 -- accel/accel.sh@21 -- # val= 00:06:26.030 20:23:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # IFS=: 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # read -r var val 00:06:26.030 20:23:44 -- accel/accel.sh@21 -- # val= 00:06:26.030 20:23:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # IFS=: 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # read -r var val 00:06:26.030 20:23:44 -- accel/accel.sh@21 -- # val= 00:06:26.030 20:23:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # IFS=: 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # read -r var val 00:06:26.030 20:23:44 -- accel/accel.sh@21 -- # val= 00:06:26.030 20:23:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # IFS=: 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # read -r var val 00:06:26.030 20:23:44 -- accel/accel.sh@21 -- # val= 00:06:26.030 20:23:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # IFS=: 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # read -r var val 00:06:26.030 20:23:44 -- accel/accel.sh@21 -- # val= 00:06:26.030 20:23:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # IFS=: 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # read -r var val 00:06:26.030 20:23:44 -- accel/accel.sh@21 -- # val= 00:06:26.030 20:23:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # IFS=: 00:06:26.030 20:23:44 -- accel/accel.sh@20 -- # read -r var val 00:06:26.030 20:23:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:26.030 20:23:44 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:26.030 20:23:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:26.030 00:06:26.030 real 0m2.567s 00:06:26.030 user 0m2.377s 00:06:26.030 sys 0m0.198s 00:06:26.030 20:23:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:26.030 20:23:44 -- common/autotest_common.sh@10 -- # set +x 00:06:26.030 ************************************ 00:06:26.030 END TEST accel_decomp_mthread 00:06:26.030 ************************************ 00:06:26.030 20:23:44 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:26.030 20:23:44 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:06:26.030 20:23:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:26.030 20:23:44 -- common/autotest_common.sh@10 -- # set +x 00:06:26.030 ************************************ 00:06:26.030 START TEST accel_deomp_full_mthread 00:06:26.030 ************************************ 00:06:26.030 20:23:44 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:26.030 20:23:44 -- accel/accel.sh@16 -- # local accel_opc 00:06:26.030 20:23:44 -- accel/accel.sh@17 -- # local accel_module 00:06:26.030 20:23:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:26.030 20:23:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:26.030 20:23:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:26.030 20:23:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:26.030 20:23:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:26.030 20:23:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:26.030 20:23:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:26.030 20:23:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:26.030 20:23:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:26.030 20:23:44 -- accel/accel.sh@42 -- # jq -r . 00:06:26.030 [2024-04-26 20:23:44.356465] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:26.030 [2024-04-26 20:23:44.356545] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3854451 ] 00:06:26.292 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.292 [2024-04-26 20:23:44.418077] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.292 [2024-04-26 20:23:44.483811] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.679 20:23:45 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:27.679 00:06:27.679 SPDK Configuration: 00:06:27.679 Core mask: 0x1 00:06:27.679 00:06:27.679 Accel Perf Configuration: 00:06:27.679 Workload Type: decompress 00:06:27.679 Transfer size: 111250 bytes 00:06:27.679 Vector count 1 00:06:27.679 Module: software 00:06:27.679 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:27.679 Queue depth: 32 00:06:27.679 Allocate depth: 32 00:06:27.679 # threads/core: 2 00:06:27.679 Run time: 1 seconds 00:06:27.679 Verify: Yes 00:06:27.679 00:06:27.679 Running for 1 seconds... 00:06:27.679 00:06:27.679 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:27.679 ------------------------------------------------------------------------------------ 00:06:27.679 0,1 2112/s 87 MiB/s 0 0 00:06:27.679 0,0 2048/s 84 MiB/s 0 0 00:06:27.679 ==================================================================================== 00:06:27.679 Total 4160/s 441 MiB/s 0 0' 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:27.679 20:23:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:27.679 20:23:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.679 20:23:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.679 20:23:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.679 20:23:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.679 20:23:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.679 20:23:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.679 20:23:45 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.679 20:23:45 -- accel/accel.sh@42 -- # jq -r . 00:06:27.679 [2024-04-26 20:23:45.670822] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:27.679 [2024-04-26 20:23:45.670900] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3854767 ] 00:06:27.679 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.679 [2024-04-26 20:23:45.731836] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.679 [2024-04-26 20:23:45.794232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val= 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val= 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val= 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val=0x1 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val= 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val= 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val=decompress 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val= 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val=software 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@23 -- # accel_module=software 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val=32 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val=32 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val=2 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val=Yes 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val= 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:27.679 20:23:45 -- accel/accel.sh@21 -- # val= 00:06:27.679 20:23:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # IFS=: 00:06:27.679 20:23:45 -- accel/accel.sh@20 -- # read -r var val 00:06:28.637 20:23:46 -- accel/accel.sh@21 -- # val= 00:06:28.637 20:23:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # IFS=: 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # read -r var val 00:06:28.637 20:23:46 -- accel/accel.sh@21 -- # val= 00:06:28.637 20:23:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # IFS=: 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # read -r var val 00:06:28.637 20:23:46 -- accel/accel.sh@21 -- # val= 00:06:28.637 20:23:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # IFS=: 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # read -r var val 00:06:28.637 20:23:46 -- accel/accel.sh@21 -- # val= 00:06:28.637 20:23:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # IFS=: 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # read -r var val 00:06:28.637 20:23:46 -- accel/accel.sh@21 -- # val= 00:06:28.637 20:23:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # IFS=: 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # read -r var val 00:06:28.637 20:23:46 -- accel/accel.sh@21 -- # val= 00:06:28.637 20:23:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # IFS=: 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # read -r var val 00:06:28.637 20:23:46 -- accel/accel.sh@21 -- # val= 00:06:28.637 20:23:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # IFS=: 00:06:28.637 20:23:46 -- accel/accel.sh@20 -- # read -r var val 00:06:28.637 20:23:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:28.637 20:23:46 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:28.637 20:23:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:28.637 00:06:28.637 real 0m2.625s 00:06:28.637 user 0m2.444s 00:06:28.637 sys 0m0.188s 00:06:28.637 20:23:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:28.637 20:23:46 -- common/autotest_common.sh@10 -- # set +x 00:06:28.637 ************************************ 00:06:28.637 END TEST accel_deomp_full_mthread 00:06:28.637 ************************************ 00:06:28.944 20:23:46 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:28.944 20:23:46 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:28.944 20:23:46 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:28.944 20:23:46 -- accel/accel.sh@129 -- # build_accel_config 00:06:28.944 20:23:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:28.944 20:23:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:28.944 20:23:46 -- common/autotest_common.sh@10 -- # set +x 00:06:28.944 20:23:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:28.944 20:23:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:28.944 20:23:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:28.944 20:23:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:28.944 20:23:46 -- accel/accel.sh@41 -- # local IFS=, 00:06:28.944 20:23:46 -- accel/accel.sh@42 -- # jq -r . 00:06:28.944 ************************************ 00:06:28.944 START TEST accel_dif_functional_tests 00:06:28.944 ************************************ 00:06:28.944 20:23:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:28.944 [2024-04-26 20:23:47.043299] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:28.945 [2024-04-26 20:23:47.043355] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3855120 ] 00:06:28.945 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.945 [2024-04-26 20:23:47.101707] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:28.945 [2024-04-26 20:23:47.166583] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:28.945 [2024-04-26 20:23:47.166719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:28.945 [2024-04-26 20:23:47.166722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.945 00:06:28.945 00:06:28.945 CUnit - A unit testing framework for C - Version 2.1-3 00:06:28.945 http://cunit.sourceforge.net/ 00:06:28.945 00:06:28.945 00:06:28.945 Suite: accel_dif 00:06:28.945 Test: verify: DIF generated, GUARD check ...passed 00:06:28.945 Test: verify: DIF generated, APPTAG check ...passed 00:06:28.945 Test: verify: DIF generated, REFTAG check ...passed 00:06:28.945 Test: verify: DIF not generated, GUARD check ...[2024-04-26 20:23:47.221865] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:28.945 [2024-04-26 20:23:47.221901] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:28.945 passed 00:06:28.945 Test: verify: DIF not generated, APPTAG check ...[2024-04-26 20:23:47.221931] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:28.945 [2024-04-26 20:23:47.221946] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:28.945 passed 00:06:28.945 Test: verify: DIF not generated, REFTAG check ...[2024-04-26 20:23:47.221963] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:28.945 [2024-04-26 20:23:47.221976] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:28.945 passed 00:06:28.945 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:28.945 Test: verify: APPTAG incorrect, APPTAG check ...[2024-04-26 20:23:47.222020] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:28.945 passed 00:06:28.945 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:28.945 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:28.945 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:28.945 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-04-26 20:23:47.222133] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:28.945 passed 00:06:28.945 Test: generate copy: DIF generated, GUARD check ...passed 00:06:28.945 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:28.945 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:28.945 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:28.945 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:28.945 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:28.945 Test: generate copy: iovecs-len validate ...[2024-04-26 20:23:47.222325] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:28.945 passed 00:06:28.945 Test: generate copy: buffer alignment validate ...passed 00:06:28.945 00:06:28.945 Run Summary: Type Total Ran Passed Failed Inactive 00:06:28.945 suites 1 1 n/a 0 0 00:06:28.945 tests 20 20 20 0 0 00:06:28.945 asserts 204 204 204 0 n/a 00:06:28.945 00:06:28.945 Elapsed time = 0.002 seconds 00:06:29.253 00:06:29.253 real 0m0.339s 00:06:29.253 user 0m0.480s 00:06:29.253 sys 0m0.122s 00:06:29.253 20:23:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:29.253 20:23:47 -- common/autotest_common.sh@10 -- # set +x 00:06:29.253 ************************************ 00:06:29.253 END TEST accel_dif_functional_tests 00:06:29.253 ************************************ 00:06:29.253 00:06:29.253 real 0m54.733s 00:06:29.253 user 1m3.300s 00:06:29.253 sys 0m5.613s 00:06:29.253 20:23:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:29.253 20:23:47 -- common/autotest_common.sh@10 -- # set +x 00:06:29.253 ************************************ 00:06:29.253 END TEST accel 00:06:29.253 ************************************ 00:06:29.253 20:23:47 -- spdk/autotest.sh@190 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:29.253 20:23:47 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:29.253 20:23:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:29.253 20:23:47 -- common/autotest_common.sh@10 -- # set +x 00:06:29.253 ************************************ 00:06:29.253 START TEST accel_rpc 00:06:29.253 ************************************ 00:06:29.253 20:23:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:29.253 * Looking for test storage... 00:06:29.253 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:29.253 20:23:47 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:29.253 20:23:47 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3855189 00:06:29.253 20:23:47 -- accel/accel_rpc.sh@15 -- # waitforlisten 3855189 00:06:29.253 20:23:47 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:29.253 20:23:47 -- common/autotest_common.sh@819 -- # '[' -z 3855189 ']' 00:06:29.253 20:23:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:29.253 20:23:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:29.253 20:23:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:29.253 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:29.253 20:23:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:29.253 20:23:47 -- common/autotest_common.sh@10 -- # set +x 00:06:29.253 [2024-04-26 20:23:47.561332] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:29.253 [2024-04-26 20:23:47.561388] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3855189 ] 00:06:29.253 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.513 [2024-04-26 20:23:47.619861] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.513 [2024-04-26 20:23:47.682272] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:29.513 [2024-04-26 20:23:47.682413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.085 20:23:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:30.085 20:23:48 -- common/autotest_common.sh@852 -- # return 0 00:06:30.085 20:23:48 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:30.085 20:23:48 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:30.085 20:23:48 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:30.085 20:23:48 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:30.085 20:23:48 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:30.085 20:23:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:30.085 20:23:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:30.085 20:23:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.085 ************************************ 00:06:30.085 START TEST accel_assign_opcode 00:06:30.085 ************************************ 00:06:30.085 20:23:48 -- common/autotest_common.sh@1104 -- # accel_assign_opcode_test_suite 00:06:30.085 20:23:48 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:30.085 20:23:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:30.085 20:23:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.085 [2024-04-26 20:23:48.308227] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:30.085 20:23:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:30.085 20:23:48 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:30.085 20:23:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:30.085 20:23:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.085 [2024-04-26 20:23:48.316239] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:30.085 20:23:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:30.085 20:23:48 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:30.085 20:23:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:30.085 20:23:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.347 20:23:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:30.347 20:23:48 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:30.347 20:23:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:30.347 20:23:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.347 20:23:48 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:30.347 20:23:48 -- accel/accel_rpc.sh@42 -- # grep software 00:06:30.347 20:23:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:30.347 software 00:06:30.347 00:06:30.347 real 0m0.203s 00:06:30.347 user 0m0.037s 00:06:30.347 sys 0m0.014s 00:06:30.347 20:23:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:30.347 20:23:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.347 ************************************ 00:06:30.347 END TEST accel_assign_opcode 00:06:30.347 ************************************ 00:06:30.347 20:23:48 -- accel/accel_rpc.sh@55 -- # killprocess 3855189 00:06:30.347 20:23:48 -- common/autotest_common.sh@926 -- # '[' -z 3855189 ']' 00:06:30.347 20:23:48 -- common/autotest_common.sh@930 -- # kill -0 3855189 00:06:30.347 20:23:48 -- common/autotest_common.sh@931 -- # uname 00:06:30.347 20:23:48 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:30.347 20:23:48 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3855189 00:06:30.347 20:23:48 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:30.347 20:23:48 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:30.347 20:23:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3855189' 00:06:30.347 killing process with pid 3855189 00:06:30.347 20:23:48 -- common/autotest_common.sh@945 -- # kill 3855189 00:06:30.347 20:23:48 -- common/autotest_common.sh@950 -- # wait 3855189 00:06:30.609 00:06:30.609 real 0m1.379s 00:06:30.609 user 0m1.425s 00:06:30.609 sys 0m0.366s 00:06:30.609 20:23:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:30.609 20:23:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.609 ************************************ 00:06:30.609 END TEST accel_rpc 00:06:30.609 ************************************ 00:06:30.609 20:23:48 -- spdk/autotest.sh@191 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:30.609 20:23:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:30.609 20:23:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:30.609 20:23:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.609 ************************************ 00:06:30.609 START TEST app_cmdline 00:06:30.609 ************************************ 00:06:30.609 20:23:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:30.609 * Looking for test storage... 00:06:30.609 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:30.609 20:23:48 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:30.609 20:23:48 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3855591 00:06:30.609 20:23:48 -- app/cmdline.sh@18 -- # waitforlisten 3855591 00:06:30.609 20:23:48 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:30.609 20:23:48 -- common/autotest_common.sh@819 -- # '[' -z 3855591 ']' 00:06:30.609 20:23:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:30.609 20:23:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:30.609 20:23:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:30.609 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:30.609 20:23:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:30.609 20:23:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.870 [2024-04-26 20:23:48.986673] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:06:30.870 [2024-04-26 20:23:48.986736] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3855591 ] 00:06:30.870 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.870 [2024-04-26 20:23:49.047624] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.870 [2024-04-26 20:23:49.112985] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:30.870 [2024-04-26 20:23:49.113112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.443 20:23:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:31.443 20:23:49 -- common/autotest_common.sh@852 -- # return 0 00:06:31.443 20:23:49 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:31.704 { 00:06:31.704 "version": "SPDK v24.01.1-pre git sha1 36faa8c31", 00:06:31.704 "fields": { 00:06:31.704 "major": 24, 00:06:31.704 "minor": 1, 00:06:31.704 "patch": 1, 00:06:31.704 "suffix": "-pre", 00:06:31.704 "commit": "36faa8c31" 00:06:31.704 } 00:06:31.704 } 00:06:31.704 20:23:49 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:31.704 20:23:49 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:31.704 20:23:49 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:31.704 20:23:49 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:31.704 20:23:49 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:31.704 20:23:49 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:31.704 20:23:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:31.704 20:23:49 -- app/cmdline.sh@26 -- # sort 00:06:31.704 20:23:49 -- common/autotest_common.sh@10 -- # set +x 00:06:31.704 20:23:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:31.704 20:23:49 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:31.704 20:23:49 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:31.704 20:23:49 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:31.704 20:23:49 -- common/autotest_common.sh@640 -- # local es=0 00:06:31.704 20:23:49 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:31.705 20:23:49 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:31.705 20:23:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:31.705 20:23:49 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:31.705 20:23:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:31.705 20:23:49 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:31.705 20:23:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:31.705 20:23:49 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:31.705 20:23:49 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:31.705 20:23:49 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:31.965 request: 00:06:31.965 { 00:06:31.965 "method": "env_dpdk_get_mem_stats", 00:06:31.965 "req_id": 1 00:06:31.965 } 00:06:31.965 Got JSON-RPC error response 00:06:31.965 response: 00:06:31.965 { 00:06:31.965 "code": -32601, 00:06:31.965 "message": "Method not found" 00:06:31.965 } 00:06:31.965 20:23:50 -- common/autotest_common.sh@643 -- # es=1 00:06:31.965 20:23:50 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:31.965 20:23:50 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:31.965 20:23:50 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:31.965 20:23:50 -- app/cmdline.sh@1 -- # killprocess 3855591 00:06:31.965 20:23:50 -- common/autotest_common.sh@926 -- # '[' -z 3855591 ']' 00:06:31.965 20:23:50 -- common/autotest_common.sh@930 -- # kill -0 3855591 00:06:31.965 20:23:50 -- common/autotest_common.sh@931 -- # uname 00:06:31.965 20:23:50 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:31.965 20:23:50 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3855591 00:06:31.965 20:23:50 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:31.965 20:23:50 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:31.965 20:23:50 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3855591' 00:06:31.965 killing process with pid 3855591 00:06:31.965 20:23:50 -- common/autotest_common.sh@945 -- # kill 3855591 00:06:31.965 20:23:50 -- common/autotest_common.sh@950 -- # wait 3855591 00:06:32.227 00:06:32.227 real 0m1.505s 00:06:32.227 user 0m1.790s 00:06:32.227 sys 0m0.393s 00:06:32.227 20:23:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:32.227 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:06:32.227 ************************************ 00:06:32.227 END TEST app_cmdline 00:06:32.227 ************************************ 00:06:32.227 20:23:50 -- spdk/autotest.sh@192 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:32.227 20:23:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:32.227 20:23:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:32.227 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:06:32.227 ************************************ 00:06:32.227 START TEST version 00:06:32.227 ************************************ 00:06:32.227 20:23:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:32.227 * Looking for test storage... 00:06:32.227 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:32.227 20:23:50 -- app/version.sh@17 -- # get_header_version major 00:06:32.227 20:23:50 -- app/version.sh@14 -- # cut -f2 00:06:32.227 20:23:50 -- app/version.sh@14 -- # tr -d '"' 00:06:32.227 20:23:50 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:32.227 20:23:50 -- app/version.sh@17 -- # major=24 00:06:32.227 20:23:50 -- app/version.sh@18 -- # get_header_version minor 00:06:32.227 20:23:50 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:32.227 20:23:50 -- app/version.sh@14 -- # cut -f2 00:06:32.227 20:23:50 -- app/version.sh@14 -- # tr -d '"' 00:06:32.227 20:23:50 -- app/version.sh@18 -- # minor=1 00:06:32.227 20:23:50 -- app/version.sh@19 -- # get_header_version patch 00:06:32.227 20:23:50 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:32.227 20:23:50 -- app/version.sh@14 -- # cut -f2 00:06:32.227 20:23:50 -- app/version.sh@14 -- # tr -d '"' 00:06:32.227 20:23:50 -- app/version.sh@19 -- # patch=1 00:06:32.227 20:23:50 -- app/version.sh@20 -- # get_header_version suffix 00:06:32.227 20:23:50 -- app/version.sh@14 -- # cut -f2 00:06:32.227 20:23:50 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:32.227 20:23:50 -- app/version.sh@14 -- # tr -d '"' 00:06:32.227 20:23:50 -- app/version.sh@20 -- # suffix=-pre 00:06:32.227 20:23:50 -- app/version.sh@22 -- # version=24.1 00:06:32.227 20:23:50 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:32.227 20:23:50 -- app/version.sh@25 -- # version=24.1.1 00:06:32.227 20:23:50 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:32.227 20:23:50 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:32.227 20:23:50 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:32.227 20:23:50 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:32.227 20:23:50 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:32.227 00:06:32.227 real 0m0.166s 00:06:32.227 user 0m0.092s 00:06:32.227 sys 0m0.099s 00:06:32.227 20:23:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:32.227 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:06:32.227 ************************************ 00:06:32.227 END TEST version 00:06:32.227 ************************************ 00:06:32.488 20:23:50 -- spdk/autotest.sh@194 -- # '[' 0 -eq 1 ']' 00:06:32.488 20:23:50 -- spdk/autotest.sh@204 -- # uname -s 00:06:32.488 20:23:50 -- spdk/autotest.sh@204 -- # [[ Linux == Linux ]] 00:06:32.488 20:23:50 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:06:32.488 20:23:50 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:06:32.488 20:23:50 -- spdk/autotest.sh@217 -- # '[' 0 -eq 1 ']' 00:06:32.488 20:23:50 -- spdk/autotest.sh@264 -- # '[' 0 -eq 1 ']' 00:06:32.488 20:23:50 -- spdk/autotest.sh@268 -- # timing_exit lib 00:06:32.488 20:23:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:32.488 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:06:32.488 20:23:50 -- spdk/autotest.sh@270 -- # '[' 0 -eq 1 ']' 00:06:32.488 20:23:50 -- spdk/autotest.sh@278 -- # '[' 0 -eq 1 ']' 00:06:32.488 20:23:50 -- spdk/autotest.sh@287 -- # '[' 1 -eq 1 ']' 00:06:32.488 20:23:50 -- spdk/autotest.sh@288 -- # export NET_TYPE 00:06:32.488 20:23:50 -- spdk/autotest.sh@291 -- # '[' tcp = rdma ']' 00:06:32.488 20:23:50 -- spdk/autotest.sh@294 -- # '[' tcp = tcp ']' 00:06:32.488 20:23:50 -- spdk/autotest.sh@295 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:32.488 20:23:50 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:32.488 20:23:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:32.488 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:06:32.488 ************************************ 00:06:32.488 START TEST nvmf_tcp 00:06:32.488 ************************************ 00:06:32.488 20:23:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:32.488 * Looking for test storage... 00:06:32.488 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:32.488 20:23:50 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:32.488 20:23:50 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:32.488 20:23:50 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:32.488 20:23:50 -- nvmf/common.sh@7 -- # uname -s 00:06:32.488 20:23:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:32.488 20:23:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:32.488 20:23:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:32.488 20:23:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:32.488 20:23:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:32.488 20:23:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:32.488 20:23:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:32.488 20:23:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:32.488 20:23:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:32.488 20:23:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:32.488 20:23:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:06:32.488 20:23:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:06:32.488 20:23:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:32.488 20:23:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:32.488 20:23:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:32.488 20:23:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:32.488 20:23:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:32.488 20:23:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:32.488 20:23:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:32.489 20:23:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.489 20:23:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.489 20:23:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.489 20:23:50 -- paths/export.sh@5 -- # export PATH 00:06:32.489 20:23:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.489 20:23:50 -- nvmf/common.sh@46 -- # : 0 00:06:32.489 20:23:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:32.489 20:23:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:32.489 20:23:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:32.489 20:23:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:32.489 20:23:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:32.489 20:23:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:32.489 20:23:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:32.489 20:23:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:32.489 20:23:50 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:32.489 20:23:50 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:32.489 20:23:50 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:32.489 20:23:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:32.489 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:06:32.489 20:23:50 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:32.489 20:23:50 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:32.489 20:23:50 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:32.489 20:23:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:32.489 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:06:32.489 ************************************ 00:06:32.489 START TEST nvmf_example 00:06:32.489 ************************************ 00:06:32.489 20:23:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:32.751 * Looking for test storage... 00:06:32.751 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:32.751 20:23:50 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:32.751 20:23:50 -- nvmf/common.sh@7 -- # uname -s 00:06:32.751 20:23:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:32.751 20:23:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:32.751 20:23:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:32.751 20:23:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:32.751 20:23:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:32.751 20:23:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:32.751 20:23:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:32.751 20:23:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:32.751 20:23:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:32.751 20:23:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:32.751 20:23:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:06:32.751 20:23:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:06:32.751 20:23:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:32.751 20:23:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:32.751 20:23:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:32.751 20:23:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:32.751 20:23:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:32.751 20:23:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:32.751 20:23:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:32.751 20:23:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.751 20:23:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.751 20:23:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.751 20:23:50 -- paths/export.sh@5 -- # export PATH 00:06:32.751 20:23:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.751 20:23:50 -- nvmf/common.sh@46 -- # : 0 00:06:32.751 20:23:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:32.751 20:23:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:32.751 20:23:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:32.751 20:23:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:32.751 20:23:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:32.751 20:23:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:32.751 20:23:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:32.751 20:23:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:32.751 20:23:50 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:32.751 20:23:50 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:32.751 20:23:50 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:32.751 20:23:50 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:32.751 20:23:50 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:32.751 20:23:50 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:32.751 20:23:50 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:32.751 20:23:50 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:32.751 20:23:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:32.752 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:06:32.752 20:23:50 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:32.752 20:23:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:32.752 20:23:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:32.752 20:23:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:32.752 20:23:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:32.752 20:23:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:32.752 20:23:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:32.752 20:23:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:32.752 20:23:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:32.752 20:23:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:32.752 20:23:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:32.752 20:23:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:32.752 20:23:50 -- common/autotest_common.sh@10 -- # set +x 00:06:39.344 20:23:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:39.344 20:23:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:39.344 20:23:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:39.344 20:23:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:39.344 20:23:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:39.344 20:23:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:39.344 20:23:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:39.344 20:23:57 -- nvmf/common.sh@294 -- # net_devs=() 00:06:39.344 20:23:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:39.344 20:23:57 -- nvmf/common.sh@295 -- # e810=() 00:06:39.344 20:23:57 -- nvmf/common.sh@295 -- # local -ga e810 00:06:39.344 20:23:57 -- nvmf/common.sh@296 -- # x722=() 00:06:39.344 20:23:57 -- nvmf/common.sh@296 -- # local -ga x722 00:06:39.344 20:23:57 -- nvmf/common.sh@297 -- # mlx=() 00:06:39.344 20:23:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:39.345 20:23:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:39.345 20:23:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:39.345 20:23:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:39.345 20:23:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:39.345 20:23:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:39.345 20:23:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:39.345 20:23:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:39.345 20:23:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:39.345 20:23:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:39.345 20:23:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:39.345 20:23:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:39.345 20:23:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:39.345 20:23:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:39.345 20:23:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:39.345 20:23:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:39.345 20:23:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:06:39.345 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:06:39.345 20:23:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:39.345 20:23:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:06:39.345 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:06:39.345 20:23:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:39.345 20:23:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:39.345 20:23:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:39.345 20:23:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:39.345 20:23:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:39.345 20:23:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:06:39.345 Found net devices under 0000:4b:00.0: cvl_0_0 00:06:39.345 20:23:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:39.345 20:23:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:39.345 20:23:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:39.345 20:23:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:39.345 20:23:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:39.345 20:23:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:06:39.345 Found net devices under 0000:4b:00.1: cvl_0_1 00:06:39.345 20:23:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:39.345 20:23:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:39.345 20:23:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:39.345 20:23:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:39.345 20:23:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:39.345 20:23:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:39.345 20:23:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:39.345 20:23:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:39.345 20:23:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:39.345 20:23:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:39.345 20:23:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:39.345 20:23:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:39.345 20:23:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:39.345 20:23:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:39.345 20:23:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:39.345 20:23:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:39.345 20:23:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:39.345 20:23:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:39.607 20:23:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:39.607 20:23:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:39.607 20:23:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:39.607 20:23:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:39.607 20:23:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:39.607 20:23:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:39.607 20:23:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:39.607 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:39.607 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.706 ms 00:06:39.607 00:06:39.607 --- 10.0.0.2 ping statistics --- 00:06:39.607 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:39.607 rtt min/avg/max/mdev = 0.706/0.706/0.706/0.000 ms 00:06:39.607 20:23:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:39.607 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:39.607 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.496 ms 00:06:39.607 00:06:39.607 --- 10.0.0.1 ping statistics --- 00:06:39.607 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:39.607 rtt min/avg/max/mdev = 0.496/0.496/0.496/0.000 ms 00:06:39.607 20:23:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:39.607 20:23:57 -- nvmf/common.sh@410 -- # return 0 00:06:39.607 20:23:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:39.607 20:23:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:39.607 20:23:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:39.607 20:23:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:39.607 20:23:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:39.607 20:23:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:39.607 20:23:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:39.607 20:23:57 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:39.607 20:23:57 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:39.607 20:23:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:39.607 20:23:57 -- common/autotest_common.sh@10 -- # set +x 00:06:39.607 20:23:57 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:39.607 20:23:57 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:39.607 20:23:57 -- target/nvmf_example.sh@34 -- # nvmfpid=3859708 00:06:39.607 20:23:57 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:39.607 20:23:57 -- target/nvmf_example.sh@36 -- # waitforlisten 3859708 00:06:39.607 20:23:57 -- common/autotest_common.sh@819 -- # '[' -z 3859708 ']' 00:06:39.607 20:23:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.607 20:23:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:39.607 20:23:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.607 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.607 20:23:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:39.607 20:23:57 -- common/autotest_common.sh@10 -- # set +x 00:06:39.607 20:23:57 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:39.868 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.439 20:23:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:40.439 20:23:58 -- common/autotest_common.sh@852 -- # return 0 00:06:40.439 20:23:58 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:40.439 20:23:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:40.439 20:23:58 -- common/autotest_common.sh@10 -- # set +x 00:06:40.439 20:23:58 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:40.439 20:23:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:40.439 20:23:58 -- common/autotest_common.sh@10 -- # set +x 00:06:40.699 20:23:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:40.699 20:23:58 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:40.699 20:23:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:40.699 20:23:58 -- common/autotest_common.sh@10 -- # set +x 00:06:40.699 20:23:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:40.699 20:23:58 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:40.699 20:23:58 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:40.699 20:23:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:40.699 20:23:58 -- common/autotest_common.sh@10 -- # set +x 00:06:40.699 20:23:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:40.699 20:23:58 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:40.699 20:23:58 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:40.699 20:23:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:40.699 20:23:58 -- common/autotest_common.sh@10 -- # set +x 00:06:40.699 20:23:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:40.699 20:23:58 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:40.699 20:23:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:40.699 20:23:58 -- common/autotest_common.sh@10 -- # set +x 00:06:40.699 20:23:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:40.699 20:23:58 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:40.699 20:23:58 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:40.699 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.952 Initializing NVMe Controllers 00:06:52.952 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:52.952 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:52.952 Initialization complete. Launching workers. 00:06:52.952 ======================================================== 00:06:52.952 Latency(us) 00:06:52.952 Device Information : IOPS MiB/s Average min max 00:06:52.952 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 14202.30 55.48 4508.34 899.89 19146.89 00:06:52.952 ======================================================== 00:06:52.952 Total : 14202.30 55.48 4508.34 899.89 19146.89 00:06:52.952 00:06:52.952 20:24:09 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:52.952 20:24:09 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:52.952 20:24:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:52.952 20:24:09 -- nvmf/common.sh@116 -- # sync 00:06:52.952 20:24:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:52.952 20:24:09 -- nvmf/common.sh@119 -- # set +e 00:06:52.952 20:24:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:52.952 20:24:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:52.952 rmmod nvme_tcp 00:06:52.952 rmmod nvme_fabrics 00:06:52.952 rmmod nvme_keyring 00:06:52.952 20:24:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:52.952 20:24:09 -- nvmf/common.sh@123 -- # set -e 00:06:52.952 20:24:09 -- nvmf/common.sh@124 -- # return 0 00:06:52.952 20:24:09 -- nvmf/common.sh@477 -- # '[' -n 3859708 ']' 00:06:52.952 20:24:09 -- nvmf/common.sh@478 -- # killprocess 3859708 00:06:52.952 20:24:09 -- common/autotest_common.sh@926 -- # '[' -z 3859708 ']' 00:06:52.952 20:24:09 -- common/autotest_common.sh@930 -- # kill -0 3859708 00:06:52.952 20:24:09 -- common/autotest_common.sh@931 -- # uname 00:06:52.952 20:24:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:52.952 20:24:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3859708 00:06:52.952 20:24:09 -- common/autotest_common.sh@932 -- # process_name=nvmf 00:06:52.952 20:24:09 -- common/autotest_common.sh@936 -- # '[' nvmf = sudo ']' 00:06:52.952 20:24:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3859708' 00:06:52.952 killing process with pid 3859708 00:06:52.952 20:24:09 -- common/autotest_common.sh@945 -- # kill 3859708 00:06:52.952 20:24:09 -- common/autotest_common.sh@950 -- # wait 3859708 00:06:52.952 nvmf threads initialize successfully 00:06:52.952 bdev subsystem init successfully 00:06:52.952 created a nvmf target service 00:06:52.952 create targets's poll groups done 00:06:52.952 all subsystems of target started 00:06:52.952 nvmf target is running 00:06:52.952 all subsystems of target stopped 00:06:52.952 destroy targets's poll groups done 00:06:52.952 destroyed the nvmf target service 00:06:52.952 bdev subsystem finish successfully 00:06:52.952 nvmf threads destroy successfully 00:06:52.952 20:24:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:52.952 20:24:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:52.952 20:24:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:52.952 20:24:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:52.952 20:24:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:52.952 20:24:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:52.952 20:24:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:52.952 20:24:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:53.214 20:24:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:53.214 20:24:11 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:53.214 20:24:11 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:53.214 20:24:11 -- common/autotest_common.sh@10 -- # set +x 00:06:53.214 00:06:53.214 real 0m20.705s 00:06:53.214 user 0m46.466s 00:06:53.214 sys 0m6.280s 00:06:53.214 20:24:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:53.214 20:24:11 -- common/autotest_common.sh@10 -- # set +x 00:06:53.214 ************************************ 00:06:53.214 END TEST nvmf_example 00:06:53.214 ************************************ 00:06:53.214 20:24:11 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:53.214 20:24:11 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:53.214 20:24:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:53.214 20:24:11 -- common/autotest_common.sh@10 -- # set +x 00:06:53.214 ************************************ 00:06:53.214 START TEST nvmf_filesystem 00:06:53.214 ************************************ 00:06:53.214 20:24:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:53.479 * Looking for test storage... 00:06:53.479 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:53.479 20:24:11 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:53.479 20:24:11 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:53.479 20:24:11 -- common/autotest_common.sh@34 -- # set -e 00:06:53.479 20:24:11 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:53.479 20:24:11 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:53.479 20:24:11 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:53.479 20:24:11 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:53.479 20:24:11 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:53.479 20:24:11 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:53.479 20:24:11 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:53.479 20:24:11 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:53.479 20:24:11 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:53.479 20:24:11 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:53.479 20:24:11 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:53.479 20:24:11 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:53.479 20:24:11 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:53.479 20:24:11 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:53.479 20:24:11 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:53.479 20:24:11 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:53.479 20:24:11 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:53.479 20:24:11 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:53.479 20:24:11 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:53.479 20:24:11 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:53.479 20:24:11 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:53.479 20:24:11 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:53.479 20:24:11 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:53.479 20:24:11 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:53.479 20:24:11 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:53.479 20:24:11 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:53.479 20:24:11 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:53.479 20:24:11 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:53.479 20:24:11 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:53.479 20:24:11 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:53.479 20:24:11 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:53.479 20:24:11 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:53.479 20:24:11 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:53.479 20:24:11 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:53.479 20:24:11 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:53.479 20:24:11 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:53.479 20:24:11 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:53.479 20:24:11 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:53.479 20:24:11 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:53.479 20:24:11 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:53.479 20:24:11 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:53.479 20:24:11 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:53.479 20:24:11 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:53.479 20:24:11 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:53.479 20:24:11 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:53.479 20:24:11 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:53.479 20:24:11 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:53.479 20:24:11 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:53.479 20:24:11 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:53.479 20:24:11 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:53.479 20:24:11 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:53.479 20:24:11 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:53.479 20:24:11 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:53.479 20:24:11 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:53.479 20:24:11 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:53.479 20:24:11 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:53.479 20:24:11 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:53.479 20:24:11 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:53.479 20:24:11 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:53.479 20:24:11 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:53.479 20:24:11 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:53.479 20:24:11 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:53.479 20:24:11 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:53.479 20:24:11 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=n 00:06:53.479 20:24:11 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:53.479 20:24:11 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:53.479 20:24:11 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:53.479 20:24:11 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:53.479 20:24:11 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:53.479 20:24:11 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:53.479 20:24:11 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:53.480 20:24:11 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:53.480 20:24:11 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:53.480 20:24:11 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:53.480 20:24:11 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:53.480 20:24:11 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:53.480 20:24:11 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:53.480 20:24:11 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:53.480 20:24:11 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:53.480 20:24:11 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:53.480 20:24:11 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:53.480 20:24:11 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:53.480 20:24:11 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:53.480 20:24:11 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:53.480 20:24:11 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:53.480 20:24:11 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:53.480 20:24:11 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:53.480 20:24:11 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:53.480 20:24:11 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:53.480 20:24:11 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:53.480 20:24:11 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:53.480 20:24:11 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:53.480 20:24:11 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:53.480 20:24:11 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:53.480 20:24:11 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:53.480 20:24:11 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:53.480 20:24:11 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:53.480 20:24:11 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:53.480 20:24:11 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:53.480 #define SPDK_CONFIG_H 00:06:53.480 #define SPDK_CONFIG_APPS 1 00:06:53.480 #define SPDK_CONFIG_ARCH native 00:06:53.480 #undef SPDK_CONFIG_ASAN 00:06:53.480 #undef SPDK_CONFIG_AVAHI 00:06:53.480 #undef SPDK_CONFIG_CET 00:06:53.480 #define SPDK_CONFIG_COVERAGE 1 00:06:53.480 #define SPDK_CONFIG_CROSS_PREFIX 00:06:53.480 #undef SPDK_CONFIG_CRYPTO 00:06:53.480 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:53.480 #undef SPDK_CONFIG_CUSTOMOCF 00:06:53.480 #undef SPDK_CONFIG_DAOS 00:06:53.480 #define SPDK_CONFIG_DAOS_DIR 00:06:53.480 #define SPDK_CONFIG_DEBUG 1 00:06:53.480 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:53.480 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:53.480 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:53.480 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:53.480 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:53.480 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:53.480 #define SPDK_CONFIG_EXAMPLES 1 00:06:53.480 #undef SPDK_CONFIG_FC 00:06:53.480 #define SPDK_CONFIG_FC_PATH 00:06:53.480 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:53.480 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:53.480 #undef SPDK_CONFIG_FUSE 00:06:53.480 #undef SPDK_CONFIG_FUZZER 00:06:53.480 #define SPDK_CONFIG_FUZZER_LIB 00:06:53.480 #undef SPDK_CONFIG_GOLANG 00:06:53.480 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:53.480 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:53.480 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:53.480 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:53.480 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:53.480 #define SPDK_CONFIG_IDXD 1 00:06:53.480 #undef SPDK_CONFIG_IDXD_KERNEL 00:06:53.480 #undef SPDK_CONFIG_IPSEC_MB 00:06:53.480 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:53.480 #define SPDK_CONFIG_ISAL 1 00:06:53.480 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:53.480 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:53.480 #define SPDK_CONFIG_LIBDIR 00:06:53.480 #undef SPDK_CONFIG_LTO 00:06:53.480 #define SPDK_CONFIG_MAX_LCORES 00:06:53.480 #define SPDK_CONFIG_NVME_CUSE 1 00:06:53.480 #undef SPDK_CONFIG_OCF 00:06:53.480 #define SPDK_CONFIG_OCF_PATH 00:06:53.480 #define SPDK_CONFIG_OPENSSL_PATH 00:06:53.480 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:53.480 #undef SPDK_CONFIG_PGO_USE 00:06:53.480 #define SPDK_CONFIG_PREFIX /usr/local 00:06:53.480 #undef SPDK_CONFIG_RAID5F 00:06:53.480 #undef SPDK_CONFIG_RBD 00:06:53.480 #define SPDK_CONFIG_RDMA 1 00:06:53.480 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:53.480 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:53.480 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:53.480 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:53.480 #define SPDK_CONFIG_SHARED 1 00:06:53.480 #undef SPDK_CONFIG_SMA 00:06:53.480 #define SPDK_CONFIG_TESTS 1 00:06:53.480 #undef SPDK_CONFIG_TSAN 00:06:53.480 #define SPDK_CONFIG_UBLK 1 00:06:53.480 #define SPDK_CONFIG_UBSAN 1 00:06:53.480 #undef SPDK_CONFIG_UNIT_TESTS 00:06:53.480 #undef SPDK_CONFIG_URING 00:06:53.480 #define SPDK_CONFIG_URING_PATH 00:06:53.480 #undef SPDK_CONFIG_URING_ZNS 00:06:53.480 #undef SPDK_CONFIG_USDT 00:06:53.480 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:53.480 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:53.480 #undef SPDK_CONFIG_VFIO_USER 00:06:53.480 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:53.480 #define SPDK_CONFIG_VHOST 1 00:06:53.480 #define SPDK_CONFIG_VIRTIO 1 00:06:53.480 #undef SPDK_CONFIG_VTUNE 00:06:53.480 #define SPDK_CONFIG_VTUNE_DIR 00:06:53.480 #define SPDK_CONFIG_WERROR 1 00:06:53.480 #define SPDK_CONFIG_WPDK_DIR 00:06:53.480 #undef SPDK_CONFIG_XNVME 00:06:53.480 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:53.480 20:24:11 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:53.480 20:24:11 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:53.480 20:24:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:53.480 20:24:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:53.480 20:24:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:53.480 20:24:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:53.480 20:24:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:53.480 20:24:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:53.480 20:24:11 -- paths/export.sh@5 -- # export PATH 00:06:53.480 20:24:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:53.480 20:24:11 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:53.480 20:24:11 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:53.480 20:24:11 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:53.480 20:24:11 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:53.480 20:24:11 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:53.480 20:24:11 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:53.480 20:24:11 -- pm/common@16 -- # TEST_TAG=N/A 00:06:53.480 20:24:11 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:53.480 20:24:11 -- common/autotest_common.sh@52 -- # : 1 00:06:53.480 20:24:11 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:53.480 20:24:11 -- common/autotest_common.sh@56 -- # : 0 00:06:53.480 20:24:11 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:53.480 20:24:11 -- common/autotest_common.sh@58 -- # : 0 00:06:53.480 20:24:11 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:53.480 20:24:11 -- common/autotest_common.sh@60 -- # : 1 00:06:53.480 20:24:11 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:53.480 20:24:11 -- common/autotest_common.sh@62 -- # : 0 00:06:53.480 20:24:11 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:53.480 20:24:11 -- common/autotest_common.sh@64 -- # : 00:06:53.480 20:24:11 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:53.480 20:24:11 -- common/autotest_common.sh@66 -- # : 0 00:06:53.480 20:24:11 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:53.480 20:24:11 -- common/autotest_common.sh@68 -- # : 0 00:06:53.480 20:24:11 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:53.480 20:24:11 -- common/autotest_common.sh@70 -- # : 0 00:06:53.480 20:24:11 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:53.480 20:24:11 -- common/autotest_common.sh@72 -- # : 0 00:06:53.480 20:24:11 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:53.481 20:24:11 -- common/autotest_common.sh@74 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:53.481 20:24:11 -- common/autotest_common.sh@76 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:53.481 20:24:11 -- common/autotest_common.sh@78 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:53.481 20:24:11 -- common/autotest_common.sh@80 -- # : 1 00:06:53.481 20:24:11 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:53.481 20:24:11 -- common/autotest_common.sh@82 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:53.481 20:24:11 -- common/autotest_common.sh@84 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:53.481 20:24:11 -- common/autotest_common.sh@86 -- # : 1 00:06:53.481 20:24:11 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:53.481 20:24:11 -- common/autotest_common.sh@88 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:53.481 20:24:11 -- common/autotest_common.sh@90 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:53.481 20:24:11 -- common/autotest_common.sh@92 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:53.481 20:24:11 -- common/autotest_common.sh@94 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:53.481 20:24:11 -- common/autotest_common.sh@96 -- # : tcp 00:06:53.481 20:24:11 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:53.481 20:24:11 -- common/autotest_common.sh@98 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:53.481 20:24:11 -- common/autotest_common.sh@100 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:53.481 20:24:11 -- common/autotest_common.sh@102 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:53.481 20:24:11 -- common/autotest_common.sh@104 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:53.481 20:24:11 -- common/autotest_common.sh@106 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:53.481 20:24:11 -- common/autotest_common.sh@108 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:53.481 20:24:11 -- common/autotest_common.sh@110 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:53.481 20:24:11 -- common/autotest_common.sh@112 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:53.481 20:24:11 -- common/autotest_common.sh@114 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:53.481 20:24:11 -- common/autotest_common.sh@116 -- # : 1 00:06:53.481 20:24:11 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:53.481 20:24:11 -- common/autotest_common.sh@118 -- # : 00:06:53.481 20:24:11 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:53.481 20:24:11 -- common/autotest_common.sh@120 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:53.481 20:24:11 -- common/autotest_common.sh@122 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:53.481 20:24:11 -- common/autotest_common.sh@124 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:53.481 20:24:11 -- common/autotest_common.sh@126 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:53.481 20:24:11 -- common/autotest_common.sh@128 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:53.481 20:24:11 -- common/autotest_common.sh@130 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:53.481 20:24:11 -- common/autotest_common.sh@132 -- # : 00:06:53.481 20:24:11 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:53.481 20:24:11 -- common/autotest_common.sh@134 -- # : true 00:06:53.481 20:24:11 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:53.481 20:24:11 -- common/autotest_common.sh@136 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:53.481 20:24:11 -- common/autotest_common.sh@138 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:53.481 20:24:11 -- common/autotest_common.sh@140 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:53.481 20:24:11 -- common/autotest_common.sh@142 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:53.481 20:24:11 -- common/autotest_common.sh@144 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:53.481 20:24:11 -- common/autotest_common.sh@146 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:53.481 20:24:11 -- common/autotest_common.sh@148 -- # : e810 00:06:53.481 20:24:11 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:53.481 20:24:11 -- common/autotest_common.sh@150 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:53.481 20:24:11 -- common/autotest_common.sh@152 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:53.481 20:24:11 -- common/autotest_common.sh@154 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:53.481 20:24:11 -- common/autotest_common.sh@156 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:53.481 20:24:11 -- common/autotest_common.sh@158 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:53.481 20:24:11 -- common/autotest_common.sh@160 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:53.481 20:24:11 -- common/autotest_common.sh@163 -- # : 00:06:53.481 20:24:11 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:53.481 20:24:11 -- common/autotest_common.sh@165 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:53.481 20:24:11 -- common/autotest_common.sh@167 -- # : 0 00:06:53.481 20:24:11 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:53.481 20:24:11 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:53.481 20:24:11 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:53.481 20:24:11 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:53.481 20:24:11 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:53.481 20:24:11 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:53.481 20:24:11 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:53.481 20:24:11 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:53.481 20:24:11 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:53.481 20:24:11 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:53.481 20:24:11 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:53.481 20:24:11 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:53.481 20:24:11 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:53.481 20:24:11 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:53.481 20:24:11 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:53.481 20:24:11 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:53.481 20:24:11 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:53.481 20:24:11 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:53.481 20:24:11 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:53.481 20:24:11 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:53.481 20:24:11 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:53.481 20:24:11 -- common/autotest_common.sh@196 -- # cat 00:06:53.481 20:24:11 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:53.481 20:24:11 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:53.481 20:24:11 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:53.481 20:24:11 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:53.481 20:24:11 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:53.482 20:24:11 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:53.482 20:24:11 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:53.482 20:24:11 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:53.482 20:24:11 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:53.482 20:24:11 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:53.482 20:24:11 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:53.482 20:24:11 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:53.482 20:24:11 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:53.482 20:24:11 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:53.482 20:24:11 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:53.482 20:24:11 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:53.482 20:24:11 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:53.482 20:24:11 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:53.482 20:24:11 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:53.482 20:24:11 -- common/autotest_common.sh@248 -- # '[' 0 -eq 0 ']' 00:06:53.482 20:24:11 -- common/autotest_common.sh@249 -- # export valgrind= 00:06:53.482 20:24:11 -- common/autotest_common.sh@249 -- # valgrind= 00:06:53.482 20:24:11 -- common/autotest_common.sh@255 -- # uname -s 00:06:53.482 20:24:11 -- common/autotest_common.sh@255 -- # '[' Linux = Linux ']' 00:06:53.482 20:24:11 -- common/autotest_common.sh@256 -- # HUGEMEM=4096 00:06:53.482 20:24:11 -- common/autotest_common.sh@257 -- # export CLEAR_HUGE=yes 00:06:53.482 20:24:11 -- common/autotest_common.sh@257 -- # CLEAR_HUGE=yes 00:06:53.482 20:24:11 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:06:53.482 20:24:11 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:06:53.482 20:24:11 -- common/autotest_common.sh@265 -- # MAKE=make 00:06:53.482 20:24:11 -- common/autotest_common.sh@266 -- # MAKEFLAGS=-j144 00:06:53.482 20:24:11 -- common/autotest_common.sh@282 -- # export HUGEMEM=4096 00:06:53.482 20:24:11 -- common/autotest_common.sh@282 -- # HUGEMEM=4096 00:06:53.482 20:24:11 -- common/autotest_common.sh@284 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:53.482 20:24:11 -- common/autotest_common.sh@289 -- # NO_HUGE=() 00:06:53.482 20:24:11 -- common/autotest_common.sh@290 -- # TEST_MODE= 00:06:53.482 20:24:11 -- common/autotest_common.sh@291 -- # for i in "$@" 00:06:53.482 20:24:11 -- common/autotest_common.sh@292 -- # case "$i" in 00:06:53.482 20:24:11 -- common/autotest_common.sh@297 -- # TEST_TRANSPORT=tcp 00:06:53.482 20:24:11 -- common/autotest_common.sh@309 -- # [[ -z 3863160 ]] 00:06:53.482 20:24:11 -- common/autotest_common.sh@309 -- # kill -0 3863160 00:06:53.482 20:24:11 -- common/autotest_common.sh@1665 -- # set_test_storage 2147483648 00:06:53.482 20:24:11 -- common/autotest_common.sh@319 -- # [[ -v testdir ]] 00:06:53.482 20:24:11 -- common/autotest_common.sh@321 -- # local requested_size=2147483648 00:06:53.482 20:24:11 -- common/autotest_common.sh@322 -- # local mount target_dir 00:06:53.482 20:24:11 -- common/autotest_common.sh@324 -- # local -A mounts fss sizes avails uses 00:06:53.482 20:24:11 -- common/autotest_common.sh@325 -- # local source fs size avail mount use 00:06:53.482 20:24:11 -- common/autotest_common.sh@327 -- # local storage_fallback storage_candidates 00:06:53.482 20:24:11 -- common/autotest_common.sh@329 -- # mktemp -udt spdk.XXXXXX 00:06:53.482 20:24:11 -- common/autotest_common.sh@329 -- # storage_fallback=/tmp/spdk.MXL6vh 00:06:53.482 20:24:11 -- common/autotest_common.sh@334 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:53.482 20:24:11 -- common/autotest_common.sh@336 -- # [[ -n '' ]] 00:06:53.482 20:24:11 -- common/autotest_common.sh@341 -- # [[ -n '' ]] 00:06:53.482 20:24:11 -- common/autotest_common.sh@346 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.MXL6vh/tests/target /tmp/spdk.MXL6vh 00:06:53.482 20:24:11 -- common/autotest_common.sh@349 -- # requested_size=2214592512 00:06:53.482 20:24:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:53.482 20:24:11 -- common/autotest_common.sh@318 -- # df -T 00:06:53.482 20:24:11 -- common/autotest_common.sh@318 -- # grep -v Filesystem 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_devtmpfs 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=devtmpfs 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=67108864 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=67108864 00:06:53.482 20:24:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=0 00:06:53.482 20:24:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=/dev/pmem0 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=ext2 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=1052192768 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=5284429824 00:06:53.482 20:24:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=4232237056 00:06:53.482 20:24:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_root 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=overlay 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=115759902720 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=129371037696 00:06:53.482 20:24:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=13611134976 00:06:53.482 20:24:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=64682926080 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=64685518848 00:06:53.482 20:24:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=2592768 00:06:53.482 20:24:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=25864511488 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=25874210816 00:06:53.482 20:24:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=9699328 00:06:53.482 20:24:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=efivarfs 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=efivarfs 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=234496 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=507904 00:06:53.482 20:24:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=269312 00:06:53.482 20:24:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=64684478464 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=64685518848 00:06:53.482 20:24:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=1040384 00:06:53.482 20:24:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:53.482 20:24:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=12937097216 00:06:53.482 20:24:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=12937101312 00:06:53.482 20:24:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=4096 00:06:53.482 20:24:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:53.482 20:24:11 -- common/autotest_common.sh@357 -- # printf '* Looking for test storage...\n' 00:06:53.482 * Looking for test storage... 00:06:53.482 20:24:11 -- common/autotest_common.sh@359 -- # local target_space new_size 00:06:53.482 20:24:11 -- common/autotest_common.sh@360 -- # for target_dir in "${storage_candidates[@]}" 00:06:53.482 20:24:11 -- common/autotest_common.sh@363 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:53.482 20:24:11 -- common/autotest_common.sh@363 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:53.482 20:24:11 -- common/autotest_common.sh@363 -- # mount=/ 00:06:53.482 20:24:11 -- common/autotest_common.sh@365 -- # target_space=115759902720 00:06:53.482 20:24:11 -- common/autotest_common.sh@366 -- # (( target_space == 0 || target_space < requested_size )) 00:06:53.482 20:24:11 -- common/autotest_common.sh@369 -- # (( target_space >= requested_size )) 00:06:53.482 20:24:11 -- common/autotest_common.sh@371 -- # [[ overlay == tmpfs ]] 00:06:53.482 20:24:11 -- common/autotest_common.sh@371 -- # [[ overlay == ramfs ]] 00:06:53.482 20:24:11 -- common/autotest_common.sh@371 -- # [[ / == / ]] 00:06:53.482 20:24:11 -- common/autotest_common.sh@372 -- # new_size=15825727488 00:06:53.482 20:24:11 -- common/autotest_common.sh@373 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:53.482 20:24:11 -- common/autotest_common.sh@378 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:53.482 20:24:11 -- common/autotest_common.sh@378 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:53.482 20:24:11 -- common/autotest_common.sh@379 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:53.482 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:53.482 20:24:11 -- common/autotest_common.sh@380 -- # return 0 00:06:53.482 20:24:11 -- common/autotest_common.sh@1667 -- # set -o errtrace 00:06:53.482 20:24:11 -- common/autotest_common.sh@1668 -- # shopt -s extdebug 00:06:53.482 20:24:11 -- common/autotest_common.sh@1669 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:53.482 20:24:11 -- common/autotest_common.sh@1671 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:53.482 20:24:11 -- common/autotest_common.sh@1672 -- # true 00:06:53.482 20:24:11 -- common/autotest_common.sh@1674 -- # xtrace_fd 00:06:53.482 20:24:11 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:53.482 20:24:11 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:53.482 20:24:11 -- common/autotest_common.sh@27 -- # exec 00:06:53.482 20:24:11 -- common/autotest_common.sh@29 -- # exec 00:06:53.482 20:24:11 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:53.482 20:24:11 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:53.483 20:24:11 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:53.483 20:24:11 -- common/autotest_common.sh@18 -- # set -x 00:06:53.483 20:24:11 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:53.483 20:24:11 -- nvmf/common.sh@7 -- # uname -s 00:06:53.483 20:24:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:53.483 20:24:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:53.483 20:24:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:53.483 20:24:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:53.483 20:24:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:53.483 20:24:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:53.483 20:24:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:53.483 20:24:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:53.483 20:24:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:53.483 20:24:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:53.483 20:24:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:06:53.483 20:24:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:06:53.483 20:24:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:53.483 20:24:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:53.483 20:24:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:53.483 20:24:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:53.483 20:24:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:53.483 20:24:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:53.483 20:24:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:53.483 20:24:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:53.483 20:24:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:53.483 20:24:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:53.483 20:24:11 -- paths/export.sh@5 -- # export PATH 00:06:53.483 20:24:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:53.483 20:24:11 -- nvmf/common.sh@46 -- # : 0 00:06:53.483 20:24:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:53.483 20:24:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:53.483 20:24:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:53.483 20:24:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:53.483 20:24:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:53.483 20:24:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:53.483 20:24:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:53.483 20:24:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:53.483 20:24:11 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:53.483 20:24:11 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:53.483 20:24:11 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:53.483 20:24:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:53.483 20:24:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:53.483 20:24:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:53.483 20:24:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:53.483 20:24:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:53.483 20:24:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:53.483 20:24:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:53.483 20:24:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:53.483 20:24:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:53.483 20:24:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:53.483 20:24:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:53.483 20:24:11 -- common/autotest_common.sh@10 -- # set +x 00:07:01.631 20:24:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:01.631 20:24:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:01.631 20:24:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:01.631 20:24:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:01.631 20:24:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:01.631 20:24:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:01.631 20:24:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:01.631 20:24:18 -- nvmf/common.sh@294 -- # net_devs=() 00:07:01.631 20:24:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:01.631 20:24:18 -- nvmf/common.sh@295 -- # e810=() 00:07:01.631 20:24:18 -- nvmf/common.sh@295 -- # local -ga e810 00:07:01.631 20:24:18 -- nvmf/common.sh@296 -- # x722=() 00:07:01.631 20:24:18 -- nvmf/common.sh@296 -- # local -ga x722 00:07:01.631 20:24:18 -- nvmf/common.sh@297 -- # mlx=() 00:07:01.631 20:24:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:01.631 20:24:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:01.631 20:24:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:01.631 20:24:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:01.631 20:24:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:01.631 20:24:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:01.631 20:24:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:01.631 20:24:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:01.631 20:24:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:01.631 20:24:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:01.631 20:24:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:01.631 20:24:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:01.631 20:24:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:01.631 20:24:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:01.631 20:24:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:01.631 20:24:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:01.631 20:24:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:01.631 20:24:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:01.631 20:24:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:01.631 20:24:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:07:01.631 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:07:01.631 20:24:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:01.631 20:24:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:01.631 20:24:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:01.631 20:24:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:01.631 20:24:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:01.631 20:24:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:01.631 20:24:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:07:01.632 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:07:01.632 20:24:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:01.632 20:24:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:01.632 20:24:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:01.632 20:24:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:01.632 20:24:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:01.632 20:24:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:01.632 20:24:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:01.632 20:24:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:01.632 20:24:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:01.632 20:24:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:01.632 20:24:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:01.632 20:24:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:01.632 20:24:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:07:01.632 Found net devices under 0000:4b:00.0: cvl_0_0 00:07:01.632 20:24:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:01.632 20:24:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:01.632 20:24:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:01.632 20:24:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:01.632 20:24:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:01.632 20:24:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:07:01.632 Found net devices under 0000:4b:00.1: cvl_0_1 00:07:01.632 20:24:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:01.632 20:24:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:01.632 20:24:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:01.632 20:24:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:01.632 20:24:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:01.632 20:24:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:01.632 20:24:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:01.632 20:24:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:01.632 20:24:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:01.632 20:24:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:01.632 20:24:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:01.632 20:24:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:01.632 20:24:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:01.632 20:24:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:01.632 20:24:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:01.632 20:24:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:01.632 20:24:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:01.632 20:24:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:01.632 20:24:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:01.632 20:24:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:01.632 20:24:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:01.632 20:24:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:01.632 20:24:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:01.632 20:24:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:01.632 20:24:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:01.632 20:24:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:01.632 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:01.632 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.707 ms 00:07:01.632 00:07:01.632 --- 10.0.0.2 ping statistics --- 00:07:01.632 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:01.632 rtt min/avg/max/mdev = 0.707/0.707/0.707/0.000 ms 00:07:01.632 20:24:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:01.632 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:01.632 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.407 ms 00:07:01.632 00:07:01.632 --- 10.0.0.1 ping statistics --- 00:07:01.632 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:01.632 rtt min/avg/max/mdev = 0.407/0.407/0.407/0.000 ms 00:07:01.632 20:24:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:01.632 20:24:18 -- nvmf/common.sh@410 -- # return 0 00:07:01.632 20:24:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:01.632 20:24:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:01.632 20:24:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:01.632 20:24:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:01.632 20:24:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:01.632 20:24:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:01.632 20:24:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:01.632 20:24:18 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:01.632 20:24:18 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:01.632 20:24:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:01.632 20:24:18 -- common/autotest_common.sh@10 -- # set +x 00:07:01.632 ************************************ 00:07:01.632 START TEST nvmf_filesystem_no_in_capsule 00:07:01.632 ************************************ 00:07:01.632 20:24:18 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 0 00:07:01.632 20:24:18 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:01.632 20:24:18 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:01.632 20:24:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:01.632 20:24:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:01.632 20:24:18 -- common/autotest_common.sh@10 -- # set +x 00:07:01.632 20:24:18 -- nvmf/common.sh@469 -- # nvmfpid=3866999 00:07:01.632 20:24:18 -- nvmf/common.sh@470 -- # waitforlisten 3866999 00:07:01.632 20:24:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:01.632 20:24:18 -- common/autotest_common.sh@819 -- # '[' -z 3866999 ']' 00:07:01.632 20:24:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:01.632 20:24:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:01.632 20:24:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:01.632 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:01.632 20:24:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:01.632 20:24:18 -- common/autotest_common.sh@10 -- # set +x 00:07:01.632 [2024-04-26 20:24:18.921804] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:01.632 [2024-04-26 20:24:18.921864] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:01.632 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.632 [2024-04-26 20:24:18.991570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:01.632 [2024-04-26 20:24:19.066134] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:01.632 [2024-04-26 20:24:19.066255] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:01.632 [2024-04-26 20:24:19.066263] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:01.632 [2024-04-26 20:24:19.066271] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:01.632 [2024-04-26 20:24:19.066374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:01.632 [2024-04-26 20:24:19.066497] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:01.632 [2024-04-26 20:24:19.066623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:01.632 [2024-04-26 20:24:19.066626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.632 20:24:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:01.632 20:24:19 -- common/autotest_common.sh@852 -- # return 0 00:07:01.632 20:24:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:01.632 20:24:19 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:01.632 20:24:19 -- common/autotest_common.sh@10 -- # set +x 00:07:01.632 20:24:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:01.632 20:24:19 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:01.632 20:24:19 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:01.632 20:24:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:01.632 20:24:19 -- common/autotest_common.sh@10 -- # set +x 00:07:01.632 [2024-04-26 20:24:19.750506] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:01.632 20:24:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:01.632 20:24:19 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:01.632 20:24:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:01.632 20:24:19 -- common/autotest_common.sh@10 -- # set +x 00:07:01.632 Malloc1 00:07:01.632 20:24:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:01.632 20:24:19 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:01.632 20:24:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:01.632 20:24:19 -- common/autotest_common.sh@10 -- # set +x 00:07:01.632 20:24:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:01.632 20:24:19 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:01.632 20:24:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:01.632 20:24:19 -- common/autotest_common.sh@10 -- # set +x 00:07:01.632 20:24:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:01.632 20:24:19 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:01.632 20:24:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:01.632 20:24:19 -- common/autotest_common.sh@10 -- # set +x 00:07:01.632 [2024-04-26 20:24:19.879551] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:01.632 20:24:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:01.632 20:24:19 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:01.632 20:24:19 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:07:01.632 20:24:19 -- common/autotest_common.sh@1358 -- # local bdev_info 00:07:01.632 20:24:19 -- common/autotest_common.sh@1359 -- # local bs 00:07:01.632 20:24:19 -- common/autotest_common.sh@1360 -- # local nb 00:07:01.632 20:24:19 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:01.632 20:24:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:01.632 20:24:19 -- common/autotest_common.sh@10 -- # set +x 00:07:01.632 20:24:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:01.632 20:24:19 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:07:01.632 { 00:07:01.632 "name": "Malloc1", 00:07:01.632 "aliases": [ 00:07:01.632 "ed88401b-27cc-4c49-9975-1021460cd0e6" 00:07:01.632 ], 00:07:01.632 "product_name": "Malloc disk", 00:07:01.632 "block_size": 512, 00:07:01.632 "num_blocks": 1048576, 00:07:01.632 "uuid": "ed88401b-27cc-4c49-9975-1021460cd0e6", 00:07:01.632 "assigned_rate_limits": { 00:07:01.632 "rw_ios_per_sec": 0, 00:07:01.632 "rw_mbytes_per_sec": 0, 00:07:01.632 "r_mbytes_per_sec": 0, 00:07:01.632 "w_mbytes_per_sec": 0 00:07:01.632 }, 00:07:01.632 "claimed": true, 00:07:01.632 "claim_type": "exclusive_write", 00:07:01.632 "zoned": false, 00:07:01.632 "supported_io_types": { 00:07:01.632 "read": true, 00:07:01.632 "write": true, 00:07:01.632 "unmap": true, 00:07:01.632 "write_zeroes": true, 00:07:01.632 "flush": true, 00:07:01.632 "reset": true, 00:07:01.632 "compare": false, 00:07:01.632 "compare_and_write": false, 00:07:01.632 "abort": true, 00:07:01.632 "nvme_admin": false, 00:07:01.632 "nvme_io": false 00:07:01.632 }, 00:07:01.632 "memory_domains": [ 00:07:01.632 { 00:07:01.632 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:01.632 "dma_device_type": 2 00:07:01.632 } 00:07:01.632 ], 00:07:01.632 "driver_specific": {} 00:07:01.632 } 00:07:01.632 ]' 00:07:01.632 20:24:19 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:07:01.632 20:24:19 -- common/autotest_common.sh@1362 -- # bs=512 00:07:01.632 20:24:19 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:07:01.894 20:24:19 -- common/autotest_common.sh@1363 -- # nb=1048576 00:07:01.894 20:24:19 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:07:01.894 20:24:19 -- common/autotest_common.sh@1367 -- # echo 512 00:07:01.894 20:24:19 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:01.894 20:24:20 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:03.280 20:24:21 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:03.280 20:24:21 -- common/autotest_common.sh@1177 -- # local i=0 00:07:03.280 20:24:21 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:07:03.280 20:24:21 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:07:03.280 20:24:21 -- common/autotest_common.sh@1184 -- # sleep 2 00:07:05.826 20:24:23 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:07:05.826 20:24:23 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:07:05.826 20:24:23 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:07:05.826 20:24:23 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:07:05.826 20:24:23 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:07:05.826 20:24:23 -- common/autotest_common.sh@1187 -- # return 0 00:07:05.826 20:24:23 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:05.826 20:24:23 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:05.826 20:24:23 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:05.826 20:24:23 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:05.826 20:24:23 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:05.826 20:24:23 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:05.826 20:24:23 -- setup/common.sh@80 -- # echo 536870912 00:07:05.826 20:24:23 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:05.826 20:24:23 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:05.826 20:24:23 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:05.826 20:24:23 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:05.826 20:24:23 -- target/filesystem.sh@69 -- # partprobe 00:07:06.087 20:24:24 -- target/filesystem.sh@70 -- # sleep 1 00:07:07.031 20:24:25 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:07.031 20:24:25 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:07.031 20:24:25 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:07.031 20:24:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:07.031 20:24:25 -- common/autotest_common.sh@10 -- # set +x 00:07:07.031 ************************************ 00:07:07.031 START TEST filesystem_ext4 00:07:07.031 ************************************ 00:07:07.031 20:24:25 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:07.031 20:24:25 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:07.031 20:24:25 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:07.031 20:24:25 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:07.031 20:24:25 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:07:07.031 20:24:25 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:07.031 20:24:25 -- common/autotest_common.sh@904 -- # local i=0 00:07:07.031 20:24:25 -- common/autotest_common.sh@905 -- # local force 00:07:07.031 20:24:25 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:07:07.031 20:24:25 -- common/autotest_common.sh@908 -- # force=-F 00:07:07.031 20:24:25 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:07.031 mke2fs 1.46.5 (30-Dec-2021) 00:07:07.292 Discarding device blocks: 0/522240 done 00:07:07.292 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:07.292 Filesystem UUID: 6bcc75ce-6262-40f1-aa51-0cd8aa9297e9 00:07:07.292 Superblock backups stored on blocks: 00:07:07.292 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:07.292 00:07:07.292 Allocating group tables: 0/64 done 00:07:07.292 Writing inode tables: 0/64 done 00:07:07.292 Creating journal (8192 blocks): done 00:07:08.384 Writing superblocks and filesystem accounting information: 0/64 6/64 done 00:07:08.384 00:07:08.384 20:24:26 -- common/autotest_common.sh@921 -- # return 0 00:07:08.384 20:24:26 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:09.325 20:24:27 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:09.325 20:24:27 -- target/filesystem.sh@25 -- # sync 00:07:09.325 20:24:27 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:09.325 20:24:27 -- target/filesystem.sh@27 -- # sync 00:07:09.325 20:24:27 -- target/filesystem.sh@29 -- # i=0 00:07:09.325 20:24:27 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:09.325 20:24:27 -- target/filesystem.sh@37 -- # kill -0 3866999 00:07:09.325 20:24:27 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:09.325 20:24:27 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:09.325 20:24:27 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:09.325 20:24:27 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:09.325 00:07:09.325 real 0m2.140s 00:07:09.325 user 0m0.020s 00:07:09.325 sys 0m0.047s 00:07:09.325 20:24:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:09.325 20:24:27 -- common/autotest_common.sh@10 -- # set +x 00:07:09.325 ************************************ 00:07:09.325 END TEST filesystem_ext4 00:07:09.325 ************************************ 00:07:09.325 20:24:27 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:09.325 20:24:27 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:09.325 20:24:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:09.325 20:24:27 -- common/autotest_common.sh@10 -- # set +x 00:07:09.325 ************************************ 00:07:09.325 START TEST filesystem_btrfs 00:07:09.325 ************************************ 00:07:09.325 20:24:27 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:09.325 20:24:27 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:09.325 20:24:27 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:09.325 20:24:27 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:09.325 20:24:27 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:07:09.325 20:24:27 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:09.325 20:24:27 -- common/autotest_common.sh@904 -- # local i=0 00:07:09.325 20:24:27 -- common/autotest_common.sh@905 -- # local force 00:07:09.325 20:24:27 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:07:09.325 20:24:27 -- common/autotest_common.sh@910 -- # force=-f 00:07:09.325 20:24:27 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:09.587 btrfs-progs v6.6.2 00:07:09.587 See https://btrfs.readthedocs.io for more information. 00:07:09.587 00:07:09.587 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:09.587 NOTE: several default settings have changed in version 5.15, please make sure 00:07:09.587 this does not affect your deployments: 00:07:09.587 - DUP for metadata (-m dup) 00:07:09.587 - enabled no-holes (-O no-holes) 00:07:09.587 - enabled free-space-tree (-R free-space-tree) 00:07:09.587 00:07:09.587 Label: (null) 00:07:09.587 UUID: d15e2eb2-c8af-4845-a22a-9f82340fdb17 00:07:09.587 Node size: 16384 00:07:09.587 Sector size: 4096 00:07:09.587 Filesystem size: 510.00MiB 00:07:09.587 Block group profiles: 00:07:09.587 Data: single 8.00MiB 00:07:09.587 Metadata: DUP 32.00MiB 00:07:09.587 System: DUP 8.00MiB 00:07:09.587 SSD detected: yes 00:07:09.587 Zoned device: no 00:07:09.587 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:07:09.587 Runtime features: free-space-tree 00:07:09.587 Checksum: crc32c 00:07:09.587 Number of devices: 1 00:07:09.587 Devices: 00:07:09.587 ID SIZE PATH 00:07:09.587 1 510.00MiB /dev/nvme0n1p1 00:07:09.587 00:07:09.587 20:24:27 -- common/autotest_common.sh@921 -- # return 0 00:07:09.587 20:24:27 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:09.847 20:24:28 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:09.847 20:24:28 -- target/filesystem.sh@25 -- # sync 00:07:10.107 20:24:28 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:10.107 20:24:28 -- target/filesystem.sh@27 -- # sync 00:07:10.107 20:24:28 -- target/filesystem.sh@29 -- # i=0 00:07:10.107 20:24:28 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:10.107 20:24:28 -- target/filesystem.sh@37 -- # kill -0 3866999 00:07:10.107 20:24:28 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:10.107 20:24:28 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:10.107 20:24:28 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:10.107 20:24:28 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:10.107 00:07:10.107 real 0m0.712s 00:07:10.107 user 0m0.029s 00:07:10.107 sys 0m0.057s 00:07:10.107 20:24:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:10.107 20:24:28 -- common/autotest_common.sh@10 -- # set +x 00:07:10.107 ************************************ 00:07:10.107 END TEST filesystem_btrfs 00:07:10.107 ************************************ 00:07:10.107 20:24:28 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:10.107 20:24:28 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:10.107 20:24:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:10.107 20:24:28 -- common/autotest_common.sh@10 -- # set +x 00:07:10.107 ************************************ 00:07:10.107 START TEST filesystem_xfs 00:07:10.107 ************************************ 00:07:10.107 20:24:28 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:07:10.107 20:24:28 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:10.107 20:24:28 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:10.107 20:24:28 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:10.107 20:24:28 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:07:10.107 20:24:28 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:10.107 20:24:28 -- common/autotest_common.sh@904 -- # local i=0 00:07:10.107 20:24:28 -- common/autotest_common.sh@905 -- # local force 00:07:10.107 20:24:28 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:07:10.107 20:24:28 -- common/autotest_common.sh@910 -- # force=-f 00:07:10.107 20:24:28 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:10.107 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:10.107 = sectsz=512 attr=2, projid32bit=1 00:07:10.107 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:10.107 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:10.107 data = bsize=4096 blocks=130560, imaxpct=25 00:07:10.107 = sunit=0 swidth=0 blks 00:07:10.107 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:10.107 log =internal log bsize=4096 blocks=16384, version=2 00:07:10.107 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:10.107 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:11.050 Discarding blocks...Done. 00:07:11.050 20:24:29 -- common/autotest_common.sh@921 -- # return 0 00:07:11.050 20:24:29 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:13.595 20:24:31 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:13.595 20:24:31 -- target/filesystem.sh@25 -- # sync 00:07:13.595 20:24:31 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:13.595 20:24:31 -- target/filesystem.sh@27 -- # sync 00:07:13.595 20:24:31 -- target/filesystem.sh@29 -- # i=0 00:07:13.595 20:24:31 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:13.595 20:24:31 -- target/filesystem.sh@37 -- # kill -0 3866999 00:07:13.595 20:24:31 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:13.595 20:24:31 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:13.856 20:24:31 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:13.856 20:24:31 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:13.856 00:07:13.856 real 0m3.661s 00:07:13.856 user 0m0.026s 00:07:13.856 sys 0m0.056s 00:07:13.856 20:24:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:13.856 20:24:31 -- common/autotest_common.sh@10 -- # set +x 00:07:13.856 ************************************ 00:07:13.856 END TEST filesystem_xfs 00:07:13.856 ************************************ 00:07:13.856 20:24:31 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:14.118 20:24:32 -- target/filesystem.sh@93 -- # sync 00:07:14.118 20:24:32 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:14.118 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:14.118 20:24:32 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:14.118 20:24:32 -- common/autotest_common.sh@1198 -- # local i=0 00:07:14.118 20:24:32 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:07:14.118 20:24:32 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:14.118 20:24:32 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:07:14.118 20:24:32 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:14.118 20:24:32 -- common/autotest_common.sh@1210 -- # return 0 00:07:14.118 20:24:32 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:14.118 20:24:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:14.118 20:24:32 -- common/autotest_common.sh@10 -- # set +x 00:07:14.118 20:24:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:14.118 20:24:32 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:14.118 20:24:32 -- target/filesystem.sh@101 -- # killprocess 3866999 00:07:14.118 20:24:32 -- common/autotest_common.sh@926 -- # '[' -z 3866999 ']' 00:07:14.118 20:24:32 -- common/autotest_common.sh@930 -- # kill -0 3866999 00:07:14.118 20:24:32 -- common/autotest_common.sh@931 -- # uname 00:07:14.118 20:24:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:14.118 20:24:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3866999 00:07:14.118 20:24:32 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:14.118 20:24:32 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:14.118 20:24:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3866999' 00:07:14.118 killing process with pid 3866999 00:07:14.118 20:24:32 -- common/autotest_common.sh@945 -- # kill 3866999 00:07:14.118 20:24:32 -- common/autotest_common.sh@950 -- # wait 3866999 00:07:14.379 20:24:32 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:14.379 00:07:14.379 real 0m13.799s 00:07:14.379 user 0m54.335s 00:07:14.379 sys 0m1.042s 00:07:14.379 20:24:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:14.379 20:24:32 -- common/autotest_common.sh@10 -- # set +x 00:07:14.379 ************************************ 00:07:14.379 END TEST nvmf_filesystem_no_in_capsule 00:07:14.379 ************************************ 00:07:14.379 20:24:32 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:14.379 20:24:32 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:14.379 20:24:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:14.379 20:24:32 -- common/autotest_common.sh@10 -- # set +x 00:07:14.379 ************************************ 00:07:14.379 START TEST nvmf_filesystem_in_capsule 00:07:14.379 ************************************ 00:07:14.379 20:24:32 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 4096 00:07:14.379 20:24:32 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:14.379 20:24:32 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:14.379 20:24:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:14.379 20:24:32 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:14.379 20:24:32 -- common/autotest_common.sh@10 -- # set +x 00:07:14.379 20:24:32 -- nvmf/common.sh@469 -- # nvmfpid=3869997 00:07:14.379 20:24:32 -- nvmf/common.sh@470 -- # waitforlisten 3869997 00:07:14.379 20:24:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:14.379 20:24:32 -- common/autotest_common.sh@819 -- # '[' -z 3869997 ']' 00:07:14.379 20:24:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:14.379 20:24:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:14.379 20:24:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:14.379 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:14.379 20:24:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:14.379 20:24:32 -- common/autotest_common.sh@10 -- # set +x 00:07:14.640 [2024-04-26 20:24:32.762059] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:14.640 [2024-04-26 20:24:32.762109] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:14.640 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.640 [2024-04-26 20:24:32.826966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:14.640 [2024-04-26 20:24:32.890050] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:14.640 [2024-04-26 20:24:32.890187] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:14.640 [2024-04-26 20:24:32.890197] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:14.640 [2024-04-26 20:24:32.890205] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:14.640 [2024-04-26 20:24:32.890346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:14.640 [2024-04-26 20:24:32.890419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:14.640 [2024-04-26 20:24:32.890544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:14.640 [2024-04-26 20:24:32.890547] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.237 20:24:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:15.237 20:24:33 -- common/autotest_common.sh@852 -- # return 0 00:07:15.237 20:24:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:15.237 20:24:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:15.237 20:24:33 -- common/autotest_common.sh@10 -- # set +x 00:07:15.237 20:24:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:15.237 20:24:33 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:15.237 20:24:33 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:15.237 20:24:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:15.237 20:24:33 -- common/autotest_common.sh@10 -- # set +x 00:07:15.521 [2024-04-26 20:24:33.578530] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:15.521 20:24:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:15.521 20:24:33 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:15.521 20:24:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:15.521 20:24:33 -- common/autotest_common.sh@10 -- # set +x 00:07:15.521 Malloc1 00:07:15.521 20:24:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:15.521 20:24:33 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:15.521 20:24:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:15.521 20:24:33 -- common/autotest_common.sh@10 -- # set +x 00:07:15.521 20:24:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:15.521 20:24:33 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:15.521 20:24:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:15.521 20:24:33 -- common/autotest_common.sh@10 -- # set +x 00:07:15.521 20:24:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:15.521 20:24:33 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:15.521 20:24:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:15.521 20:24:33 -- common/autotest_common.sh@10 -- # set +x 00:07:15.521 [2024-04-26 20:24:33.704561] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:15.521 20:24:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:15.521 20:24:33 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:15.521 20:24:33 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:07:15.521 20:24:33 -- common/autotest_common.sh@1358 -- # local bdev_info 00:07:15.521 20:24:33 -- common/autotest_common.sh@1359 -- # local bs 00:07:15.521 20:24:33 -- common/autotest_common.sh@1360 -- # local nb 00:07:15.521 20:24:33 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:15.521 20:24:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:15.521 20:24:33 -- common/autotest_common.sh@10 -- # set +x 00:07:15.521 20:24:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:15.521 20:24:33 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:07:15.521 { 00:07:15.521 "name": "Malloc1", 00:07:15.521 "aliases": [ 00:07:15.521 "59762f09-5cee-47ee-80e8-576963fb55c2" 00:07:15.521 ], 00:07:15.521 "product_name": "Malloc disk", 00:07:15.521 "block_size": 512, 00:07:15.521 "num_blocks": 1048576, 00:07:15.521 "uuid": "59762f09-5cee-47ee-80e8-576963fb55c2", 00:07:15.521 "assigned_rate_limits": { 00:07:15.521 "rw_ios_per_sec": 0, 00:07:15.521 "rw_mbytes_per_sec": 0, 00:07:15.521 "r_mbytes_per_sec": 0, 00:07:15.521 "w_mbytes_per_sec": 0 00:07:15.521 }, 00:07:15.521 "claimed": true, 00:07:15.521 "claim_type": "exclusive_write", 00:07:15.521 "zoned": false, 00:07:15.521 "supported_io_types": { 00:07:15.521 "read": true, 00:07:15.521 "write": true, 00:07:15.521 "unmap": true, 00:07:15.521 "write_zeroes": true, 00:07:15.521 "flush": true, 00:07:15.521 "reset": true, 00:07:15.521 "compare": false, 00:07:15.521 "compare_and_write": false, 00:07:15.521 "abort": true, 00:07:15.521 "nvme_admin": false, 00:07:15.521 "nvme_io": false 00:07:15.521 }, 00:07:15.521 "memory_domains": [ 00:07:15.521 { 00:07:15.521 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:15.521 "dma_device_type": 2 00:07:15.521 } 00:07:15.521 ], 00:07:15.521 "driver_specific": {} 00:07:15.521 } 00:07:15.521 ]' 00:07:15.521 20:24:33 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:07:15.521 20:24:33 -- common/autotest_common.sh@1362 -- # bs=512 00:07:15.521 20:24:33 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:07:15.521 20:24:33 -- common/autotest_common.sh@1363 -- # nb=1048576 00:07:15.521 20:24:33 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:07:15.521 20:24:33 -- common/autotest_common.sh@1367 -- # echo 512 00:07:15.521 20:24:33 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:15.521 20:24:33 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:17.434 20:24:35 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:17.434 20:24:35 -- common/autotest_common.sh@1177 -- # local i=0 00:07:17.434 20:24:35 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:07:17.434 20:24:35 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:07:17.434 20:24:35 -- common/autotest_common.sh@1184 -- # sleep 2 00:07:19.349 20:24:37 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:07:19.349 20:24:37 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:07:19.349 20:24:37 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:07:19.349 20:24:37 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:07:19.349 20:24:37 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:07:19.349 20:24:37 -- common/autotest_common.sh@1187 -- # return 0 00:07:19.349 20:24:37 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:19.349 20:24:37 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:19.349 20:24:37 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:19.349 20:24:37 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:19.349 20:24:37 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:19.349 20:24:37 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:19.349 20:24:37 -- setup/common.sh@80 -- # echo 536870912 00:07:19.349 20:24:37 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:19.349 20:24:37 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:19.349 20:24:37 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:19.350 20:24:37 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:19.350 20:24:37 -- target/filesystem.sh@69 -- # partprobe 00:07:19.610 20:24:37 -- target/filesystem.sh@70 -- # sleep 1 00:07:20.550 20:24:38 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:20.550 20:24:38 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:20.550 20:24:38 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:20.550 20:24:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:20.550 20:24:38 -- common/autotest_common.sh@10 -- # set +x 00:07:20.550 ************************************ 00:07:20.550 START TEST filesystem_in_capsule_ext4 00:07:20.550 ************************************ 00:07:20.550 20:24:38 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:20.550 20:24:38 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:20.550 20:24:38 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:20.550 20:24:38 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:20.550 20:24:38 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:07:20.550 20:24:38 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:20.550 20:24:38 -- common/autotest_common.sh@904 -- # local i=0 00:07:20.550 20:24:38 -- common/autotest_common.sh@905 -- # local force 00:07:20.550 20:24:38 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:07:20.550 20:24:38 -- common/autotest_common.sh@908 -- # force=-F 00:07:20.550 20:24:38 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:20.550 mke2fs 1.46.5 (30-Dec-2021) 00:07:20.810 Discarding device blocks: 0/522240 done 00:07:20.810 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:20.810 Filesystem UUID: 49dc7251-c3e3-481b-bb24-cc56f930b37c 00:07:20.810 Superblock backups stored on blocks: 00:07:20.810 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:20.810 00:07:20.810 Allocating group tables: 0/64 done 00:07:20.810 Writing inode tables: 0/64 done 00:07:20.810 Creating journal (8192 blocks): done 00:07:22.015 Writing superblocks and filesystem accounting information: 0/6450/64 done 00:07:22.015 00:07:22.015 20:24:40 -- common/autotest_common.sh@921 -- # return 0 00:07:22.015 20:24:40 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:22.015 20:24:40 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:22.276 20:24:40 -- target/filesystem.sh@25 -- # sync 00:07:22.276 20:24:40 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:22.276 20:24:40 -- target/filesystem.sh@27 -- # sync 00:07:22.276 20:24:40 -- target/filesystem.sh@29 -- # i=0 00:07:22.276 20:24:40 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:22.276 20:24:40 -- target/filesystem.sh@37 -- # kill -0 3869997 00:07:22.276 20:24:40 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:22.276 20:24:40 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:22.276 20:24:40 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:22.276 20:24:40 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:22.276 00:07:22.276 real 0m1.614s 00:07:22.276 user 0m0.030s 00:07:22.276 sys 0m0.042s 00:07:22.276 20:24:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:22.276 20:24:40 -- common/autotest_common.sh@10 -- # set +x 00:07:22.276 ************************************ 00:07:22.276 END TEST filesystem_in_capsule_ext4 00:07:22.276 ************************************ 00:07:22.276 20:24:40 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:22.276 20:24:40 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:22.276 20:24:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:22.276 20:24:40 -- common/autotest_common.sh@10 -- # set +x 00:07:22.276 ************************************ 00:07:22.276 START TEST filesystem_in_capsule_btrfs 00:07:22.276 ************************************ 00:07:22.276 20:24:40 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:22.276 20:24:40 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:22.276 20:24:40 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:22.276 20:24:40 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:22.276 20:24:40 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:07:22.276 20:24:40 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:22.276 20:24:40 -- common/autotest_common.sh@904 -- # local i=0 00:07:22.276 20:24:40 -- common/autotest_common.sh@905 -- # local force 00:07:22.276 20:24:40 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:07:22.276 20:24:40 -- common/autotest_common.sh@910 -- # force=-f 00:07:22.276 20:24:40 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:22.537 btrfs-progs v6.6.2 00:07:22.537 See https://btrfs.readthedocs.io for more information. 00:07:22.537 00:07:22.537 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:22.537 NOTE: several default settings have changed in version 5.15, please make sure 00:07:22.537 this does not affect your deployments: 00:07:22.537 - DUP for metadata (-m dup) 00:07:22.537 - enabled no-holes (-O no-holes) 00:07:22.537 - enabled free-space-tree (-R free-space-tree) 00:07:22.537 00:07:22.537 Label: (null) 00:07:22.537 UUID: e3a564a8-29c3-42c4-a2a5-f48dfaca9fdc 00:07:22.537 Node size: 16384 00:07:22.537 Sector size: 4096 00:07:22.537 Filesystem size: 510.00MiB 00:07:22.537 Block group profiles: 00:07:22.537 Data: single 8.00MiB 00:07:22.537 Metadata: DUP 32.00MiB 00:07:22.537 System: DUP 8.00MiB 00:07:22.537 SSD detected: yes 00:07:22.537 Zoned device: no 00:07:22.537 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:07:22.537 Runtime features: free-space-tree 00:07:22.537 Checksum: crc32c 00:07:22.537 Number of devices: 1 00:07:22.537 Devices: 00:07:22.537 ID SIZE PATH 00:07:22.537 1 510.00MiB /dev/nvme0n1p1 00:07:22.537 00:07:22.537 20:24:40 -- common/autotest_common.sh@921 -- # return 0 00:07:22.537 20:24:40 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:23.105 20:24:41 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:23.105 20:24:41 -- target/filesystem.sh@25 -- # sync 00:07:23.105 20:24:41 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:23.105 20:24:41 -- target/filesystem.sh@27 -- # sync 00:07:23.105 20:24:41 -- target/filesystem.sh@29 -- # i=0 00:07:23.105 20:24:41 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:23.105 20:24:41 -- target/filesystem.sh@37 -- # kill -0 3869997 00:07:23.105 20:24:41 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:23.105 20:24:41 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:23.105 20:24:41 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:23.105 20:24:41 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:23.105 00:07:23.105 real 0m0.838s 00:07:23.105 user 0m0.017s 00:07:23.105 sys 0m0.066s 00:07:23.105 20:24:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:23.105 20:24:41 -- common/autotest_common.sh@10 -- # set +x 00:07:23.105 ************************************ 00:07:23.105 END TEST filesystem_in_capsule_btrfs 00:07:23.105 ************************************ 00:07:23.105 20:24:41 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:23.105 20:24:41 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:23.105 20:24:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:23.105 20:24:41 -- common/autotest_common.sh@10 -- # set +x 00:07:23.105 ************************************ 00:07:23.105 START TEST filesystem_in_capsule_xfs 00:07:23.105 ************************************ 00:07:23.105 20:24:41 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:07:23.105 20:24:41 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:23.105 20:24:41 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:23.105 20:24:41 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:23.105 20:24:41 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:07:23.105 20:24:41 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:23.105 20:24:41 -- common/autotest_common.sh@904 -- # local i=0 00:07:23.105 20:24:41 -- common/autotest_common.sh@905 -- # local force 00:07:23.105 20:24:41 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:07:23.105 20:24:41 -- common/autotest_common.sh@910 -- # force=-f 00:07:23.105 20:24:41 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:23.105 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:23.105 = sectsz=512 attr=2, projid32bit=1 00:07:23.105 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:23.105 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:23.105 data = bsize=4096 blocks=130560, imaxpct=25 00:07:23.105 = sunit=0 swidth=0 blks 00:07:23.105 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:23.105 log =internal log bsize=4096 blocks=16384, version=2 00:07:23.105 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:23.105 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:24.045 Discarding blocks...Done. 00:07:24.045 20:24:42 -- common/autotest_common.sh@921 -- # return 0 00:07:24.045 20:24:42 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:26.631 20:24:44 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:26.631 20:24:44 -- target/filesystem.sh@25 -- # sync 00:07:26.631 20:24:44 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:26.631 20:24:44 -- target/filesystem.sh@27 -- # sync 00:07:26.631 20:24:44 -- target/filesystem.sh@29 -- # i=0 00:07:26.631 20:24:44 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:26.631 20:24:44 -- target/filesystem.sh@37 -- # kill -0 3869997 00:07:26.631 20:24:44 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:26.631 20:24:44 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:26.631 20:24:44 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:26.631 20:24:44 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:26.631 00:07:26.631 real 0m3.495s 00:07:26.631 user 0m0.024s 00:07:26.631 sys 0m0.056s 00:07:26.631 20:24:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:26.631 20:24:44 -- common/autotest_common.sh@10 -- # set +x 00:07:26.631 ************************************ 00:07:26.631 END TEST filesystem_in_capsule_xfs 00:07:26.631 ************************************ 00:07:26.631 20:24:44 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:26.631 20:24:44 -- target/filesystem.sh@93 -- # sync 00:07:26.631 20:24:44 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:26.892 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:26.892 20:24:45 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:26.892 20:24:45 -- common/autotest_common.sh@1198 -- # local i=0 00:07:26.892 20:24:45 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:07:26.892 20:24:45 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:26.892 20:24:45 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:07:26.892 20:24:45 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:26.892 20:24:45 -- common/autotest_common.sh@1210 -- # return 0 00:07:26.892 20:24:45 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:26.892 20:24:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:26.892 20:24:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.892 20:24:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:26.892 20:24:45 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:26.892 20:24:45 -- target/filesystem.sh@101 -- # killprocess 3869997 00:07:26.892 20:24:45 -- common/autotest_common.sh@926 -- # '[' -z 3869997 ']' 00:07:26.892 20:24:45 -- common/autotest_common.sh@930 -- # kill -0 3869997 00:07:26.892 20:24:45 -- common/autotest_common.sh@931 -- # uname 00:07:26.892 20:24:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:26.892 20:24:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3869997 00:07:26.892 20:24:45 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:26.892 20:24:45 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:26.892 20:24:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3869997' 00:07:26.892 killing process with pid 3869997 00:07:26.892 20:24:45 -- common/autotest_common.sh@945 -- # kill 3869997 00:07:26.892 20:24:45 -- common/autotest_common.sh@950 -- # wait 3869997 00:07:27.153 20:24:45 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:27.153 00:07:27.153 real 0m12.670s 00:07:27.153 user 0m49.889s 00:07:27.153 sys 0m1.003s 00:07:27.153 20:24:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:27.153 20:24:45 -- common/autotest_common.sh@10 -- # set +x 00:07:27.153 ************************************ 00:07:27.153 END TEST nvmf_filesystem_in_capsule 00:07:27.153 ************************************ 00:07:27.153 20:24:45 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:27.153 20:24:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:27.153 20:24:45 -- nvmf/common.sh@116 -- # sync 00:07:27.153 20:24:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:27.153 20:24:45 -- nvmf/common.sh@119 -- # set +e 00:07:27.153 20:24:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:27.153 20:24:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:27.153 rmmod nvme_tcp 00:07:27.153 rmmod nvme_fabrics 00:07:27.153 rmmod nvme_keyring 00:07:27.153 20:24:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:27.153 20:24:45 -- nvmf/common.sh@123 -- # set -e 00:07:27.153 20:24:45 -- nvmf/common.sh@124 -- # return 0 00:07:27.153 20:24:45 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:27.153 20:24:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:27.153 20:24:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:27.153 20:24:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:27.153 20:24:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:27.153 20:24:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:27.153 20:24:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:27.153 20:24:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:27.153 20:24:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:29.699 20:24:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:29.699 00:07:29.699 real 0m36.016s 00:07:29.699 user 1m46.342s 00:07:29.699 sys 0m7.423s 00:07:29.699 20:24:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:29.699 20:24:47 -- common/autotest_common.sh@10 -- # set +x 00:07:29.699 ************************************ 00:07:29.699 END TEST nvmf_filesystem 00:07:29.699 ************************************ 00:07:29.699 20:24:47 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:29.699 20:24:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:29.699 20:24:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:29.699 20:24:47 -- common/autotest_common.sh@10 -- # set +x 00:07:29.699 ************************************ 00:07:29.699 START TEST nvmf_discovery 00:07:29.699 ************************************ 00:07:29.699 20:24:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:29.699 * Looking for test storage... 00:07:29.699 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:29.699 20:24:47 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:29.699 20:24:47 -- nvmf/common.sh@7 -- # uname -s 00:07:29.699 20:24:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:29.699 20:24:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:29.699 20:24:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:29.699 20:24:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:29.699 20:24:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:29.700 20:24:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:29.700 20:24:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:29.700 20:24:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:29.700 20:24:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:29.700 20:24:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:29.700 20:24:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:29.700 20:24:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:29.700 20:24:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:29.700 20:24:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:29.700 20:24:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:29.700 20:24:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:29.700 20:24:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:29.700 20:24:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:29.700 20:24:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:29.700 20:24:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.700 20:24:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.700 20:24:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.700 20:24:47 -- paths/export.sh@5 -- # export PATH 00:07:29.700 20:24:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.700 20:24:47 -- nvmf/common.sh@46 -- # : 0 00:07:29.700 20:24:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:29.700 20:24:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:29.700 20:24:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:29.700 20:24:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:29.700 20:24:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:29.700 20:24:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:29.700 20:24:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:29.700 20:24:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:29.700 20:24:47 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:29.700 20:24:47 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:29.700 20:24:47 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:29.700 20:24:47 -- target/discovery.sh@15 -- # hash nvme 00:07:29.700 20:24:47 -- target/discovery.sh@20 -- # nvmftestinit 00:07:29.700 20:24:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:29.700 20:24:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:29.700 20:24:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:29.700 20:24:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:29.700 20:24:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:29.700 20:24:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:29.700 20:24:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:29.700 20:24:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:29.700 20:24:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:29.700 20:24:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:29.700 20:24:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:29.700 20:24:47 -- common/autotest_common.sh@10 -- # set +x 00:07:36.292 20:24:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:36.292 20:24:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:36.292 20:24:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:36.292 20:24:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:36.292 20:24:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:36.292 20:24:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:36.292 20:24:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:36.292 20:24:54 -- nvmf/common.sh@294 -- # net_devs=() 00:07:36.292 20:24:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:36.292 20:24:54 -- nvmf/common.sh@295 -- # e810=() 00:07:36.292 20:24:54 -- nvmf/common.sh@295 -- # local -ga e810 00:07:36.292 20:24:54 -- nvmf/common.sh@296 -- # x722=() 00:07:36.292 20:24:54 -- nvmf/common.sh@296 -- # local -ga x722 00:07:36.292 20:24:54 -- nvmf/common.sh@297 -- # mlx=() 00:07:36.292 20:24:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:36.292 20:24:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:36.292 20:24:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:36.292 20:24:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:36.292 20:24:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:36.292 20:24:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:36.292 20:24:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:36.292 20:24:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:36.292 20:24:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:36.292 20:24:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:36.292 20:24:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:36.292 20:24:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:36.292 20:24:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:36.292 20:24:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:36.292 20:24:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:36.292 20:24:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:36.292 20:24:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:07:36.292 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:07:36.292 20:24:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:36.292 20:24:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:07:36.292 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:07:36.292 20:24:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:36.292 20:24:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:36.292 20:24:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:36.292 20:24:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:36.292 20:24:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:36.292 20:24:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:07:36.292 Found net devices under 0000:4b:00.0: cvl_0_0 00:07:36.292 20:24:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:36.292 20:24:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:36.292 20:24:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:36.292 20:24:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:36.292 20:24:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:36.292 20:24:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:07:36.292 Found net devices under 0000:4b:00.1: cvl_0_1 00:07:36.292 20:24:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:36.292 20:24:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:36.292 20:24:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:36.292 20:24:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:36.292 20:24:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:36.292 20:24:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:36.292 20:24:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:36.292 20:24:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:36.292 20:24:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:36.292 20:24:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:36.292 20:24:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:36.292 20:24:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:36.292 20:24:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:36.292 20:24:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:36.292 20:24:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:36.292 20:24:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:36.292 20:24:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:36.292 20:24:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:36.292 20:24:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:36.292 20:24:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:36.292 20:24:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:36.292 20:24:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:36.292 20:24:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:36.292 20:24:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:36.292 20:24:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:36.292 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:36.292 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.578 ms 00:07:36.292 00:07:36.292 --- 10.0.0.2 ping statistics --- 00:07:36.292 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:36.292 rtt min/avg/max/mdev = 0.578/0.578/0.578/0.000 ms 00:07:36.292 20:24:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:36.292 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:36.292 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.401 ms 00:07:36.292 00:07:36.292 --- 10.0.0.1 ping statistics --- 00:07:36.293 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:36.293 rtt min/avg/max/mdev = 0.401/0.401/0.401/0.000 ms 00:07:36.293 20:24:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:36.293 20:24:54 -- nvmf/common.sh@410 -- # return 0 00:07:36.293 20:24:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:36.293 20:24:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:36.293 20:24:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:36.293 20:24:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:36.293 20:24:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:36.293 20:24:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:36.293 20:24:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:36.293 20:24:54 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:36.293 20:24:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:36.293 20:24:54 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:36.293 20:24:54 -- common/autotest_common.sh@10 -- # set +x 00:07:36.554 20:24:54 -- nvmf/common.sh@469 -- # nvmfpid=3876903 00:07:36.554 20:24:54 -- nvmf/common.sh@470 -- # waitforlisten 3876903 00:07:36.554 20:24:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:36.554 20:24:54 -- common/autotest_common.sh@819 -- # '[' -z 3876903 ']' 00:07:36.554 20:24:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:36.554 20:24:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:36.554 20:24:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:36.554 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:36.554 20:24:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:36.554 20:24:54 -- common/autotest_common.sh@10 -- # set +x 00:07:36.554 [2024-04-26 20:24:54.684823] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:36.554 [2024-04-26 20:24:54.684884] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:36.554 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.554 [2024-04-26 20:24:54.755047] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:36.554 [2024-04-26 20:24:54.828422] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:36.554 [2024-04-26 20:24:54.828558] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:36.554 [2024-04-26 20:24:54.828567] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:36.554 [2024-04-26 20:24:54.828575] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:36.554 [2024-04-26 20:24:54.828717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:36.554 [2024-04-26 20:24:54.828840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:36.554 [2024-04-26 20:24:54.828968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:36.554 [2024-04-26 20:24:54.828971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.128 20:24:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:37.128 20:24:55 -- common/autotest_common.sh@852 -- # return 0 00:07:37.128 20:24:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:37.128 20:24:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:37.128 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.389 20:24:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:37.389 20:24:55 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:37.389 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.389 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 [2024-04-26 20:24:55.513539] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@26 -- # seq 1 4 00:07:37.390 20:24:55 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:37.390 20:24:55 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 Null1 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 [2024-04-26 20:24:55.571394] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:37.390 20:24:55 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 Null2 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:37.390 20:24:55 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 Null3 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:37.390 20:24:55 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 Null4 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.390 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.390 20:24:55 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:37.390 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.390 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.650 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.650 20:24:55 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 4420 00:07:37.650 00:07:37.650 Discovery Log Number of Records 6, Generation counter 6 00:07:37.650 =====Discovery Log Entry 0====== 00:07:37.650 trtype: tcp 00:07:37.650 adrfam: ipv4 00:07:37.650 subtype: current discovery subsystem 00:07:37.650 treq: not required 00:07:37.650 portid: 0 00:07:37.650 trsvcid: 4420 00:07:37.650 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:37.650 traddr: 10.0.0.2 00:07:37.650 eflags: explicit discovery connections, duplicate discovery information 00:07:37.650 sectype: none 00:07:37.650 =====Discovery Log Entry 1====== 00:07:37.650 trtype: tcp 00:07:37.650 adrfam: ipv4 00:07:37.650 subtype: nvme subsystem 00:07:37.650 treq: not required 00:07:37.650 portid: 0 00:07:37.650 trsvcid: 4420 00:07:37.650 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:37.650 traddr: 10.0.0.2 00:07:37.650 eflags: none 00:07:37.650 sectype: none 00:07:37.650 =====Discovery Log Entry 2====== 00:07:37.650 trtype: tcp 00:07:37.650 adrfam: ipv4 00:07:37.650 subtype: nvme subsystem 00:07:37.650 treq: not required 00:07:37.650 portid: 0 00:07:37.650 trsvcid: 4420 00:07:37.650 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:37.650 traddr: 10.0.0.2 00:07:37.650 eflags: none 00:07:37.650 sectype: none 00:07:37.650 =====Discovery Log Entry 3====== 00:07:37.650 trtype: tcp 00:07:37.650 adrfam: ipv4 00:07:37.650 subtype: nvme subsystem 00:07:37.650 treq: not required 00:07:37.650 portid: 0 00:07:37.650 trsvcid: 4420 00:07:37.650 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:37.650 traddr: 10.0.0.2 00:07:37.650 eflags: none 00:07:37.650 sectype: none 00:07:37.650 =====Discovery Log Entry 4====== 00:07:37.650 trtype: tcp 00:07:37.650 adrfam: ipv4 00:07:37.650 subtype: nvme subsystem 00:07:37.650 treq: not required 00:07:37.650 portid: 0 00:07:37.650 trsvcid: 4420 00:07:37.650 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:37.650 traddr: 10.0.0.2 00:07:37.650 eflags: none 00:07:37.650 sectype: none 00:07:37.650 =====Discovery Log Entry 5====== 00:07:37.651 trtype: tcp 00:07:37.651 adrfam: ipv4 00:07:37.651 subtype: discovery subsystem referral 00:07:37.651 treq: not required 00:07:37.651 portid: 0 00:07:37.651 trsvcid: 4430 00:07:37.651 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:37.651 traddr: 10.0.0.2 00:07:37.651 eflags: none 00:07:37.651 sectype: none 00:07:37.651 20:24:55 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:37.651 Perform nvmf subsystem discovery via RPC 00:07:37.651 20:24:55 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:37.651 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.651 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.651 [2024-04-26 20:24:55.812021] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:37.651 [ 00:07:37.651 { 00:07:37.651 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:37.651 "subtype": "Discovery", 00:07:37.651 "listen_addresses": [ 00:07:37.651 { 00:07:37.651 "transport": "TCP", 00:07:37.651 "trtype": "TCP", 00:07:37.651 "adrfam": "IPv4", 00:07:37.651 "traddr": "10.0.0.2", 00:07:37.651 "trsvcid": "4420" 00:07:37.651 } 00:07:37.651 ], 00:07:37.651 "allow_any_host": true, 00:07:37.651 "hosts": [] 00:07:37.651 }, 00:07:37.651 { 00:07:37.651 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:37.651 "subtype": "NVMe", 00:07:37.651 "listen_addresses": [ 00:07:37.651 { 00:07:37.651 "transport": "TCP", 00:07:37.651 "trtype": "TCP", 00:07:37.651 "adrfam": "IPv4", 00:07:37.651 "traddr": "10.0.0.2", 00:07:37.651 "trsvcid": "4420" 00:07:37.651 } 00:07:37.651 ], 00:07:37.651 "allow_any_host": true, 00:07:37.651 "hosts": [], 00:07:37.651 "serial_number": "SPDK00000000000001", 00:07:37.651 "model_number": "SPDK bdev Controller", 00:07:37.651 "max_namespaces": 32, 00:07:37.651 "min_cntlid": 1, 00:07:37.651 "max_cntlid": 65519, 00:07:37.651 "namespaces": [ 00:07:37.651 { 00:07:37.651 "nsid": 1, 00:07:37.651 "bdev_name": "Null1", 00:07:37.651 "name": "Null1", 00:07:37.651 "nguid": "F86785BB59684ACA89E805112C2733E7", 00:07:37.651 "uuid": "f86785bb-5968-4aca-89e8-05112c2733e7" 00:07:37.651 } 00:07:37.651 ] 00:07:37.651 }, 00:07:37.651 { 00:07:37.651 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:37.651 "subtype": "NVMe", 00:07:37.651 "listen_addresses": [ 00:07:37.651 { 00:07:37.651 "transport": "TCP", 00:07:37.651 "trtype": "TCP", 00:07:37.651 "adrfam": "IPv4", 00:07:37.651 "traddr": "10.0.0.2", 00:07:37.651 "trsvcid": "4420" 00:07:37.651 } 00:07:37.651 ], 00:07:37.651 "allow_any_host": true, 00:07:37.651 "hosts": [], 00:07:37.651 "serial_number": "SPDK00000000000002", 00:07:37.651 "model_number": "SPDK bdev Controller", 00:07:37.651 "max_namespaces": 32, 00:07:37.651 "min_cntlid": 1, 00:07:37.651 "max_cntlid": 65519, 00:07:37.651 "namespaces": [ 00:07:37.651 { 00:07:37.651 "nsid": 1, 00:07:37.651 "bdev_name": "Null2", 00:07:37.651 "name": "Null2", 00:07:37.651 "nguid": "C31B2533459F4420B103507C9F74FAED", 00:07:37.651 "uuid": "c31b2533-459f-4420-b103-507c9f74faed" 00:07:37.651 } 00:07:37.651 ] 00:07:37.651 }, 00:07:37.651 { 00:07:37.651 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:37.651 "subtype": "NVMe", 00:07:37.651 "listen_addresses": [ 00:07:37.651 { 00:07:37.651 "transport": "TCP", 00:07:37.651 "trtype": "TCP", 00:07:37.651 "adrfam": "IPv4", 00:07:37.651 "traddr": "10.0.0.2", 00:07:37.651 "trsvcid": "4420" 00:07:37.651 } 00:07:37.651 ], 00:07:37.651 "allow_any_host": true, 00:07:37.651 "hosts": [], 00:07:37.651 "serial_number": "SPDK00000000000003", 00:07:37.651 "model_number": "SPDK bdev Controller", 00:07:37.651 "max_namespaces": 32, 00:07:37.651 "min_cntlid": 1, 00:07:37.651 "max_cntlid": 65519, 00:07:37.651 "namespaces": [ 00:07:37.651 { 00:07:37.651 "nsid": 1, 00:07:37.651 "bdev_name": "Null3", 00:07:37.651 "name": "Null3", 00:07:37.651 "nguid": "C1E9936FDEB6438E89B8A6EC340CF3BC", 00:07:37.651 "uuid": "c1e9936f-deb6-438e-89b8-a6ec340cf3bc" 00:07:37.651 } 00:07:37.651 ] 00:07:37.651 }, 00:07:37.651 { 00:07:37.651 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:37.651 "subtype": "NVMe", 00:07:37.651 "listen_addresses": [ 00:07:37.651 { 00:07:37.651 "transport": "TCP", 00:07:37.651 "trtype": "TCP", 00:07:37.651 "adrfam": "IPv4", 00:07:37.651 "traddr": "10.0.0.2", 00:07:37.651 "trsvcid": "4420" 00:07:37.651 } 00:07:37.651 ], 00:07:37.651 "allow_any_host": true, 00:07:37.651 "hosts": [], 00:07:37.651 "serial_number": "SPDK00000000000004", 00:07:37.651 "model_number": "SPDK bdev Controller", 00:07:37.651 "max_namespaces": 32, 00:07:37.651 "min_cntlid": 1, 00:07:37.651 "max_cntlid": 65519, 00:07:37.651 "namespaces": [ 00:07:37.651 { 00:07:37.651 "nsid": 1, 00:07:37.651 "bdev_name": "Null4", 00:07:37.651 "name": "Null4", 00:07:37.651 "nguid": "7F04A3C9523A46A586B75EACF3662297", 00:07:37.651 "uuid": "7f04a3c9-523a-46a5-86b7-5eacf3662297" 00:07:37.651 } 00:07:37.651 ] 00:07:37.651 } 00:07:37.651 ] 00:07:37.651 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.651 20:24:55 -- target/discovery.sh@42 -- # seq 1 4 00:07:37.651 20:24:55 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:37.651 20:24:55 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:37.651 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.651 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.651 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.651 20:24:55 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:37.651 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.651 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.651 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.651 20:24:55 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:37.651 20:24:55 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:37.651 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.651 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.651 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.651 20:24:55 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:37.651 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.651 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.651 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.651 20:24:55 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:37.651 20:24:55 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:37.651 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.651 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.651 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.651 20:24:55 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:37.651 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.651 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.651 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.651 20:24:55 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:37.651 20:24:55 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:37.651 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.651 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.651 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.651 20:24:55 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:37.651 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.651 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.651 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.651 20:24:55 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:37.651 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.651 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.651 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.651 20:24:55 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:37.651 20:24:55 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:37.651 20:24:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:37.651 20:24:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.651 20:24:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:37.651 20:24:55 -- target/discovery.sh@49 -- # check_bdevs= 00:07:37.651 20:24:55 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:37.651 20:24:55 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:37.651 20:24:55 -- target/discovery.sh@57 -- # nvmftestfini 00:07:37.651 20:24:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:37.651 20:24:55 -- nvmf/common.sh@116 -- # sync 00:07:37.651 20:24:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:37.651 20:24:55 -- nvmf/common.sh@119 -- # set +e 00:07:37.651 20:24:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:37.651 20:24:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:37.912 rmmod nvme_tcp 00:07:37.912 rmmod nvme_fabrics 00:07:37.912 rmmod nvme_keyring 00:07:37.912 20:24:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:37.912 20:24:56 -- nvmf/common.sh@123 -- # set -e 00:07:37.912 20:24:56 -- nvmf/common.sh@124 -- # return 0 00:07:37.912 20:24:56 -- nvmf/common.sh@477 -- # '[' -n 3876903 ']' 00:07:37.912 20:24:56 -- nvmf/common.sh@478 -- # killprocess 3876903 00:07:37.912 20:24:56 -- common/autotest_common.sh@926 -- # '[' -z 3876903 ']' 00:07:37.912 20:24:56 -- common/autotest_common.sh@930 -- # kill -0 3876903 00:07:37.912 20:24:56 -- common/autotest_common.sh@931 -- # uname 00:07:37.912 20:24:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:37.912 20:24:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3876903 00:07:37.912 20:24:56 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:37.912 20:24:56 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:37.912 20:24:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3876903' 00:07:37.912 killing process with pid 3876903 00:07:37.912 20:24:56 -- common/autotest_common.sh@945 -- # kill 3876903 00:07:37.912 [2024-04-26 20:24:56.112581] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:37.912 20:24:56 -- common/autotest_common.sh@950 -- # wait 3876903 00:07:37.912 20:24:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:37.912 20:24:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:37.912 20:24:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:37.912 20:24:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:37.912 20:24:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:37.912 20:24:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:37.912 20:24:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:37.912 20:24:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:40.459 20:24:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:40.459 00:07:40.459 real 0m10.728s 00:07:40.459 user 0m7.846s 00:07:40.459 sys 0m5.417s 00:07:40.459 20:24:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:40.459 20:24:58 -- common/autotest_common.sh@10 -- # set +x 00:07:40.459 ************************************ 00:07:40.459 END TEST nvmf_discovery 00:07:40.459 ************************************ 00:07:40.459 20:24:58 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:40.459 20:24:58 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:40.459 20:24:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:40.459 20:24:58 -- common/autotest_common.sh@10 -- # set +x 00:07:40.459 ************************************ 00:07:40.459 START TEST nvmf_referrals 00:07:40.459 ************************************ 00:07:40.459 20:24:58 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:40.459 * Looking for test storage... 00:07:40.459 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:40.459 20:24:58 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:40.459 20:24:58 -- nvmf/common.sh@7 -- # uname -s 00:07:40.459 20:24:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:40.459 20:24:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:40.459 20:24:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:40.459 20:24:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:40.459 20:24:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:40.459 20:24:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:40.459 20:24:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:40.459 20:24:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:40.459 20:24:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:40.459 20:24:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:40.459 20:24:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:40.459 20:24:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:40.459 20:24:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:40.459 20:24:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:40.459 20:24:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:40.459 20:24:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:40.459 20:24:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:40.459 20:24:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:40.459 20:24:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:40.459 20:24:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:40.459 20:24:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:40.459 20:24:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:40.459 20:24:58 -- paths/export.sh@5 -- # export PATH 00:07:40.459 20:24:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:40.459 20:24:58 -- nvmf/common.sh@46 -- # : 0 00:07:40.459 20:24:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:40.459 20:24:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:40.459 20:24:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:40.459 20:24:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:40.459 20:24:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:40.459 20:24:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:40.459 20:24:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:40.459 20:24:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:40.459 20:24:58 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:40.459 20:24:58 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:40.459 20:24:58 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:40.459 20:24:58 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:40.459 20:24:58 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:40.459 20:24:58 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:40.459 20:24:58 -- target/referrals.sh@37 -- # nvmftestinit 00:07:40.459 20:24:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:40.459 20:24:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:40.459 20:24:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:40.459 20:24:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:40.459 20:24:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:40.459 20:24:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:40.459 20:24:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:40.459 20:24:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:40.459 20:24:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:40.459 20:24:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:40.459 20:24:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:40.459 20:24:58 -- common/autotest_common.sh@10 -- # set +x 00:07:47.052 20:25:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:47.052 20:25:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:47.052 20:25:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:47.052 20:25:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:47.052 20:25:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:47.052 20:25:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:47.053 20:25:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:47.053 20:25:05 -- nvmf/common.sh@294 -- # net_devs=() 00:07:47.053 20:25:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:47.053 20:25:05 -- nvmf/common.sh@295 -- # e810=() 00:07:47.053 20:25:05 -- nvmf/common.sh@295 -- # local -ga e810 00:07:47.053 20:25:05 -- nvmf/common.sh@296 -- # x722=() 00:07:47.053 20:25:05 -- nvmf/common.sh@296 -- # local -ga x722 00:07:47.053 20:25:05 -- nvmf/common.sh@297 -- # mlx=() 00:07:47.053 20:25:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:47.053 20:25:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:47.053 20:25:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:47.053 20:25:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:47.053 20:25:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:47.053 20:25:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:47.053 20:25:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:47.053 20:25:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:47.053 20:25:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:47.053 20:25:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:47.053 20:25:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:47.053 20:25:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:47.053 20:25:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:47.053 20:25:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:47.053 20:25:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:47.053 20:25:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:47.053 20:25:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:07:47.053 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:07:47.053 20:25:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:47.053 20:25:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:07:47.053 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:07:47.053 20:25:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:47.053 20:25:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:47.053 20:25:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:47.053 20:25:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:47.053 20:25:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:47.053 20:25:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:07:47.053 Found net devices under 0000:4b:00.0: cvl_0_0 00:07:47.053 20:25:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:47.053 20:25:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:47.053 20:25:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:47.053 20:25:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:47.053 20:25:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:47.053 20:25:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:07:47.053 Found net devices under 0000:4b:00.1: cvl_0_1 00:07:47.053 20:25:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:47.053 20:25:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:47.053 20:25:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:47.053 20:25:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:47.053 20:25:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:47.053 20:25:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:47.053 20:25:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:47.053 20:25:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:47.053 20:25:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:47.053 20:25:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:47.053 20:25:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:47.053 20:25:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:47.053 20:25:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:47.053 20:25:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:47.053 20:25:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:47.053 20:25:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:47.053 20:25:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:47.053 20:25:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:47.315 20:25:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:47.315 20:25:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:47.315 20:25:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:47.315 20:25:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:47.315 20:25:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:47.315 20:25:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:47.315 20:25:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:47.315 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:47.315 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.722 ms 00:07:47.315 00:07:47.315 --- 10.0.0.2 ping statistics --- 00:07:47.315 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:47.315 rtt min/avg/max/mdev = 0.722/0.722/0.722/0.000 ms 00:07:47.315 20:25:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:47.315 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:47.315 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.420 ms 00:07:47.315 00:07:47.315 --- 10.0.0.1 ping statistics --- 00:07:47.315 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:47.315 rtt min/avg/max/mdev = 0.420/0.420/0.420/0.000 ms 00:07:47.315 20:25:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:47.315 20:25:05 -- nvmf/common.sh@410 -- # return 0 00:07:47.315 20:25:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:47.315 20:25:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:47.315 20:25:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:47.315 20:25:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:47.315 20:25:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:47.315 20:25:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:47.315 20:25:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:47.315 20:25:05 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:47.315 20:25:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:47.315 20:25:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:47.315 20:25:05 -- common/autotest_common.sh@10 -- # set +x 00:07:47.315 20:25:05 -- nvmf/common.sh@469 -- # nvmfpid=3881326 00:07:47.315 20:25:05 -- nvmf/common.sh@470 -- # waitforlisten 3881326 00:07:47.315 20:25:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:47.315 20:25:05 -- common/autotest_common.sh@819 -- # '[' -z 3881326 ']' 00:07:47.315 20:25:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:47.315 20:25:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:47.315 20:25:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:47.315 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:47.315 20:25:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:47.315 20:25:05 -- common/autotest_common.sh@10 -- # set +x 00:07:47.575 [2024-04-26 20:25:05.675146] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:47.575 [2024-04-26 20:25:05.675208] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:47.575 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.575 [2024-04-26 20:25:05.744894] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:47.575 [2024-04-26 20:25:05.818226] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:47.575 [2024-04-26 20:25:05.818363] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:47.575 [2024-04-26 20:25:05.818373] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:47.575 [2024-04-26 20:25:05.818382] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:47.575 [2024-04-26 20:25:05.818505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:47.575 [2024-04-26 20:25:05.818622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:47.575 [2024-04-26 20:25:05.818749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:47.575 [2024-04-26 20:25:05.818752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.147 20:25:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:48.147 20:25:06 -- common/autotest_common.sh@852 -- # return 0 00:07:48.147 20:25:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:48.147 20:25:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:48.147 20:25:06 -- common/autotest_common.sh@10 -- # set +x 00:07:48.407 20:25:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:48.407 20:25:06 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:48.407 20:25:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.407 20:25:06 -- common/autotest_common.sh@10 -- # set +x 00:07:48.407 [2024-04-26 20:25:06.503515] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:48.407 20:25:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.407 20:25:06 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:48.407 20:25:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.407 20:25:06 -- common/autotest_common.sh@10 -- # set +x 00:07:48.407 [2024-04-26 20:25:06.519676] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:48.407 20:25:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.407 20:25:06 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:48.407 20:25:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.407 20:25:06 -- common/autotest_common.sh@10 -- # set +x 00:07:48.407 20:25:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.407 20:25:06 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:48.407 20:25:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.407 20:25:06 -- common/autotest_common.sh@10 -- # set +x 00:07:48.407 20:25:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.407 20:25:06 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:48.407 20:25:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.407 20:25:06 -- common/autotest_common.sh@10 -- # set +x 00:07:48.407 20:25:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.407 20:25:06 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:48.407 20:25:06 -- target/referrals.sh@48 -- # jq length 00:07:48.407 20:25:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.407 20:25:06 -- common/autotest_common.sh@10 -- # set +x 00:07:48.407 20:25:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.407 20:25:06 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:48.407 20:25:06 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:48.407 20:25:06 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:48.407 20:25:06 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:48.407 20:25:06 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:48.408 20:25:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.408 20:25:06 -- common/autotest_common.sh@10 -- # set +x 00:07:48.408 20:25:06 -- target/referrals.sh@21 -- # sort 00:07:48.408 20:25:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.408 20:25:06 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:48.408 20:25:06 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:48.408 20:25:06 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:48.408 20:25:06 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:48.408 20:25:06 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:48.408 20:25:06 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:48.408 20:25:06 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:48.408 20:25:06 -- target/referrals.sh@26 -- # sort 00:07:48.668 20:25:06 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:48.668 20:25:06 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:48.668 20:25:06 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:48.668 20:25:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.668 20:25:06 -- common/autotest_common.sh@10 -- # set +x 00:07:48.668 20:25:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.668 20:25:06 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:48.668 20:25:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.668 20:25:06 -- common/autotest_common.sh@10 -- # set +x 00:07:48.668 20:25:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.669 20:25:06 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:48.669 20:25:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.669 20:25:06 -- common/autotest_common.sh@10 -- # set +x 00:07:48.669 20:25:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.669 20:25:06 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:48.669 20:25:06 -- target/referrals.sh@56 -- # jq length 00:07:48.669 20:25:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.669 20:25:06 -- common/autotest_common.sh@10 -- # set +x 00:07:48.669 20:25:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.669 20:25:06 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:48.669 20:25:06 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:48.669 20:25:06 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:48.669 20:25:06 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:48.669 20:25:06 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:48.669 20:25:06 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:48.669 20:25:06 -- target/referrals.sh@26 -- # sort 00:07:48.929 20:25:07 -- target/referrals.sh@26 -- # echo 00:07:48.929 20:25:07 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:48.930 20:25:07 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:48.930 20:25:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.930 20:25:07 -- common/autotest_common.sh@10 -- # set +x 00:07:48.930 20:25:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.930 20:25:07 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:48.930 20:25:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.930 20:25:07 -- common/autotest_common.sh@10 -- # set +x 00:07:48.930 20:25:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.930 20:25:07 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:48.930 20:25:07 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:48.930 20:25:07 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:48.930 20:25:07 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:48.930 20:25:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:48.930 20:25:07 -- common/autotest_common.sh@10 -- # set +x 00:07:48.930 20:25:07 -- target/referrals.sh@21 -- # sort 00:07:48.930 20:25:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.930 20:25:07 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:48.930 20:25:07 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:48.930 20:25:07 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:48.930 20:25:07 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:48.930 20:25:07 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:48.930 20:25:07 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:48.930 20:25:07 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:48.930 20:25:07 -- target/referrals.sh@26 -- # sort 00:07:49.191 20:25:07 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:49.191 20:25:07 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:49.191 20:25:07 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:49.191 20:25:07 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:49.191 20:25:07 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:49.191 20:25:07 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.191 20:25:07 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:49.191 20:25:07 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:49.191 20:25:07 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:49.191 20:25:07 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:49.191 20:25:07 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:49.191 20:25:07 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.191 20:25:07 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:49.191 20:25:07 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:49.191 20:25:07 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:49.191 20:25:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:49.191 20:25:07 -- common/autotest_common.sh@10 -- # set +x 00:07:49.191 20:25:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:49.191 20:25:07 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:49.191 20:25:07 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:49.191 20:25:07 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:49.191 20:25:07 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:49.191 20:25:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:49.191 20:25:07 -- common/autotest_common.sh@10 -- # set +x 00:07:49.191 20:25:07 -- target/referrals.sh@21 -- # sort 00:07:49.191 20:25:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:49.453 20:25:07 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:49.453 20:25:07 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:49.453 20:25:07 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:49.453 20:25:07 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:49.453 20:25:07 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:49.453 20:25:07 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.453 20:25:07 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:49.453 20:25:07 -- target/referrals.sh@26 -- # sort 00:07:49.453 20:25:07 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:49.453 20:25:07 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:49.453 20:25:07 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:49.453 20:25:07 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:49.453 20:25:07 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:49.453 20:25:07 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.453 20:25:07 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:49.453 20:25:07 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:49.453 20:25:07 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:49.453 20:25:07 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:49.453 20:25:07 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:49.453 20:25:07 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.453 20:25:07 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:49.714 20:25:07 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:49.714 20:25:07 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:49.714 20:25:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:49.714 20:25:07 -- common/autotest_common.sh@10 -- # set +x 00:07:49.714 20:25:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:49.714 20:25:07 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:49.714 20:25:07 -- target/referrals.sh@82 -- # jq length 00:07:49.715 20:25:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:49.715 20:25:07 -- common/autotest_common.sh@10 -- # set +x 00:07:49.715 20:25:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:49.715 20:25:07 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:49.715 20:25:07 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:49.715 20:25:07 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:49.715 20:25:07 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:49.715 20:25:07 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.715 20:25:07 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:49.715 20:25:07 -- target/referrals.sh@26 -- # sort 00:07:49.715 20:25:08 -- target/referrals.sh@26 -- # echo 00:07:49.715 20:25:08 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:49.715 20:25:08 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:49.715 20:25:08 -- target/referrals.sh@86 -- # nvmftestfini 00:07:49.715 20:25:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:49.715 20:25:08 -- nvmf/common.sh@116 -- # sync 00:07:49.715 20:25:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:49.715 20:25:08 -- nvmf/common.sh@119 -- # set +e 00:07:49.715 20:25:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:49.715 20:25:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:49.715 rmmod nvme_tcp 00:07:49.715 rmmod nvme_fabrics 00:07:49.715 rmmod nvme_keyring 00:07:49.975 20:25:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:49.975 20:25:08 -- nvmf/common.sh@123 -- # set -e 00:07:49.975 20:25:08 -- nvmf/common.sh@124 -- # return 0 00:07:49.975 20:25:08 -- nvmf/common.sh@477 -- # '[' -n 3881326 ']' 00:07:49.975 20:25:08 -- nvmf/common.sh@478 -- # killprocess 3881326 00:07:49.975 20:25:08 -- common/autotest_common.sh@926 -- # '[' -z 3881326 ']' 00:07:49.975 20:25:08 -- common/autotest_common.sh@930 -- # kill -0 3881326 00:07:49.975 20:25:08 -- common/autotest_common.sh@931 -- # uname 00:07:49.975 20:25:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:49.975 20:25:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3881326 00:07:49.975 20:25:08 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:49.975 20:25:08 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:49.975 20:25:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3881326' 00:07:49.975 killing process with pid 3881326 00:07:49.975 20:25:08 -- common/autotest_common.sh@945 -- # kill 3881326 00:07:49.975 20:25:08 -- common/autotest_common.sh@950 -- # wait 3881326 00:07:49.975 20:25:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:49.975 20:25:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:49.975 20:25:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:49.976 20:25:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:49.976 20:25:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:49.976 20:25:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:49.976 20:25:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:49.976 20:25:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:52.523 20:25:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:52.523 00:07:52.523 real 0m11.989s 00:07:52.523 user 0m12.712s 00:07:52.523 sys 0m5.813s 00:07:52.523 20:25:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:52.523 20:25:10 -- common/autotest_common.sh@10 -- # set +x 00:07:52.523 ************************************ 00:07:52.523 END TEST nvmf_referrals 00:07:52.523 ************************************ 00:07:52.523 20:25:10 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:52.523 20:25:10 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:52.523 20:25:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:52.523 20:25:10 -- common/autotest_common.sh@10 -- # set +x 00:07:52.523 ************************************ 00:07:52.523 START TEST nvmf_connect_disconnect 00:07:52.523 ************************************ 00:07:52.523 20:25:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:52.523 * Looking for test storage... 00:07:52.523 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:52.523 20:25:10 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:52.523 20:25:10 -- nvmf/common.sh@7 -- # uname -s 00:07:52.523 20:25:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:52.523 20:25:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:52.523 20:25:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:52.523 20:25:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:52.523 20:25:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:52.523 20:25:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:52.523 20:25:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:52.523 20:25:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:52.523 20:25:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:52.523 20:25:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:52.523 20:25:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:52.523 20:25:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:52.523 20:25:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:52.523 20:25:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:52.523 20:25:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:52.523 20:25:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:52.523 20:25:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:52.523 20:25:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:52.523 20:25:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:52.523 20:25:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.523 20:25:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.523 20:25:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.523 20:25:10 -- paths/export.sh@5 -- # export PATH 00:07:52.523 20:25:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.523 20:25:10 -- nvmf/common.sh@46 -- # : 0 00:07:52.523 20:25:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:52.523 20:25:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:52.523 20:25:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:52.523 20:25:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:52.523 20:25:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:52.523 20:25:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:52.523 20:25:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:52.523 20:25:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:52.523 20:25:10 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:52.523 20:25:10 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:52.523 20:25:10 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:52.523 20:25:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:52.523 20:25:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:52.523 20:25:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:52.523 20:25:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:52.523 20:25:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:52.523 20:25:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:52.523 20:25:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:52.523 20:25:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:52.523 20:25:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:52.523 20:25:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:52.523 20:25:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:52.523 20:25:10 -- common/autotest_common.sh@10 -- # set +x 00:07:59.218 20:25:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:59.218 20:25:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:59.218 20:25:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:59.218 20:25:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:59.218 20:25:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:59.218 20:25:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:59.218 20:25:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:59.218 20:25:17 -- nvmf/common.sh@294 -- # net_devs=() 00:07:59.218 20:25:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:59.218 20:25:17 -- nvmf/common.sh@295 -- # e810=() 00:07:59.218 20:25:17 -- nvmf/common.sh@295 -- # local -ga e810 00:07:59.218 20:25:17 -- nvmf/common.sh@296 -- # x722=() 00:07:59.218 20:25:17 -- nvmf/common.sh@296 -- # local -ga x722 00:07:59.218 20:25:17 -- nvmf/common.sh@297 -- # mlx=() 00:07:59.218 20:25:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:59.218 20:25:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:59.218 20:25:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:59.218 20:25:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:59.218 20:25:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:59.218 20:25:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:59.218 20:25:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:59.218 20:25:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:59.218 20:25:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:59.218 20:25:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:59.218 20:25:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:59.218 20:25:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:59.218 20:25:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:59.218 20:25:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:59.218 20:25:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:59.218 20:25:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:59.218 20:25:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:07:59.218 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:07:59.218 20:25:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:59.218 20:25:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:07:59.218 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:07:59.218 20:25:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:59.218 20:25:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:59.218 20:25:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:59.218 20:25:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:59.218 20:25:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:59.218 20:25:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:07:59.218 Found net devices under 0000:4b:00.0: cvl_0_0 00:07:59.218 20:25:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:59.218 20:25:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:59.218 20:25:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:59.218 20:25:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:59.218 20:25:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:59.218 20:25:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:07:59.218 Found net devices under 0000:4b:00.1: cvl_0_1 00:07:59.218 20:25:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:59.218 20:25:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:59.218 20:25:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:59.218 20:25:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:59.218 20:25:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:59.218 20:25:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:59.218 20:25:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:59.218 20:25:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:59.218 20:25:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:59.218 20:25:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:59.218 20:25:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:59.218 20:25:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:59.218 20:25:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:59.218 20:25:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:59.218 20:25:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:59.218 20:25:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:59.218 20:25:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:59.218 20:25:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:59.218 20:25:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:59.218 20:25:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:59.218 20:25:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:59.218 20:25:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:59.480 20:25:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:59.480 20:25:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:59.480 20:25:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:59.480 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:59.480 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.530 ms 00:07:59.480 00:07:59.480 --- 10.0.0.2 ping statistics --- 00:07:59.480 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:59.480 rtt min/avg/max/mdev = 0.530/0.530/0.530/0.000 ms 00:07:59.480 20:25:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:59.480 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:59.480 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.359 ms 00:07:59.480 00:07:59.480 --- 10.0.0.1 ping statistics --- 00:07:59.480 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:59.480 rtt min/avg/max/mdev = 0.359/0.359/0.359/0.000 ms 00:07:59.480 20:25:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:59.480 20:25:17 -- nvmf/common.sh@410 -- # return 0 00:07:59.480 20:25:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:59.480 20:25:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:59.480 20:25:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:59.480 20:25:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:59.480 20:25:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:59.480 20:25:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:59.480 20:25:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:59.480 20:25:17 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:59.480 20:25:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:59.480 20:25:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:59.480 20:25:17 -- common/autotest_common.sh@10 -- # set +x 00:07:59.480 20:25:17 -- nvmf/common.sh@469 -- # nvmfpid=3886119 00:07:59.480 20:25:17 -- nvmf/common.sh@470 -- # waitforlisten 3886119 00:07:59.480 20:25:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:59.480 20:25:17 -- common/autotest_common.sh@819 -- # '[' -z 3886119 ']' 00:07:59.480 20:25:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:59.480 20:25:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:59.480 20:25:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:59.480 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:59.480 20:25:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:59.480 20:25:17 -- common/autotest_common.sh@10 -- # set +x 00:07:59.480 [2024-04-26 20:25:17.723332] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:07:59.480 [2024-04-26 20:25:17.723380] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:59.480 EAL: No free 2048 kB hugepages reported on node 1 00:07:59.480 [2024-04-26 20:25:17.788962] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:59.741 [2024-04-26 20:25:17.851822] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:59.741 [2024-04-26 20:25:17.851961] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:59.741 [2024-04-26 20:25:17.851971] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:59.741 [2024-04-26 20:25:17.851979] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:59.741 [2024-04-26 20:25:17.852100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:59.741 [2024-04-26 20:25:17.852214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:59.741 [2024-04-26 20:25:17.852361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:59.741 [2024-04-26 20:25:17.852535] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:00.314 20:25:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:00.314 20:25:18 -- common/autotest_common.sh@852 -- # return 0 00:08:00.314 20:25:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:00.314 20:25:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:00.314 20:25:18 -- common/autotest_common.sh@10 -- # set +x 00:08:00.314 20:25:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:00.314 20:25:18 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:00.314 20:25:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:00.314 20:25:18 -- common/autotest_common.sh@10 -- # set +x 00:08:00.314 [2024-04-26 20:25:18.534450] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:00.314 20:25:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:00.314 20:25:18 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:00.314 20:25:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:00.314 20:25:18 -- common/autotest_common.sh@10 -- # set +x 00:08:00.314 20:25:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:00.314 20:25:18 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:00.314 20:25:18 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:00.314 20:25:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:00.314 20:25:18 -- common/autotest_common.sh@10 -- # set +x 00:08:00.314 20:25:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:00.314 20:25:18 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:00.314 20:25:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:00.314 20:25:18 -- common/autotest_common.sh@10 -- # set +x 00:08:00.314 20:25:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:00.314 20:25:18 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:00.314 20:25:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:00.314 20:25:18 -- common/autotest_common.sh@10 -- # set +x 00:08:00.314 [2024-04-26 20:25:18.593952] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:00.314 20:25:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:00.314 20:25:18 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:08:00.314 20:25:18 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:08:00.314 20:25:18 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:08:00.314 20:25:18 -- target/connect_disconnect.sh@34 -- # set +x 00:08:02.861 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:05.435 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.348 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:09.896 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.812 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.359 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:16.904 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.822 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:21.368 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.917 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.830 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.377 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.292 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:32.838 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.752 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.297 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.319 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.866 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:43.782 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.326 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.239 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:50.785 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.329 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.240 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.780 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.321 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.234 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:04.778 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.722 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.268 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.182 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.731 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.295 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.265 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.808 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.722 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.268 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.182 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.727 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.274 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.202 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.748 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.292 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.206 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.754 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.686 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.232 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.142 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.688 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.234 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.146 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.742 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.660 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.207 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.120 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.667 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.214 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.129 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.673 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.221 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.136 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.684 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.596 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.144 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.691 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.607 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.152 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.082 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.683 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.601 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.148 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.073 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.621 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.168 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.114 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.659 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.572 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.146 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.059 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.606 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.154 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.070 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.616 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.533 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.089 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.638 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.627 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.215 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.129 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.673 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.583 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.126 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.040 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.588 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.502 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.046 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.592 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.507 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:47.052 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.598 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.598 20:29:07 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:49.598 20:29:07 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:49.598 20:29:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:49.598 20:29:07 -- nvmf/common.sh@116 -- # sync 00:11:49.598 20:29:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:49.598 20:29:07 -- nvmf/common.sh@119 -- # set +e 00:11:49.598 20:29:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:49.598 20:29:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:49.598 rmmod nvme_tcp 00:11:49.598 rmmod nvme_fabrics 00:11:49.598 rmmod nvme_keyring 00:11:49.598 20:29:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:49.598 20:29:07 -- nvmf/common.sh@123 -- # set -e 00:11:49.598 20:29:07 -- nvmf/common.sh@124 -- # return 0 00:11:49.598 20:29:07 -- nvmf/common.sh@477 -- # '[' -n 3886119 ']' 00:11:49.598 20:29:07 -- nvmf/common.sh@478 -- # killprocess 3886119 00:11:49.598 20:29:07 -- common/autotest_common.sh@926 -- # '[' -z 3886119 ']' 00:11:49.598 20:29:07 -- common/autotest_common.sh@930 -- # kill -0 3886119 00:11:49.598 20:29:07 -- common/autotest_common.sh@931 -- # uname 00:11:49.598 20:29:07 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:49.598 20:29:07 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3886119 00:11:49.598 20:29:07 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:11:49.598 20:29:07 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:11:49.598 20:29:07 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3886119' 00:11:49.598 killing process with pid 3886119 00:11:49.598 20:29:07 -- common/autotest_common.sh@945 -- # kill 3886119 00:11:49.598 20:29:07 -- common/autotest_common.sh@950 -- # wait 3886119 00:11:49.598 20:29:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:49.598 20:29:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:49.598 20:29:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:49.598 20:29:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:49.598 20:29:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:49.598 20:29:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:49.598 20:29:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:49.598 20:29:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:51.513 20:29:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:51.513 00:11:51.513 real 3m59.322s 00:11:51.513 user 15m12.762s 00:11:51.513 sys 0m19.260s 00:11:51.513 20:29:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:11:51.513 20:29:09 -- common/autotest_common.sh@10 -- # set +x 00:11:51.513 ************************************ 00:11:51.513 END TEST nvmf_connect_disconnect 00:11:51.513 ************************************ 00:11:51.513 20:29:09 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:51.513 20:29:09 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:11:51.513 20:29:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:11:51.513 20:29:09 -- common/autotest_common.sh@10 -- # set +x 00:11:51.513 ************************************ 00:11:51.513 START TEST nvmf_multitarget 00:11:51.513 ************************************ 00:11:51.513 20:29:09 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:51.513 * Looking for test storage... 00:11:51.513 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:51.513 20:29:09 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:51.513 20:29:09 -- nvmf/common.sh@7 -- # uname -s 00:11:51.513 20:29:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:51.513 20:29:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:51.513 20:29:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:51.513 20:29:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:51.513 20:29:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:51.513 20:29:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:51.513 20:29:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:51.513 20:29:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:51.513 20:29:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:51.513 20:29:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:51.513 20:29:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:11:51.513 20:29:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:11:51.513 20:29:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:51.514 20:29:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:51.775 20:29:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:51.775 20:29:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:51.775 20:29:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:51.775 20:29:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:51.775 20:29:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:51.775 20:29:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.776 20:29:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.776 20:29:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.776 20:29:09 -- paths/export.sh@5 -- # export PATH 00:11:51.776 20:29:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.776 20:29:09 -- nvmf/common.sh@46 -- # : 0 00:11:51.776 20:29:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:51.776 20:29:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:51.776 20:29:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:51.776 20:29:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:51.776 20:29:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:51.776 20:29:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:51.776 20:29:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:51.776 20:29:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:51.776 20:29:09 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:51.776 20:29:09 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:51.776 20:29:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:51.776 20:29:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:51.776 20:29:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:51.776 20:29:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:51.776 20:29:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:51.776 20:29:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:51.776 20:29:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:51.776 20:29:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:51.776 20:29:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:51.776 20:29:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:51.776 20:29:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:51.776 20:29:09 -- common/autotest_common.sh@10 -- # set +x 00:11:58.467 20:29:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:58.467 20:29:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:58.467 20:29:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:58.467 20:29:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:58.467 20:29:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:58.467 20:29:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:58.467 20:29:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:58.467 20:29:16 -- nvmf/common.sh@294 -- # net_devs=() 00:11:58.467 20:29:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:58.467 20:29:16 -- nvmf/common.sh@295 -- # e810=() 00:11:58.467 20:29:16 -- nvmf/common.sh@295 -- # local -ga e810 00:11:58.467 20:29:16 -- nvmf/common.sh@296 -- # x722=() 00:11:58.467 20:29:16 -- nvmf/common.sh@296 -- # local -ga x722 00:11:58.467 20:29:16 -- nvmf/common.sh@297 -- # mlx=() 00:11:58.467 20:29:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:58.467 20:29:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:58.467 20:29:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:58.467 20:29:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:58.467 20:29:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:58.467 20:29:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:58.467 20:29:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:58.467 20:29:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:58.467 20:29:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:58.467 20:29:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:58.467 20:29:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:58.467 20:29:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:58.467 20:29:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:58.467 20:29:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:58.467 20:29:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:58.467 20:29:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:58.467 20:29:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:11:58.467 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:11:58.467 20:29:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:58.467 20:29:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:11:58.467 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:11:58.467 20:29:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:58.467 20:29:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:58.467 20:29:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:58.467 20:29:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:58.467 20:29:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:58.467 20:29:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:11:58.467 Found net devices under 0000:4b:00.0: cvl_0_0 00:11:58.467 20:29:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:58.467 20:29:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:58.467 20:29:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:58.467 20:29:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:58.467 20:29:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:58.467 20:29:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:11:58.467 Found net devices under 0000:4b:00.1: cvl_0_1 00:11:58.467 20:29:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:58.467 20:29:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:58.467 20:29:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:58.467 20:29:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:58.467 20:29:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:58.467 20:29:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:58.467 20:29:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:58.467 20:29:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:58.467 20:29:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:58.467 20:29:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:58.467 20:29:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:58.467 20:29:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:58.467 20:29:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:58.468 20:29:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:58.468 20:29:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:58.468 20:29:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:58.468 20:29:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:58.468 20:29:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:58.468 20:29:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:58.468 20:29:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:58.468 20:29:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:58.468 20:29:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:58.468 20:29:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:58.468 20:29:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:58.468 20:29:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:58.468 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:58.468 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.681 ms 00:11:58.468 00:11:58.468 --- 10.0.0.2 ping statistics --- 00:11:58.468 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:58.468 rtt min/avg/max/mdev = 0.681/0.681/0.681/0.000 ms 00:11:58.468 20:29:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:58.468 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:58.468 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.509 ms 00:11:58.468 00:11:58.468 --- 10.0.0.1 ping statistics --- 00:11:58.468 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:58.468 rtt min/avg/max/mdev = 0.509/0.509/0.509/0.000 ms 00:11:58.468 20:29:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:58.468 20:29:16 -- nvmf/common.sh@410 -- # return 0 00:11:58.468 20:29:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:58.468 20:29:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:58.468 20:29:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:58.468 20:29:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:58.468 20:29:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:58.468 20:29:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:58.468 20:29:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:58.468 20:29:16 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:58.468 20:29:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:58.468 20:29:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:11:58.468 20:29:16 -- common/autotest_common.sh@10 -- # set +x 00:11:58.468 20:29:16 -- nvmf/common.sh@469 -- # nvmfpid=3937978 00:11:58.468 20:29:16 -- nvmf/common.sh@470 -- # waitforlisten 3937978 00:11:58.468 20:29:16 -- common/autotest_common.sh@819 -- # '[' -z 3937978 ']' 00:11:58.468 20:29:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:58.468 20:29:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:11:58.468 20:29:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:58.468 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:58.468 20:29:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:11:58.468 20:29:16 -- common/autotest_common.sh@10 -- # set +x 00:11:58.468 20:29:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:58.468 [2024-04-26 20:29:16.590642] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:11:58.468 [2024-04-26 20:29:16.590706] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:58.468 EAL: No free 2048 kB hugepages reported on node 1 00:11:58.468 [2024-04-26 20:29:16.661626] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:58.468 [2024-04-26 20:29:16.734589] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:58.468 [2024-04-26 20:29:16.734719] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:58.468 [2024-04-26 20:29:16.734729] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:58.468 [2024-04-26 20:29:16.734738] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:58.468 [2024-04-26 20:29:16.734863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:58.468 [2024-04-26 20:29:16.734983] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:58.468 [2024-04-26 20:29:16.735111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:58.468 [2024-04-26 20:29:16.735114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:59.038 20:29:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:11:59.038 20:29:17 -- common/autotest_common.sh@852 -- # return 0 00:11:59.038 20:29:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:59.038 20:29:17 -- common/autotest_common.sh@718 -- # xtrace_disable 00:11:59.038 20:29:17 -- common/autotest_common.sh@10 -- # set +x 00:11:59.299 20:29:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:59.299 20:29:17 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:59.299 20:29:17 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:59.299 20:29:17 -- target/multitarget.sh@21 -- # jq length 00:11:59.299 20:29:17 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:59.299 20:29:17 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:59.299 "nvmf_tgt_1" 00:11:59.299 20:29:17 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:59.561 "nvmf_tgt_2" 00:11:59.561 20:29:17 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:59.561 20:29:17 -- target/multitarget.sh@28 -- # jq length 00:11:59.561 20:29:17 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:59.561 20:29:17 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:59.561 true 00:11:59.822 20:29:17 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:59.822 true 00:11:59.822 20:29:18 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:59.822 20:29:18 -- target/multitarget.sh@35 -- # jq length 00:11:59.822 20:29:18 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:59.822 20:29:18 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:59.822 20:29:18 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:59.822 20:29:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:59.822 20:29:18 -- nvmf/common.sh@116 -- # sync 00:11:59.822 20:29:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:59.822 20:29:18 -- nvmf/common.sh@119 -- # set +e 00:11:59.822 20:29:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:59.822 20:29:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:59.822 rmmod nvme_tcp 00:11:59.822 rmmod nvme_fabrics 00:11:59.822 rmmod nvme_keyring 00:12:00.084 20:29:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:00.084 20:29:18 -- nvmf/common.sh@123 -- # set -e 00:12:00.084 20:29:18 -- nvmf/common.sh@124 -- # return 0 00:12:00.084 20:29:18 -- nvmf/common.sh@477 -- # '[' -n 3937978 ']' 00:12:00.084 20:29:18 -- nvmf/common.sh@478 -- # killprocess 3937978 00:12:00.084 20:29:18 -- common/autotest_common.sh@926 -- # '[' -z 3937978 ']' 00:12:00.084 20:29:18 -- common/autotest_common.sh@930 -- # kill -0 3937978 00:12:00.084 20:29:18 -- common/autotest_common.sh@931 -- # uname 00:12:00.084 20:29:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:00.084 20:29:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3937978 00:12:00.084 20:29:18 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:00.084 20:29:18 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:00.084 20:29:18 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3937978' 00:12:00.084 killing process with pid 3937978 00:12:00.084 20:29:18 -- common/autotest_common.sh@945 -- # kill 3937978 00:12:00.084 20:29:18 -- common/autotest_common.sh@950 -- # wait 3937978 00:12:00.084 20:29:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:00.084 20:29:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:00.084 20:29:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:00.084 20:29:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:00.084 20:29:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:00.084 20:29:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:00.084 20:29:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:00.084 20:29:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:02.632 20:29:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:02.632 00:12:02.632 real 0m10.685s 00:12:02.632 user 0m9.045s 00:12:02.632 sys 0m5.414s 00:12:02.632 20:29:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:02.632 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:12:02.632 ************************************ 00:12:02.632 END TEST nvmf_multitarget 00:12:02.632 ************************************ 00:12:02.632 20:29:20 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:02.632 20:29:20 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:02.632 20:29:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:02.632 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:12:02.632 ************************************ 00:12:02.632 START TEST nvmf_rpc 00:12:02.632 ************************************ 00:12:02.632 20:29:20 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:02.632 * Looking for test storage... 00:12:02.632 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:02.632 20:29:20 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:02.632 20:29:20 -- nvmf/common.sh@7 -- # uname -s 00:12:02.632 20:29:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:02.632 20:29:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:02.632 20:29:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:02.632 20:29:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:02.632 20:29:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:02.632 20:29:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:02.632 20:29:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:02.632 20:29:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:02.632 20:29:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:02.632 20:29:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:02.632 20:29:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:02.632 20:29:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:02.632 20:29:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:02.632 20:29:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:02.632 20:29:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:02.632 20:29:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:02.632 20:29:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:02.632 20:29:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:02.632 20:29:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:02.633 20:29:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:02.633 20:29:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:02.633 20:29:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:02.633 20:29:20 -- paths/export.sh@5 -- # export PATH 00:12:02.633 20:29:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:02.633 20:29:20 -- nvmf/common.sh@46 -- # : 0 00:12:02.633 20:29:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:02.633 20:29:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:02.633 20:29:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:02.633 20:29:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:02.633 20:29:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:02.633 20:29:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:02.633 20:29:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:02.633 20:29:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:02.633 20:29:20 -- target/rpc.sh@11 -- # loops=5 00:12:02.633 20:29:20 -- target/rpc.sh@23 -- # nvmftestinit 00:12:02.633 20:29:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:02.633 20:29:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:02.633 20:29:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:02.633 20:29:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:02.633 20:29:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:02.633 20:29:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:02.633 20:29:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:02.633 20:29:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:02.633 20:29:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:02.633 20:29:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:02.633 20:29:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:02.633 20:29:20 -- common/autotest_common.sh@10 -- # set +x 00:12:09.217 20:29:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:09.217 20:29:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:09.217 20:29:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:09.217 20:29:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:09.217 20:29:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:09.217 20:29:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:09.217 20:29:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:09.217 20:29:27 -- nvmf/common.sh@294 -- # net_devs=() 00:12:09.217 20:29:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:09.217 20:29:27 -- nvmf/common.sh@295 -- # e810=() 00:12:09.217 20:29:27 -- nvmf/common.sh@295 -- # local -ga e810 00:12:09.217 20:29:27 -- nvmf/common.sh@296 -- # x722=() 00:12:09.217 20:29:27 -- nvmf/common.sh@296 -- # local -ga x722 00:12:09.217 20:29:27 -- nvmf/common.sh@297 -- # mlx=() 00:12:09.217 20:29:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:09.217 20:29:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:09.217 20:29:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:09.217 20:29:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:09.217 20:29:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:09.217 20:29:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:09.217 20:29:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:09.217 20:29:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:09.217 20:29:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:09.217 20:29:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:09.217 20:29:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:09.217 20:29:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:09.217 20:29:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:09.217 20:29:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:09.217 20:29:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:09.217 20:29:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:09.217 20:29:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:12:09.217 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:12:09.217 20:29:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:09.217 20:29:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:12:09.217 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:12:09.217 20:29:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:09.217 20:29:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:09.217 20:29:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:09.217 20:29:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:09.217 20:29:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:09.217 20:29:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:12:09.217 Found net devices under 0000:4b:00.0: cvl_0_0 00:12:09.217 20:29:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:09.217 20:29:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:09.217 20:29:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:09.217 20:29:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:09.217 20:29:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:09.217 20:29:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:12:09.217 Found net devices under 0000:4b:00.1: cvl_0_1 00:12:09.217 20:29:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:09.217 20:29:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:09.217 20:29:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:09.217 20:29:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:09.217 20:29:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:09.217 20:29:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:09.217 20:29:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:09.217 20:29:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:09.217 20:29:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:09.217 20:29:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:09.217 20:29:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:09.217 20:29:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:09.217 20:29:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:09.217 20:29:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:09.217 20:29:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:09.217 20:29:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:09.217 20:29:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:09.217 20:29:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:09.218 20:29:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:09.218 20:29:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:09.218 20:29:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:09.218 20:29:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:09.479 20:29:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:09.479 20:29:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:09.479 20:29:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:09.479 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:09.479 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.619 ms 00:12:09.479 00:12:09.479 --- 10.0.0.2 ping statistics --- 00:12:09.479 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:09.479 rtt min/avg/max/mdev = 0.619/0.619/0.619/0.000 ms 00:12:09.479 20:29:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:09.479 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:09.479 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.369 ms 00:12:09.479 00:12:09.479 --- 10.0.0.1 ping statistics --- 00:12:09.479 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:09.479 rtt min/avg/max/mdev = 0.369/0.369/0.369/0.000 ms 00:12:09.479 20:29:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:09.479 20:29:27 -- nvmf/common.sh@410 -- # return 0 00:12:09.479 20:29:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:09.479 20:29:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:09.479 20:29:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:09.479 20:29:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:09.479 20:29:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:09.479 20:29:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:09.479 20:29:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:09.479 20:29:27 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:09.479 20:29:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:09.479 20:29:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:09.479 20:29:27 -- common/autotest_common.sh@10 -- # set +x 00:12:09.479 20:29:27 -- nvmf/common.sh@469 -- # nvmfpid=3942476 00:12:09.479 20:29:27 -- nvmf/common.sh@470 -- # waitforlisten 3942476 00:12:09.479 20:29:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:09.479 20:29:27 -- common/autotest_common.sh@819 -- # '[' -z 3942476 ']' 00:12:09.479 20:29:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:09.479 20:29:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:09.479 20:29:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:09.479 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:09.479 20:29:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:09.479 20:29:27 -- common/autotest_common.sh@10 -- # set +x 00:12:09.479 [2024-04-26 20:29:27.759391] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:12:09.479 [2024-04-26 20:29:27.759454] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:09.479 EAL: No free 2048 kB hugepages reported on node 1 00:12:09.740 [2024-04-26 20:29:27.829501] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:09.740 [2024-04-26 20:29:27.903824] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:09.740 [2024-04-26 20:29:27.903962] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:09.740 [2024-04-26 20:29:27.903972] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:09.740 [2024-04-26 20:29:27.903980] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:09.740 [2024-04-26 20:29:27.904101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:09.740 [2024-04-26 20:29:27.904241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:09.740 [2024-04-26 20:29:27.904395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:09.740 [2024-04-26 20:29:27.904398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:10.312 20:29:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:10.312 20:29:28 -- common/autotest_common.sh@852 -- # return 0 00:12:10.312 20:29:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:10.312 20:29:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:10.312 20:29:28 -- common/autotest_common.sh@10 -- # set +x 00:12:10.312 20:29:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:10.312 20:29:28 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:10.312 20:29:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:10.312 20:29:28 -- common/autotest_common.sh@10 -- # set +x 00:12:10.312 20:29:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:10.312 20:29:28 -- target/rpc.sh@26 -- # stats='{ 00:12:10.312 "tick_rate": 2400000000, 00:12:10.312 "poll_groups": [ 00:12:10.312 { 00:12:10.312 "name": "nvmf_tgt_poll_group_0", 00:12:10.312 "admin_qpairs": 0, 00:12:10.312 "io_qpairs": 0, 00:12:10.312 "current_admin_qpairs": 0, 00:12:10.312 "current_io_qpairs": 0, 00:12:10.312 "pending_bdev_io": 0, 00:12:10.312 "completed_nvme_io": 0, 00:12:10.312 "transports": [] 00:12:10.312 }, 00:12:10.312 { 00:12:10.312 "name": "nvmf_tgt_poll_group_1", 00:12:10.312 "admin_qpairs": 0, 00:12:10.312 "io_qpairs": 0, 00:12:10.312 "current_admin_qpairs": 0, 00:12:10.312 "current_io_qpairs": 0, 00:12:10.312 "pending_bdev_io": 0, 00:12:10.312 "completed_nvme_io": 0, 00:12:10.312 "transports": [] 00:12:10.312 }, 00:12:10.312 { 00:12:10.312 "name": "nvmf_tgt_poll_group_2", 00:12:10.312 "admin_qpairs": 0, 00:12:10.312 "io_qpairs": 0, 00:12:10.312 "current_admin_qpairs": 0, 00:12:10.312 "current_io_qpairs": 0, 00:12:10.312 "pending_bdev_io": 0, 00:12:10.312 "completed_nvme_io": 0, 00:12:10.312 "transports": [] 00:12:10.312 }, 00:12:10.312 { 00:12:10.312 "name": "nvmf_tgt_poll_group_3", 00:12:10.312 "admin_qpairs": 0, 00:12:10.312 "io_qpairs": 0, 00:12:10.312 "current_admin_qpairs": 0, 00:12:10.312 "current_io_qpairs": 0, 00:12:10.312 "pending_bdev_io": 0, 00:12:10.312 "completed_nvme_io": 0, 00:12:10.312 "transports": [] 00:12:10.312 } 00:12:10.312 ] 00:12:10.312 }' 00:12:10.312 20:29:28 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:10.312 20:29:28 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:10.312 20:29:28 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:10.312 20:29:28 -- target/rpc.sh@15 -- # wc -l 00:12:10.312 20:29:28 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:10.312 20:29:28 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:10.573 20:29:28 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:10.573 20:29:28 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:10.573 20:29:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:10.573 20:29:28 -- common/autotest_common.sh@10 -- # set +x 00:12:10.573 [2024-04-26 20:29:28.699848] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:10.573 20:29:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:10.573 20:29:28 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:10.573 20:29:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:10.573 20:29:28 -- common/autotest_common.sh@10 -- # set +x 00:12:10.573 20:29:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:10.573 20:29:28 -- target/rpc.sh@33 -- # stats='{ 00:12:10.573 "tick_rate": 2400000000, 00:12:10.573 "poll_groups": [ 00:12:10.573 { 00:12:10.573 "name": "nvmf_tgt_poll_group_0", 00:12:10.573 "admin_qpairs": 0, 00:12:10.573 "io_qpairs": 0, 00:12:10.573 "current_admin_qpairs": 0, 00:12:10.573 "current_io_qpairs": 0, 00:12:10.573 "pending_bdev_io": 0, 00:12:10.573 "completed_nvme_io": 0, 00:12:10.573 "transports": [ 00:12:10.573 { 00:12:10.573 "trtype": "TCP" 00:12:10.573 } 00:12:10.573 ] 00:12:10.573 }, 00:12:10.573 { 00:12:10.573 "name": "nvmf_tgt_poll_group_1", 00:12:10.573 "admin_qpairs": 0, 00:12:10.573 "io_qpairs": 0, 00:12:10.573 "current_admin_qpairs": 0, 00:12:10.573 "current_io_qpairs": 0, 00:12:10.573 "pending_bdev_io": 0, 00:12:10.573 "completed_nvme_io": 0, 00:12:10.573 "transports": [ 00:12:10.573 { 00:12:10.573 "trtype": "TCP" 00:12:10.573 } 00:12:10.573 ] 00:12:10.573 }, 00:12:10.574 { 00:12:10.574 "name": "nvmf_tgt_poll_group_2", 00:12:10.574 "admin_qpairs": 0, 00:12:10.574 "io_qpairs": 0, 00:12:10.574 "current_admin_qpairs": 0, 00:12:10.574 "current_io_qpairs": 0, 00:12:10.574 "pending_bdev_io": 0, 00:12:10.574 "completed_nvme_io": 0, 00:12:10.574 "transports": [ 00:12:10.574 { 00:12:10.574 "trtype": "TCP" 00:12:10.574 } 00:12:10.574 ] 00:12:10.574 }, 00:12:10.574 { 00:12:10.574 "name": "nvmf_tgt_poll_group_3", 00:12:10.574 "admin_qpairs": 0, 00:12:10.574 "io_qpairs": 0, 00:12:10.574 "current_admin_qpairs": 0, 00:12:10.574 "current_io_qpairs": 0, 00:12:10.574 "pending_bdev_io": 0, 00:12:10.574 "completed_nvme_io": 0, 00:12:10.574 "transports": [ 00:12:10.574 { 00:12:10.574 "trtype": "TCP" 00:12:10.574 } 00:12:10.574 ] 00:12:10.574 } 00:12:10.574 ] 00:12:10.574 }' 00:12:10.574 20:29:28 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:10.574 20:29:28 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:10.574 20:29:28 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:10.574 20:29:28 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:10.574 20:29:28 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:10.574 20:29:28 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:10.574 20:29:28 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:10.574 20:29:28 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:10.574 20:29:28 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:10.574 20:29:28 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:10.574 20:29:28 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:10.574 20:29:28 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:10.574 20:29:28 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:10.574 20:29:28 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:10.574 20:29:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:10.574 20:29:28 -- common/autotest_common.sh@10 -- # set +x 00:12:10.574 Malloc1 00:12:10.574 20:29:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:10.574 20:29:28 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:10.574 20:29:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:10.574 20:29:28 -- common/autotest_common.sh@10 -- # set +x 00:12:10.574 20:29:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:10.574 20:29:28 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:10.574 20:29:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:10.574 20:29:28 -- common/autotest_common.sh@10 -- # set +x 00:12:10.574 20:29:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:10.574 20:29:28 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:10.574 20:29:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:10.574 20:29:28 -- common/autotest_common.sh@10 -- # set +x 00:12:10.574 20:29:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:10.574 20:29:28 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:10.574 20:29:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:10.574 20:29:28 -- common/autotest_common.sh@10 -- # set +x 00:12:10.574 [2024-04-26 20:29:28.883673] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:10.574 20:29:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:10.574 20:29:28 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be -a 10.0.0.2 -s 4420 00:12:10.574 20:29:28 -- common/autotest_common.sh@640 -- # local es=0 00:12:10.574 20:29:28 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be -a 10.0.0.2 -s 4420 00:12:10.574 20:29:28 -- common/autotest_common.sh@628 -- # local arg=nvme 00:12:10.574 20:29:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:10.574 20:29:28 -- common/autotest_common.sh@632 -- # type -t nvme 00:12:10.574 20:29:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:10.574 20:29:28 -- common/autotest_common.sh@634 -- # type -P nvme 00:12:10.574 20:29:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:10.574 20:29:28 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:12:10.574 20:29:28 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:12:10.574 20:29:28 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be -a 10.0.0.2 -s 4420 00:12:10.574 [2024-04-26 20:29:28.910700] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be' 00:12:10.574 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:10.574 could not add new controller: failed to write to nvme-fabrics device 00:12:10.574 20:29:28 -- common/autotest_common.sh@643 -- # es=1 00:12:10.574 20:29:28 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:12:10.574 20:29:28 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:12:10.574 20:29:28 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:12:10.574 20:29:28 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:10.574 20:29:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:10.574 20:29:28 -- common/autotest_common.sh@10 -- # set +x 00:12:10.835 20:29:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:10.835 20:29:28 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:12.222 20:29:30 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:12.222 20:29:30 -- common/autotest_common.sh@1177 -- # local i=0 00:12:12.222 20:29:30 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:12.222 20:29:30 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:12.222 20:29:30 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:14.138 20:29:32 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:14.138 20:29:32 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:14.138 20:29:32 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:14.399 20:29:32 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:14.399 20:29:32 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:14.399 20:29:32 -- common/autotest_common.sh@1187 -- # return 0 00:12:14.399 20:29:32 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:14.399 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.399 20:29:32 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:14.399 20:29:32 -- common/autotest_common.sh@1198 -- # local i=0 00:12:14.399 20:29:32 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:14.399 20:29:32 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:14.399 20:29:32 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:14.399 20:29:32 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:14.399 20:29:32 -- common/autotest_common.sh@1210 -- # return 0 00:12:14.399 20:29:32 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:14.399 20:29:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:14.399 20:29:32 -- common/autotest_common.sh@10 -- # set +x 00:12:14.399 20:29:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:14.399 20:29:32 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:14.399 20:29:32 -- common/autotest_common.sh@640 -- # local es=0 00:12:14.399 20:29:32 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:14.399 20:29:32 -- common/autotest_common.sh@628 -- # local arg=nvme 00:12:14.399 20:29:32 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:14.399 20:29:32 -- common/autotest_common.sh@632 -- # type -t nvme 00:12:14.399 20:29:32 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:14.399 20:29:32 -- common/autotest_common.sh@634 -- # type -P nvme 00:12:14.399 20:29:32 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:14.399 20:29:32 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:12:14.399 20:29:32 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:12:14.399 20:29:32 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:14.399 [2024-04-26 20:29:32.716069] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be' 00:12:14.399 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:14.399 could not add new controller: failed to write to nvme-fabrics device 00:12:14.399 20:29:32 -- common/autotest_common.sh@643 -- # es=1 00:12:14.399 20:29:32 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:12:14.399 20:29:32 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:12:14.399 20:29:32 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:12:14.399 20:29:32 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:14.399 20:29:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:14.399 20:29:32 -- common/autotest_common.sh@10 -- # set +x 00:12:14.399 20:29:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:14.399 20:29:32 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:16.316 20:29:34 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:16.316 20:29:34 -- common/autotest_common.sh@1177 -- # local i=0 00:12:16.316 20:29:34 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:16.316 20:29:34 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:16.316 20:29:34 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:18.232 20:29:36 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:18.232 20:29:36 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:18.232 20:29:36 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:18.232 20:29:36 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:18.232 20:29:36 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:18.232 20:29:36 -- common/autotest_common.sh@1187 -- # return 0 00:12:18.232 20:29:36 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:18.232 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.232 20:29:36 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:18.232 20:29:36 -- common/autotest_common.sh@1198 -- # local i=0 00:12:18.232 20:29:36 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:18.232 20:29:36 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:18.232 20:29:36 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:18.232 20:29:36 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:18.232 20:29:36 -- common/autotest_common.sh@1210 -- # return 0 00:12:18.232 20:29:36 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:18.232 20:29:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:18.232 20:29:36 -- common/autotest_common.sh@10 -- # set +x 00:12:18.232 20:29:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:18.232 20:29:36 -- target/rpc.sh@81 -- # seq 1 5 00:12:18.232 20:29:36 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:18.232 20:29:36 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:18.232 20:29:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:18.232 20:29:36 -- common/autotest_common.sh@10 -- # set +x 00:12:18.232 20:29:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:18.232 20:29:36 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:18.232 20:29:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:18.232 20:29:36 -- common/autotest_common.sh@10 -- # set +x 00:12:18.232 [2024-04-26 20:29:36.376969] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:18.232 20:29:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:18.232 20:29:36 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:18.232 20:29:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:18.232 20:29:36 -- common/autotest_common.sh@10 -- # set +x 00:12:18.232 20:29:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:18.232 20:29:36 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:18.232 20:29:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:18.232 20:29:36 -- common/autotest_common.sh@10 -- # set +x 00:12:18.232 20:29:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:18.232 20:29:36 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:19.618 20:29:37 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:19.618 20:29:37 -- common/autotest_common.sh@1177 -- # local i=0 00:12:19.618 20:29:37 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:19.618 20:29:37 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:19.618 20:29:37 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:22.171 20:29:39 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:22.171 20:29:39 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:22.171 20:29:39 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:22.171 20:29:39 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:22.171 20:29:39 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:22.171 20:29:39 -- common/autotest_common.sh@1187 -- # return 0 00:12:22.171 20:29:39 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:22.171 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:22.171 20:29:40 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:22.171 20:29:40 -- common/autotest_common.sh@1198 -- # local i=0 00:12:22.171 20:29:40 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:22.171 20:29:40 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:22.171 20:29:40 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:22.171 20:29:40 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:22.171 20:29:40 -- common/autotest_common.sh@1210 -- # return 0 00:12:22.171 20:29:40 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:22.171 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.171 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:12:22.171 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.171 20:29:40 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:22.171 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.171 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:12:22.171 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.171 20:29:40 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:22.171 20:29:40 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:22.171 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.171 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:12:22.171 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.171 20:29:40 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:22.171 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.171 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:12:22.171 [2024-04-26 20:29:40.114184] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.171 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.171 20:29:40 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:22.171 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.171 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:12:22.171 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.171 20:29:40 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:22.171 20:29:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:22.171 20:29:40 -- common/autotest_common.sh@10 -- # set +x 00:12:22.171 20:29:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:22.171 20:29:40 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:23.558 20:29:41 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:23.558 20:29:41 -- common/autotest_common.sh@1177 -- # local i=0 00:12:23.558 20:29:41 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:23.558 20:29:41 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:23.558 20:29:41 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:25.474 20:29:43 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:25.474 20:29:43 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:25.474 20:29:43 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:25.474 20:29:43 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:25.474 20:29:43 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:25.474 20:29:43 -- common/autotest_common.sh@1187 -- # return 0 00:12:25.474 20:29:43 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:25.474 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.474 20:29:43 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:25.474 20:29:43 -- common/autotest_common.sh@1198 -- # local i=0 00:12:25.474 20:29:43 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:25.474 20:29:43 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:25.474 20:29:43 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:25.474 20:29:43 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:25.474 20:29:43 -- common/autotest_common.sh@1210 -- # return 0 00:12:25.474 20:29:43 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:25.474 20:29:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:25.474 20:29:43 -- common/autotest_common.sh@10 -- # set +x 00:12:25.474 20:29:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:25.474 20:29:43 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:25.474 20:29:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:25.474 20:29:43 -- common/autotest_common.sh@10 -- # set +x 00:12:25.474 20:29:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:25.474 20:29:43 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:25.474 20:29:43 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:25.474 20:29:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:25.474 20:29:43 -- common/autotest_common.sh@10 -- # set +x 00:12:25.474 20:29:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:25.474 20:29:43 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:25.474 20:29:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:25.474 20:29:43 -- common/autotest_common.sh@10 -- # set +x 00:12:25.474 [2024-04-26 20:29:43.805014] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:25.474 20:29:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:25.474 20:29:43 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:25.474 20:29:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:25.474 20:29:43 -- common/autotest_common.sh@10 -- # set +x 00:12:25.735 20:29:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:25.735 20:29:43 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:25.735 20:29:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:25.735 20:29:43 -- common/autotest_common.sh@10 -- # set +x 00:12:25.735 20:29:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:25.735 20:29:43 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:27.121 20:29:45 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:27.121 20:29:45 -- common/autotest_common.sh@1177 -- # local i=0 00:12:27.121 20:29:45 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:27.121 20:29:45 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:27.121 20:29:45 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:29.036 20:29:47 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:29.036 20:29:47 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:29.036 20:29:47 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:29.036 20:29:47 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:29.036 20:29:47 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:29.036 20:29:47 -- common/autotest_common.sh@1187 -- # return 0 00:12:29.036 20:29:47 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:29.297 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:29.297 20:29:47 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:29.297 20:29:47 -- common/autotest_common.sh@1198 -- # local i=0 00:12:29.297 20:29:47 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:29.297 20:29:47 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:29.297 20:29:47 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:29.297 20:29:47 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:29.297 20:29:47 -- common/autotest_common.sh@1210 -- # return 0 00:12:29.297 20:29:47 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:29.297 20:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:29.297 20:29:47 -- common/autotest_common.sh@10 -- # set +x 00:12:29.297 20:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:29.297 20:29:47 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:29.297 20:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:29.297 20:29:47 -- common/autotest_common.sh@10 -- # set +x 00:12:29.297 20:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:29.297 20:29:47 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:29.297 20:29:47 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:29.297 20:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:29.297 20:29:47 -- common/autotest_common.sh@10 -- # set +x 00:12:29.297 20:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:29.297 20:29:47 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:29.297 20:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:29.297 20:29:47 -- common/autotest_common.sh@10 -- # set +x 00:12:29.297 [2024-04-26 20:29:47.493747] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:29.297 20:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:29.297 20:29:47 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:29.297 20:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:29.297 20:29:47 -- common/autotest_common.sh@10 -- # set +x 00:12:29.297 20:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:29.297 20:29:47 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:29.297 20:29:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:29.297 20:29:47 -- common/autotest_common.sh@10 -- # set +x 00:12:29.297 20:29:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:29.297 20:29:47 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:31.211 20:29:49 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:31.211 20:29:49 -- common/autotest_common.sh@1177 -- # local i=0 00:12:31.211 20:29:49 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:31.211 20:29:49 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:31.211 20:29:49 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:33.167 20:29:51 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:33.167 20:29:51 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:33.167 20:29:51 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:33.167 20:29:51 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:33.167 20:29:51 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:33.167 20:29:51 -- common/autotest_common.sh@1187 -- # return 0 00:12:33.167 20:29:51 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:33.167 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:33.167 20:29:51 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:33.167 20:29:51 -- common/autotest_common.sh@1198 -- # local i=0 00:12:33.167 20:29:51 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:33.167 20:29:51 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:33.167 20:29:51 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:33.167 20:29:51 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:33.167 20:29:51 -- common/autotest_common.sh@1210 -- # return 0 00:12:33.167 20:29:51 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:33.167 20:29:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:33.167 20:29:51 -- common/autotest_common.sh@10 -- # set +x 00:12:33.167 20:29:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:33.167 20:29:51 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:33.167 20:29:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:33.167 20:29:51 -- common/autotest_common.sh@10 -- # set +x 00:12:33.167 20:29:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:33.167 20:29:51 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:33.167 20:29:51 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:33.167 20:29:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:33.167 20:29:51 -- common/autotest_common.sh@10 -- # set +x 00:12:33.167 20:29:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:33.167 20:29:51 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:33.167 20:29:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:33.167 20:29:51 -- common/autotest_common.sh@10 -- # set +x 00:12:33.167 [2024-04-26 20:29:51.224716] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:33.167 20:29:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:33.167 20:29:51 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:33.167 20:29:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:33.167 20:29:51 -- common/autotest_common.sh@10 -- # set +x 00:12:33.167 20:29:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:33.167 20:29:51 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:33.167 20:29:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:33.167 20:29:51 -- common/autotest_common.sh@10 -- # set +x 00:12:33.167 20:29:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:33.167 20:29:51 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:34.562 20:29:52 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:34.562 20:29:52 -- common/autotest_common.sh@1177 -- # local i=0 00:12:34.562 20:29:52 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:34.562 20:29:52 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:34.562 20:29:52 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:36.477 20:29:54 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:36.477 20:29:54 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:36.477 20:29:54 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:36.477 20:29:54 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:36.477 20:29:54 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:36.477 20:29:54 -- common/autotest_common.sh@1187 -- # return 0 00:12:36.477 20:29:54 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:36.739 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:36.739 20:29:54 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:36.739 20:29:54 -- common/autotest_common.sh@1198 -- # local i=0 00:12:36.739 20:29:54 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:36.739 20:29:54 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:36.739 20:29:54 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:36.739 20:29:54 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:36.739 20:29:54 -- common/autotest_common.sh@1210 -- # return 0 00:12:36.739 20:29:54 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:54 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:54 -- target/rpc.sh@99 -- # seq 1 5 00:12:36.739 20:29:54 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:36.739 20:29:54 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:54 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 [2024-04-26 20:29:54.910304] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:36.739 20:29:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:54 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:54 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:54 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:54 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:54 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:36.739 20:29:54 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:54 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 [2024-04-26 20:29:54.966436] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:36.739 20:29:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:54 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:54 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:54 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:54 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:36.739 20:29:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:55 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:36.739 20:29:55 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:36.739 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:55 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:36.739 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 [2024-04-26 20:29:55.026605] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:36.739 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:55 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:36.739 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:36.739 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.739 20:29:55 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:36.739 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.739 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:36.740 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.740 20:29:55 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.740 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.740 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:36.740 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.740 20:29:55 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:36.740 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.740 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:36.740 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.740 20:29:55 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:36.740 20:29:55 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:36.740 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.740 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:36.740 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:36.740 20:29:55 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:36.740 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:36.740 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:37.001 [2024-04-26 20:29:55.082815] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:37.001 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:37.001 20:29:55 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:37.001 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:37.001 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:37.001 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:37.001 20:29:55 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:37.001 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:37.001 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:37.001 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:37.001 20:29:55 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:37.001 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:37.001 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:37.001 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:37.001 20:29:55 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:37.001 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:37.001 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:37.001 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:37.001 20:29:55 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:37.001 20:29:55 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:37.001 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:37.001 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:37.001 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:37.001 20:29:55 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:37.001 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:37.001 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:37.001 [2024-04-26 20:29:55.139008] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:37.001 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:37.001 20:29:55 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:37.001 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:37.001 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:37.001 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:37.001 20:29:55 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:37.001 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:37.001 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:37.001 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:37.002 20:29:55 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:37.002 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:37.002 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:37.002 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:37.002 20:29:55 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:37.002 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:37.002 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:37.002 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:37.002 20:29:55 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:37.002 20:29:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:37.002 20:29:55 -- common/autotest_common.sh@10 -- # set +x 00:12:37.002 20:29:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:37.002 20:29:55 -- target/rpc.sh@110 -- # stats='{ 00:12:37.002 "tick_rate": 2400000000, 00:12:37.002 "poll_groups": [ 00:12:37.002 { 00:12:37.002 "name": "nvmf_tgt_poll_group_0", 00:12:37.002 "admin_qpairs": 0, 00:12:37.002 "io_qpairs": 224, 00:12:37.002 "current_admin_qpairs": 0, 00:12:37.002 "current_io_qpairs": 0, 00:12:37.002 "pending_bdev_io": 0, 00:12:37.002 "completed_nvme_io": 225, 00:12:37.002 "transports": [ 00:12:37.002 { 00:12:37.002 "trtype": "TCP" 00:12:37.002 } 00:12:37.002 ] 00:12:37.002 }, 00:12:37.002 { 00:12:37.002 "name": "nvmf_tgt_poll_group_1", 00:12:37.002 "admin_qpairs": 1, 00:12:37.002 "io_qpairs": 223, 00:12:37.002 "current_admin_qpairs": 0, 00:12:37.002 "current_io_qpairs": 0, 00:12:37.002 "pending_bdev_io": 0, 00:12:37.002 "completed_nvme_io": 273, 00:12:37.002 "transports": [ 00:12:37.002 { 00:12:37.002 "trtype": "TCP" 00:12:37.002 } 00:12:37.002 ] 00:12:37.002 }, 00:12:37.002 { 00:12:37.002 "name": "nvmf_tgt_poll_group_2", 00:12:37.002 "admin_qpairs": 6, 00:12:37.002 "io_qpairs": 218, 00:12:37.002 "current_admin_qpairs": 0, 00:12:37.002 "current_io_qpairs": 0, 00:12:37.002 "pending_bdev_io": 0, 00:12:37.002 "completed_nvme_io": 512, 00:12:37.002 "transports": [ 00:12:37.002 { 00:12:37.002 "trtype": "TCP" 00:12:37.002 } 00:12:37.002 ] 00:12:37.002 }, 00:12:37.002 { 00:12:37.002 "name": "nvmf_tgt_poll_group_3", 00:12:37.002 "admin_qpairs": 0, 00:12:37.002 "io_qpairs": 224, 00:12:37.002 "current_admin_qpairs": 0, 00:12:37.002 "current_io_qpairs": 0, 00:12:37.002 "pending_bdev_io": 0, 00:12:37.002 "completed_nvme_io": 229, 00:12:37.002 "transports": [ 00:12:37.002 { 00:12:37.002 "trtype": "TCP" 00:12:37.002 } 00:12:37.002 ] 00:12:37.002 } 00:12:37.002 ] 00:12:37.002 }' 00:12:37.002 20:29:55 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:37.002 20:29:55 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:37.002 20:29:55 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:37.002 20:29:55 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:37.002 20:29:55 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:37.002 20:29:55 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:37.002 20:29:55 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:37.002 20:29:55 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:37.002 20:29:55 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:37.002 20:29:55 -- target/rpc.sh@113 -- # (( 889 > 0 )) 00:12:37.002 20:29:55 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:37.002 20:29:55 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:37.002 20:29:55 -- target/rpc.sh@123 -- # nvmftestfini 00:12:37.002 20:29:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:37.002 20:29:55 -- nvmf/common.sh@116 -- # sync 00:12:37.002 20:29:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:37.002 20:29:55 -- nvmf/common.sh@119 -- # set +e 00:12:37.002 20:29:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:37.002 20:29:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:37.002 rmmod nvme_tcp 00:12:37.002 rmmod nvme_fabrics 00:12:37.002 rmmod nvme_keyring 00:12:37.263 20:29:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:37.263 20:29:55 -- nvmf/common.sh@123 -- # set -e 00:12:37.263 20:29:55 -- nvmf/common.sh@124 -- # return 0 00:12:37.263 20:29:55 -- nvmf/common.sh@477 -- # '[' -n 3942476 ']' 00:12:37.263 20:29:55 -- nvmf/common.sh@478 -- # killprocess 3942476 00:12:37.263 20:29:55 -- common/autotest_common.sh@926 -- # '[' -z 3942476 ']' 00:12:37.263 20:29:55 -- common/autotest_common.sh@930 -- # kill -0 3942476 00:12:37.263 20:29:55 -- common/autotest_common.sh@931 -- # uname 00:12:37.263 20:29:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:37.263 20:29:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3942476 00:12:37.263 20:29:55 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:37.263 20:29:55 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:37.264 20:29:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3942476' 00:12:37.264 killing process with pid 3942476 00:12:37.264 20:29:55 -- common/autotest_common.sh@945 -- # kill 3942476 00:12:37.264 20:29:55 -- common/autotest_common.sh@950 -- # wait 3942476 00:12:37.264 20:29:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:37.264 20:29:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:37.264 20:29:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:37.264 20:29:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:37.264 20:29:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:37.264 20:29:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:37.264 20:29:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:37.264 20:29:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:39.817 20:29:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:39.817 00:12:39.817 real 0m37.161s 00:12:39.817 user 1m52.337s 00:12:39.817 sys 0m7.050s 00:12:39.817 20:29:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:39.817 20:29:57 -- common/autotest_common.sh@10 -- # set +x 00:12:39.817 ************************************ 00:12:39.817 END TEST nvmf_rpc 00:12:39.817 ************************************ 00:12:39.817 20:29:57 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:39.817 20:29:57 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:39.817 20:29:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:39.817 20:29:57 -- common/autotest_common.sh@10 -- # set +x 00:12:39.817 ************************************ 00:12:39.817 START TEST nvmf_invalid 00:12:39.817 ************************************ 00:12:39.817 20:29:57 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:39.817 * Looking for test storage... 00:12:39.817 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:39.817 20:29:57 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:39.817 20:29:57 -- nvmf/common.sh@7 -- # uname -s 00:12:39.817 20:29:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:39.817 20:29:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:39.817 20:29:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:39.817 20:29:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:39.817 20:29:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:39.817 20:29:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:39.817 20:29:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:39.817 20:29:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:39.817 20:29:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:39.817 20:29:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:39.817 20:29:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:39.817 20:29:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:39.817 20:29:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:39.817 20:29:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:39.817 20:29:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:39.817 20:29:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:39.817 20:29:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:39.817 20:29:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:39.817 20:29:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:39.817 20:29:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:39.817 20:29:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:39.817 20:29:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:39.817 20:29:57 -- paths/export.sh@5 -- # export PATH 00:12:39.817 20:29:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:39.817 20:29:57 -- nvmf/common.sh@46 -- # : 0 00:12:39.817 20:29:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:39.817 20:29:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:39.817 20:29:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:39.817 20:29:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:39.817 20:29:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:39.817 20:29:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:39.817 20:29:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:39.817 20:29:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:39.817 20:29:57 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:39.817 20:29:57 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:39.817 20:29:57 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:39.817 20:29:57 -- target/invalid.sh@14 -- # target=foobar 00:12:39.817 20:29:57 -- target/invalid.sh@16 -- # RANDOM=0 00:12:39.817 20:29:57 -- target/invalid.sh@34 -- # nvmftestinit 00:12:39.817 20:29:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:39.817 20:29:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:39.817 20:29:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:39.817 20:29:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:39.817 20:29:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:39.817 20:29:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:39.817 20:29:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:39.817 20:29:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:39.817 20:29:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:39.817 20:29:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:39.817 20:29:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:39.817 20:29:57 -- common/autotest_common.sh@10 -- # set +x 00:12:46.408 20:30:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:46.408 20:30:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:46.408 20:30:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:46.408 20:30:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:46.408 20:30:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:46.408 20:30:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:46.408 20:30:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:46.408 20:30:04 -- nvmf/common.sh@294 -- # net_devs=() 00:12:46.408 20:30:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:46.408 20:30:04 -- nvmf/common.sh@295 -- # e810=() 00:12:46.408 20:30:04 -- nvmf/common.sh@295 -- # local -ga e810 00:12:46.408 20:30:04 -- nvmf/common.sh@296 -- # x722=() 00:12:46.408 20:30:04 -- nvmf/common.sh@296 -- # local -ga x722 00:12:46.408 20:30:04 -- nvmf/common.sh@297 -- # mlx=() 00:12:46.408 20:30:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:46.408 20:30:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:46.408 20:30:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:46.408 20:30:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:46.408 20:30:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:46.408 20:30:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:46.408 20:30:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:46.408 20:30:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:46.408 20:30:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:46.408 20:30:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:46.408 20:30:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:46.408 20:30:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:46.408 20:30:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:46.408 20:30:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:46.408 20:30:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:46.408 20:30:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:46.408 20:30:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:12:46.408 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:12:46.408 20:30:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:46.408 20:30:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:12:46.408 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:12:46.408 20:30:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:46.408 20:30:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:46.408 20:30:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:46.408 20:30:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:46.408 20:30:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:46.408 20:30:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:12:46.408 Found net devices under 0000:4b:00.0: cvl_0_0 00:12:46.408 20:30:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:46.408 20:30:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:46.408 20:30:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:46.408 20:30:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:46.408 20:30:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:46.408 20:30:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:12:46.408 Found net devices under 0000:4b:00.1: cvl_0_1 00:12:46.408 20:30:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:46.408 20:30:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:46.408 20:30:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:46.408 20:30:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:46.408 20:30:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:46.408 20:30:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:46.408 20:30:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:46.408 20:30:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:46.408 20:30:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:46.408 20:30:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:46.408 20:30:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:46.408 20:30:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:46.408 20:30:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:46.408 20:30:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:46.408 20:30:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:46.408 20:30:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:46.408 20:30:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:46.408 20:30:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:46.408 20:30:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:46.408 20:30:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:46.408 20:30:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:46.408 20:30:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:46.700 20:30:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:46.700 20:30:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:46.700 20:30:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:46.700 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:46.700 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.715 ms 00:12:46.700 00:12:46.700 --- 10.0.0.2 ping statistics --- 00:12:46.700 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:46.700 rtt min/avg/max/mdev = 0.715/0.715/0.715/0.000 ms 00:12:46.700 20:30:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:46.700 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:46.700 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.228 ms 00:12:46.700 00:12:46.700 --- 10.0.0.1 ping statistics --- 00:12:46.700 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:46.700 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:12:46.700 20:30:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:46.700 20:30:04 -- nvmf/common.sh@410 -- # return 0 00:12:46.700 20:30:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:46.700 20:30:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:46.700 20:30:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:46.700 20:30:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:46.700 20:30:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:46.700 20:30:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:46.700 20:30:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:46.700 20:30:04 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:46.700 20:30:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:46.700 20:30:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:46.700 20:30:04 -- common/autotest_common.sh@10 -- # set +x 00:12:46.700 20:30:04 -- nvmf/common.sh@469 -- # nvmfpid=3952407 00:12:46.700 20:30:04 -- nvmf/common.sh@470 -- # waitforlisten 3952407 00:12:46.700 20:30:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:46.700 20:30:04 -- common/autotest_common.sh@819 -- # '[' -z 3952407 ']' 00:12:46.700 20:30:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:46.700 20:30:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:46.700 20:30:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:46.700 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:46.700 20:30:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:46.700 20:30:04 -- common/autotest_common.sh@10 -- # set +x 00:12:46.700 [2024-04-26 20:30:04.933530] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:12:46.700 [2024-04-26 20:30:04.933578] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:46.700 EAL: No free 2048 kB hugepages reported on node 1 00:12:46.700 [2024-04-26 20:30:04.998879] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:46.970 [2024-04-26 20:30:05.061941] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:46.970 [2024-04-26 20:30:05.062076] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:46.970 [2024-04-26 20:30:05.062087] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:46.970 [2024-04-26 20:30:05.062096] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:46.970 [2024-04-26 20:30:05.062226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:46.970 [2024-04-26 20:30:05.062367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:46.970 [2024-04-26 20:30:05.062397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:46.970 [2024-04-26 20:30:05.062394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:47.543 20:30:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:47.543 20:30:05 -- common/autotest_common.sh@852 -- # return 0 00:12:47.543 20:30:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:47.543 20:30:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:47.543 20:30:05 -- common/autotest_common.sh@10 -- # set +x 00:12:47.543 20:30:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:47.543 20:30:05 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:47.543 20:30:05 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode29377 00:12:47.543 [2024-04-26 20:30:05.877812] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:47.805 20:30:05 -- target/invalid.sh@40 -- # out='request: 00:12:47.805 { 00:12:47.805 "nqn": "nqn.2016-06.io.spdk:cnode29377", 00:12:47.805 "tgt_name": "foobar", 00:12:47.805 "method": "nvmf_create_subsystem", 00:12:47.805 "req_id": 1 00:12:47.805 } 00:12:47.805 Got JSON-RPC error response 00:12:47.805 response: 00:12:47.805 { 00:12:47.805 "code": -32603, 00:12:47.805 "message": "Unable to find target foobar" 00:12:47.805 }' 00:12:47.805 20:30:05 -- target/invalid.sh@41 -- # [[ request: 00:12:47.805 { 00:12:47.805 "nqn": "nqn.2016-06.io.spdk:cnode29377", 00:12:47.805 "tgt_name": "foobar", 00:12:47.805 "method": "nvmf_create_subsystem", 00:12:47.805 "req_id": 1 00:12:47.805 } 00:12:47.805 Got JSON-RPC error response 00:12:47.805 response: 00:12:47.805 { 00:12:47.805 "code": -32603, 00:12:47.805 "message": "Unable to find target foobar" 00:12:47.805 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:47.805 20:30:05 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:47.805 20:30:05 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode10523 00:12:47.805 [2024-04-26 20:30:06.054420] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10523: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:47.805 20:30:06 -- target/invalid.sh@45 -- # out='request: 00:12:47.805 { 00:12:47.805 "nqn": "nqn.2016-06.io.spdk:cnode10523", 00:12:47.805 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:47.805 "method": "nvmf_create_subsystem", 00:12:47.805 "req_id": 1 00:12:47.805 } 00:12:47.805 Got JSON-RPC error response 00:12:47.805 response: 00:12:47.805 { 00:12:47.805 "code": -32602, 00:12:47.805 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:47.805 }' 00:12:47.805 20:30:06 -- target/invalid.sh@46 -- # [[ request: 00:12:47.805 { 00:12:47.805 "nqn": "nqn.2016-06.io.spdk:cnode10523", 00:12:47.805 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:47.805 "method": "nvmf_create_subsystem", 00:12:47.805 "req_id": 1 00:12:47.805 } 00:12:47.805 Got JSON-RPC error response 00:12:47.805 response: 00:12:47.805 { 00:12:47.805 "code": -32602, 00:12:47.805 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:47.805 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:47.805 20:30:06 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:47.805 20:30:06 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode7467 00:12:48.066 [2024-04-26 20:30:06.226976] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode7467: invalid model number 'SPDK_Controller' 00:12:48.066 20:30:06 -- target/invalid.sh@50 -- # out='request: 00:12:48.066 { 00:12:48.066 "nqn": "nqn.2016-06.io.spdk:cnode7467", 00:12:48.066 "model_number": "SPDK_Controller\u001f", 00:12:48.067 "method": "nvmf_create_subsystem", 00:12:48.067 "req_id": 1 00:12:48.067 } 00:12:48.067 Got JSON-RPC error response 00:12:48.067 response: 00:12:48.067 { 00:12:48.067 "code": -32602, 00:12:48.067 "message": "Invalid MN SPDK_Controller\u001f" 00:12:48.067 }' 00:12:48.067 20:30:06 -- target/invalid.sh@51 -- # [[ request: 00:12:48.067 { 00:12:48.067 "nqn": "nqn.2016-06.io.spdk:cnode7467", 00:12:48.067 "model_number": "SPDK_Controller\u001f", 00:12:48.067 "method": "nvmf_create_subsystem", 00:12:48.067 "req_id": 1 00:12:48.067 } 00:12:48.067 Got JSON-RPC error response 00:12:48.067 response: 00:12:48.067 { 00:12:48.067 "code": -32602, 00:12:48.067 "message": "Invalid MN SPDK_Controller\u001f" 00:12:48.067 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:48.067 20:30:06 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:48.067 20:30:06 -- target/invalid.sh@19 -- # local length=21 ll 00:12:48.067 20:30:06 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:48.067 20:30:06 -- target/invalid.sh@21 -- # local chars 00:12:48.067 20:30:06 -- target/invalid.sh@22 -- # local string 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 79 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+=O 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 93 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+=']' 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 48 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x30' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+=0 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 39 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x27' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+=\' 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 124 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+='|' 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 73 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+=I 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 58 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+=: 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 92 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+='\' 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 55 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x37' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+=7 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 36 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x24' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+='$' 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 108 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+=l 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 33 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+='!' 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 83 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+=S 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 126 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+='~' 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 122 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+=z 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 124 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+='|' 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 65 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x41' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+=A 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 33 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+='!' 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # printf %x 69 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:48.067 20:30:06 -- target/invalid.sh@25 -- # string+=E 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.067 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.068 20:30:06 -- target/invalid.sh@25 -- # printf %x 61 00:12:48.068 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:48.068 20:30:06 -- target/invalid.sh@25 -- # string+== 00:12:48.068 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.068 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.068 20:30:06 -- target/invalid.sh@25 -- # printf %x 77 00:12:48.068 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:48.068 20:30:06 -- target/invalid.sh@25 -- # string+=M 00:12:48.068 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.068 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.068 20:30:06 -- target/invalid.sh@28 -- # [[ O == \- ]] 00:12:48.068 20:30:06 -- target/invalid.sh@31 -- # echo 'O]0'\''|I:\7$l!S~z|A!E=M' 00:12:48.329 20:30:06 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'O]0'\''|I:\7$l!S~z|A!E=M' nqn.2016-06.io.spdk:cnode3618 00:12:48.329 [2024-04-26 20:30:06.547964] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode3618: invalid serial number 'O]0'|I:\7$l!S~z|A!E=M' 00:12:48.329 20:30:06 -- target/invalid.sh@54 -- # out='request: 00:12:48.329 { 00:12:48.329 "nqn": "nqn.2016-06.io.spdk:cnode3618", 00:12:48.329 "serial_number": "O]0'\''|I:\\7$l!S~z|A!E=M", 00:12:48.329 "method": "nvmf_create_subsystem", 00:12:48.329 "req_id": 1 00:12:48.329 } 00:12:48.329 Got JSON-RPC error response 00:12:48.329 response: 00:12:48.329 { 00:12:48.329 "code": -32602, 00:12:48.329 "message": "Invalid SN O]0'\''|I:\\7$l!S~z|A!E=M" 00:12:48.329 }' 00:12:48.329 20:30:06 -- target/invalid.sh@55 -- # [[ request: 00:12:48.329 { 00:12:48.329 "nqn": "nqn.2016-06.io.spdk:cnode3618", 00:12:48.329 "serial_number": "O]0'|I:\\7$l!S~z|A!E=M", 00:12:48.329 "method": "nvmf_create_subsystem", 00:12:48.329 "req_id": 1 00:12:48.329 } 00:12:48.329 Got JSON-RPC error response 00:12:48.329 response: 00:12:48.329 { 00:12:48.329 "code": -32602, 00:12:48.329 "message": "Invalid SN O]0'|I:\\7$l!S~z|A!E=M" 00:12:48.329 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:48.329 20:30:06 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:48.329 20:30:06 -- target/invalid.sh@19 -- # local length=41 ll 00:12:48.329 20:30:06 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:48.329 20:30:06 -- target/invalid.sh@21 -- # local chars 00:12:48.329 20:30:06 -- target/invalid.sh@22 -- # local string 00:12:48.329 20:30:06 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # printf %x 87 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x57' 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # string+=W 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # printf %x 52 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x34' 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # string+=4 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # printf %x 71 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x47' 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # string+=G 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # printf %x 124 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # string+='|' 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # printf %x 70 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # string+=F 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # printf %x 91 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # string+='[' 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # printf %x 84 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # string+=T 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # printf %x 49 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x31' 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # string+=1 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # printf %x 50 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x32' 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # string+=2 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # printf %x 110 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # string+=n 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # printf %x 84 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # string+=T 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # printf %x 83 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # string+=S 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.330 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # printf %x 68 00:12:48.330 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=D 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 87 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x57' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=W 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 74 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=J 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 107 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=k 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 74 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=J 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 120 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x78' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=x 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 57 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=9 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 43 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=+ 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 76 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=L 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 40 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x28' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+='(' 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 35 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x23' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+='#' 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 80 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x50' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=P 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 37 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=% 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 113 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x71' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=q 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 120 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x78' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=x 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.592 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # printf %x 70 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:48.592 20:30:06 -- target/invalid.sh@25 -- # string+=F 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # printf %x 97 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x61' 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # string+=a 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # printf %x 105 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x69' 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # string+=i 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # printf %x 34 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # string+='"' 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # printf %x 34 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # string+='"' 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # printf %x 71 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x47' 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # string+=G 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # printf %x 122 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # string+=z 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # printf %x 110 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # string+=n 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # printf %x 87 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x57' 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # string+=W 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # printf %x 115 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x73' 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # string+=s 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # printf %x 102 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x66' 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # string+=f 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # printf %x 126 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # string+='~' 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # printf %x 41 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # string+=')' 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # printf %x 75 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:48.593 20:30:06 -- target/invalid.sh@25 -- # string+=K 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:48.593 20:30:06 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:48.593 20:30:06 -- target/invalid.sh@28 -- # [[ W == \- ]] 00:12:48.593 20:30:06 -- target/invalid.sh@31 -- # echo 'W4G|F[T12nTSDWJkJx9+L(#P%qxFai""GznWsf~)K' 00:12:48.593 20:30:06 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'W4G|F[T12nTSDWJkJx9+L(#P%qxFai""GznWsf~)K' nqn.2016-06.io.spdk:cnode2580 00:12:48.854 [2024-04-26 20:30:06.989416] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2580: invalid model number 'W4G|F[T12nTSDWJkJx9+L(#P%qxFai""GznWsf~)K' 00:12:48.854 20:30:07 -- target/invalid.sh@58 -- # out='request: 00:12:48.854 { 00:12:48.854 "nqn": "nqn.2016-06.io.spdk:cnode2580", 00:12:48.854 "model_number": "W4G|F[T12nTSDWJkJx9+L(#P%qxFai\"\"GznWsf~)K", 00:12:48.854 "method": "nvmf_create_subsystem", 00:12:48.854 "req_id": 1 00:12:48.855 } 00:12:48.855 Got JSON-RPC error response 00:12:48.855 response: 00:12:48.855 { 00:12:48.855 "code": -32602, 00:12:48.855 "message": "Invalid MN W4G|F[T12nTSDWJkJx9+L(#P%qxFai\"\"GznWsf~)K" 00:12:48.855 }' 00:12:48.855 20:30:07 -- target/invalid.sh@59 -- # [[ request: 00:12:48.855 { 00:12:48.855 "nqn": "nqn.2016-06.io.spdk:cnode2580", 00:12:48.855 "model_number": "W4G|F[T12nTSDWJkJx9+L(#P%qxFai\"\"GznWsf~)K", 00:12:48.855 "method": "nvmf_create_subsystem", 00:12:48.855 "req_id": 1 00:12:48.855 } 00:12:48.855 Got JSON-RPC error response 00:12:48.855 response: 00:12:48.855 { 00:12:48.855 "code": -32602, 00:12:48.855 "message": "Invalid MN W4G|F[T12nTSDWJkJx9+L(#P%qxFai\"\"GznWsf~)K" 00:12:48.855 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:48.855 20:30:07 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:48.855 [2024-04-26 20:30:07.158036] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:48.855 20:30:07 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:49.115 20:30:07 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:49.115 20:30:07 -- target/invalid.sh@67 -- # echo '' 00:12:49.115 20:30:07 -- target/invalid.sh@67 -- # head -n 1 00:12:49.115 20:30:07 -- target/invalid.sh@67 -- # IP= 00:12:49.115 20:30:07 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:49.397 [2024-04-26 20:30:07.491102] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:49.397 20:30:07 -- target/invalid.sh@69 -- # out='request: 00:12:49.397 { 00:12:49.397 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:49.397 "listen_address": { 00:12:49.397 "trtype": "tcp", 00:12:49.397 "traddr": "", 00:12:49.397 "trsvcid": "4421" 00:12:49.397 }, 00:12:49.397 "method": "nvmf_subsystem_remove_listener", 00:12:49.397 "req_id": 1 00:12:49.397 } 00:12:49.397 Got JSON-RPC error response 00:12:49.397 response: 00:12:49.397 { 00:12:49.397 "code": -32602, 00:12:49.397 "message": "Invalid parameters" 00:12:49.397 }' 00:12:49.397 20:30:07 -- target/invalid.sh@70 -- # [[ request: 00:12:49.397 { 00:12:49.397 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:49.397 "listen_address": { 00:12:49.397 "trtype": "tcp", 00:12:49.397 "traddr": "", 00:12:49.397 "trsvcid": "4421" 00:12:49.397 }, 00:12:49.397 "method": "nvmf_subsystem_remove_listener", 00:12:49.397 "req_id": 1 00:12:49.397 } 00:12:49.397 Got JSON-RPC error response 00:12:49.397 response: 00:12:49.397 { 00:12:49.397 "code": -32602, 00:12:49.397 "message": "Invalid parameters" 00:12:49.397 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:49.397 20:30:07 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11771 -i 0 00:12:49.397 [2024-04-26 20:30:07.655598] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode11771: invalid cntlid range [0-65519] 00:12:49.397 20:30:07 -- target/invalid.sh@73 -- # out='request: 00:12:49.397 { 00:12:49.397 "nqn": "nqn.2016-06.io.spdk:cnode11771", 00:12:49.397 "min_cntlid": 0, 00:12:49.397 "method": "nvmf_create_subsystem", 00:12:49.397 "req_id": 1 00:12:49.397 } 00:12:49.397 Got JSON-RPC error response 00:12:49.397 response: 00:12:49.397 { 00:12:49.397 "code": -32602, 00:12:49.397 "message": "Invalid cntlid range [0-65519]" 00:12:49.397 }' 00:12:49.397 20:30:07 -- target/invalid.sh@74 -- # [[ request: 00:12:49.397 { 00:12:49.397 "nqn": "nqn.2016-06.io.spdk:cnode11771", 00:12:49.397 "min_cntlid": 0, 00:12:49.397 "method": "nvmf_create_subsystem", 00:12:49.397 "req_id": 1 00:12:49.397 } 00:12:49.397 Got JSON-RPC error response 00:12:49.397 response: 00:12:49.397 { 00:12:49.397 "code": -32602, 00:12:49.397 "message": "Invalid cntlid range [0-65519]" 00:12:49.397 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:49.397 20:30:07 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode13200 -i 65520 00:12:49.658 [2024-04-26 20:30:07.824192] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode13200: invalid cntlid range [65520-65519] 00:12:49.658 20:30:07 -- target/invalid.sh@75 -- # out='request: 00:12:49.658 { 00:12:49.658 "nqn": "nqn.2016-06.io.spdk:cnode13200", 00:12:49.658 "min_cntlid": 65520, 00:12:49.658 "method": "nvmf_create_subsystem", 00:12:49.658 "req_id": 1 00:12:49.658 } 00:12:49.658 Got JSON-RPC error response 00:12:49.658 response: 00:12:49.658 { 00:12:49.658 "code": -32602, 00:12:49.658 "message": "Invalid cntlid range [65520-65519]" 00:12:49.658 }' 00:12:49.658 20:30:07 -- target/invalid.sh@76 -- # [[ request: 00:12:49.658 { 00:12:49.658 "nqn": "nqn.2016-06.io.spdk:cnode13200", 00:12:49.658 "min_cntlid": 65520, 00:12:49.658 "method": "nvmf_create_subsystem", 00:12:49.658 "req_id": 1 00:12:49.658 } 00:12:49.658 Got JSON-RPC error response 00:12:49.658 response: 00:12:49.658 { 00:12:49.658 "code": -32602, 00:12:49.658 "message": "Invalid cntlid range [65520-65519]" 00:12:49.658 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:49.658 20:30:07 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode29741 -I 0 00:12:49.658 [2024-04-26 20:30:07.988735] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode29741: invalid cntlid range [1-0] 00:12:49.919 20:30:08 -- target/invalid.sh@77 -- # out='request: 00:12:49.919 { 00:12:49.919 "nqn": "nqn.2016-06.io.spdk:cnode29741", 00:12:49.919 "max_cntlid": 0, 00:12:49.919 "method": "nvmf_create_subsystem", 00:12:49.919 "req_id": 1 00:12:49.919 } 00:12:49.919 Got JSON-RPC error response 00:12:49.919 response: 00:12:49.919 { 00:12:49.919 "code": -32602, 00:12:49.919 "message": "Invalid cntlid range [1-0]" 00:12:49.919 }' 00:12:49.919 20:30:08 -- target/invalid.sh@78 -- # [[ request: 00:12:49.919 { 00:12:49.919 "nqn": "nqn.2016-06.io.spdk:cnode29741", 00:12:49.919 "max_cntlid": 0, 00:12:49.919 "method": "nvmf_create_subsystem", 00:12:49.919 "req_id": 1 00:12:49.919 } 00:12:49.919 Got JSON-RPC error response 00:12:49.919 response: 00:12:49.919 { 00:12:49.919 "code": -32602, 00:12:49.919 "message": "Invalid cntlid range [1-0]" 00:12:49.919 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:49.919 20:30:08 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode15917 -I 65520 00:12:49.919 [2024-04-26 20:30:08.161309] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15917: invalid cntlid range [1-65520] 00:12:49.919 20:30:08 -- target/invalid.sh@79 -- # out='request: 00:12:49.919 { 00:12:49.919 "nqn": "nqn.2016-06.io.spdk:cnode15917", 00:12:49.919 "max_cntlid": 65520, 00:12:49.919 "method": "nvmf_create_subsystem", 00:12:49.919 "req_id": 1 00:12:49.919 } 00:12:49.919 Got JSON-RPC error response 00:12:49.919 response: 00:12:49.919 { 00:12:49.919 "code": -32602, 00:12:49.919 "message": "Invalid cntlid range [1-65520]" 00:12:49.919 }' 00:12:49.919 20:30:08 -- target/invalid.sh@80 -- # [[ request: 00:12:49.919 { 00:12:49.919 "nqn": "nqn.2016-06.io.spdk:cnode15917", 00:12:49.919 "max_cntlid": 65520, 00:12:49.919 "method": "nvmf_create_subsystem", 00:12:49.919 "req_id": 1 00:12:49.919 } 00:12:49.919 Got JSON-RPC error response 00:12:49.919 response: 00:12:49.919 { 00:12:49.919 "code": -32602, 00:12:49.919 "message": "Invalid cntlid range [1-65520]" 00:12:49.919 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:49.919 20:30:08 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode29059 -i 6 -I 5 00:12:50.181 [2024-04-26 20:30:08.333909] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode29059: invalid cntlid range [6-5] 00:12:50.181 20:30:08 -- target/invalid.sh@83 -- # out='request: 00:12:50.181 { 00:12:50.181 "nqn": "nqn.2016-06.io.spdk:cnode29059", 00:12:50.181 "min_cntlid": 6, 00:12:50.181 "max_cntlid": 5, 00:12:50.181 "method": "nvmf_create_subsystem", 00:12:50.181 "req_id": 1 00:12:50.181 } 00:12:50.181 Got JSON-RPC error response 00:12:50.181 response: 00:12:50.181 { 00:12:50.181 "code": -32602, 00:12:50.181 "message": "Invalid cntlid range [6-5]" 00:12:50.181 }' 00:12:50.181 20:30:08 -- target/invalid.sh@84 -- # [[ request: 00:12:50.181 { 00:12:50.181 "nqn": "nqn.2016-06.io.spdk:cnode29059", 00:12:50.181 "min_cntlid": 6, 00:12:50.181 "max_cntlid": 5, 00:12:50.181 "method": "nvmf_create_subsystem", 00:12:50.181 "req_id": 1 00:12:50.181 } 00:12:50.181 Got JSON-RPC error response 00:12:50.181 response: 00:12:50.181 { 00:12:50.181 "code": -32602, 00:12:50.181 "message": "Invalid cntlid range [6-5]" 00:12:50.181 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:50.181 20:30:08 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:50.181 20:30:08 -- target/invalid.sh@87 -- # out='request: 00:12:50.181 { 00:12:50.181 "name": "foobar", 00:12:50.181 "method": "nvmf_delete_target", 00:12:50.181 "req_id": 1 00:12:50.181 } 00:12:50.181 Got JSON-RPC error response 00:12:50.181 response: 00:12:50.181 { 00:12:50.181 "code": -32602, 00:12:50.181 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:50.181 }' 00:12:50.181 20:30:08 -- target/invalid.sh@88 -- # [[ request: 00:12:50.181 { 00:12:50.181 "name": "foobar", 00:12:50.181 "method": "nvmf_delete_target", 00:12:50.181 "req_id": 1 00:12:50.181 } 00:12:50.181 Got JSON-RPC error response 00:12:50.181 response: 00:12:50.181 { 00:12:50.181 "code": -32602, 00:12:50.181 "message": "The specified target doesn't exist, cannot delete it." 00:12:50.181 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:50.181 20:30:08 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:50.181 20:30:08 -- target/invalid.sh@91 -- # nvmftestfini 00:12:50.181 20:30:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:50.181 20:30:08 -- nvmf/common.sh@116 -- # sync 00:12:50.181 20:30:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:50.181 20:30:08 -- nvmf/common.sh@119 -- # set +e 00:12:50.181 20:30:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:50.181 20:30:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:50.181 rmmod nvme_tcp 00:12:50.181 rmmod nvme_fabrics 00:12:50.181 rmmod nvme_keyring 00:12:50.181 20:30:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:50.181 20:30:08 -- nvmf/common.sh@123 -- # set -e 00:12:50.181 20:30:08 -- nvmf/common.sh@124 -- # return 0 00:12:50.181 20:30:08 -- nvmf/common.sh@477 -- # '[' -n 3952407 ']' 00:12:50.181 20:30:08 -- nvmf/common.sh@478 -- # killprocess 3952407 00:12:50.181 20:30:08 -- common/autotest_common.sh@926 -- # '[' -z 3952407 ']' 00:12:50.181 20:30:08 -- common/autotest_common.sh@930 -- # kill -0 3952407 00:12:50.181 20:30:08 -- common/autotest_common.sh@931 -- # uname 00:12:50.181 20:30:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:50.181 20:30:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3952407 00:12:50.443 20:30:08 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:50.443 20:30:08 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:50.443 20:30:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3952407' 00:12:50.443 killing process with pid 3952407 00:12:50.443 20:30:08 -- common/autotest_common.sh@945 -- # kill 3952407 00:12:50.443 20:30:08 -- common/autotest_common.sh@950 -- # wait 3952407 00:12:50.443 20:30:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:50.443 20:30:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:50.443 20:30:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:50.443 20:30:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:50.443 20:30:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:50.443 20:30:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:50.443 20:30:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:50.443 20:30:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:52.991 20:30:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:52.991 00:12:52.991 real 0m13.090s 00:12:52.991 user 0m18.552s 00:12:52.991 sys 0m6.155s 00:12:52.991 20:30:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:52.991 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:12:52.991 ************************************ 00:12:52.991 END TEST nvmf_invalid 00:12:52.991 ************************************ 00:12:52.991 20:30:10 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:52.991 20:30:10 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:52.991 20:30:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:52.991 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:12:52.991 ************************************ 00:12:52.991 START TEST nvmf_abort 00:12:52.991 ************************************ 00:12:52.991 20:30:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:52.991 * Looking for test storage... 00:12:52.991 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:52.991 20:30:10 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:52.991 20:30:10 -- nvmf/common.sh@7 -- # uname -s 00:12:52.991 20:30:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:52.991 20:30:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:52.991 20:30:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:52.991 20:30:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:52.991 20:30:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:52.991 20:30:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:52.991 20:30:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:52.991 20:30:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:52.991 20:30:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:52.991 20:30:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:52.991 20:30:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:52.991 20:30:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:52.991 20:30:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:52.991 20:30:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:52.991 20:30:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:52.991 20:30:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:52.991 20:30:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:52.991 20:30:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:52.991 20:30:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:52.991 20:30:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.991 20:30:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.991 20:30:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.991 20:30:10 -- paths/export.sh@5 -- # export PATH 00:12:52.991 20:30:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:52.991 20:30:10 -- nvmf/common.sh@46 -- # : 0 00:12:52.991 20:30:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:52.991 20:30:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:52.991 20:30:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:52.991 20:30:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:52.991 20:30:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:52.991 20:30:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:52.991 20:30:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:52.991 20:30:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:52.991 20:30:10 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:52.991 20:30:10 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:52.991 20:30:10 -- target/abort.sh@14 -- # nvmftestinit 00:12:52.992 20:30:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:52.992 20:30:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:52.992 20:30:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:52.992 20:30:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:52.992 20:30:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:52.992 20:30:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:52.992 20:30:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:52.992 20:30:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:52.992 20:30:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:52.992 20:30:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:52.992 20:30:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:52.992 20:30:10 -- common/autotest_common.sh@10 -- # set +x 00:12:59.586 20:30:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:59.586 20:30:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:59.586 20:30:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:59.586 20:30:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:59.586 20:30:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:59.586 20:30:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:59.586 20:30:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:59.586 20:30:17 -- nvmf/common.sh@294 -- # net_devs=() 00:12:59.586 20:30:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:59.586 20:30:17 -- nvmf/common.sh@295 -- # e810=() 00:12:59.586 20:30:17 -- nvmf/common.sh@295 -- # local -ga e810 00:12:59.586 20:30:17 -- nvmf/common.sh@296 -- # x722=() 00:12:59.586 20:30:17 -- nvmf/common.sh@296 -- # local -ga x722 00:12:59.587 20:30:17 -- nvmf/common.sh@297 -- # mlx=() 00:12:59.587 20:30:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:59.587 20:30:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:59.587 20:30:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:59.587 20:30:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:59.587 20:30:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:59.587 20:30:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:59.587 20:30:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:59.587 20:30:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:59.587 20:30:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:59.587 20:30:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:59.587 20:30:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:59.587 20:30:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:59.587 20:30:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:59.587 20:30:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:59.587 20:30:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:59.587 20:30:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:59.587 20:30:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:12:59.587 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:12:59.587 20:30:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:59.587 20:30:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:12:59.587 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:12:59.587 20:30:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:59.587 20:30:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:59.587 20:30:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:59.587 20:30:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:59.587 20:30:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:59.587 20:30:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:12:59.587 Found net devices under 0000:4b:00.0: cvl_0_0 00:12:59.587 20:30:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:59.587 20:30:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:59.587 20:30:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:59.587 20:30:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:59.587 20:30:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:59.587 20:30:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:12:59.587 Found net devices under 0000:4b:00.1: cvl_0_1 00:12:59.587 20:30:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:59.587 20:30:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:59.587 20:30:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:59.587 20:30:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:59.587 20:30:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:59.587 20:30:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:59.587 20:30:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:59.587 20:30:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:59.587 20:30:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:59.587 20:30:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:59.587 20:30:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:59.587 20:30:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:59.587 20:30:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:59.587 20:30:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:59.587 20:30:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:59.587 20:30:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:59.587 20:30:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:59.587 20:30:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:59.587 20:30:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:59.587 20:30:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:59.587 20:30:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:59.587 20:30:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:59.587 20:30:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:59.587 20:30:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:59.587 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:59.587 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.683 ms 00:12:59.587 00:12:59.587 --- 10.0.0.2 ping statistics --- 00:12:59.587 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:59.587 rtt min/avg/max/mdev = 0.683/0.683/0.683/0.000 ms 00:12:59.587 20:30:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:59.587 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:59.587 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.416 ms 00:12:59.587 00:12:59.587 --- 10.0.0.1 ping statistics --- 00:12:59.587 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:59.587 rtt min/avg/max/mdev = 0.416/0.416/0.416/0.000 ms 00:12:59.587 20:30:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:59.587 20:30:17 -- nvmf/common.sh@410 -- # return 0 00:12:59.587 20:30:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:59.587 20:30:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:59.587 20:30:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:59.587 20:30:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:59.587 20:30:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:59.587 20:30:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:59.587 20:30:17 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:59.587 20:30:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:59.587 20:30:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:59.587 20:30:17 -- common/autotest_common.sh@10 -- # set +x 00:12:59.587 20:30:17 -- nvmf/common.sh@469 -- # nvmfpid=3957734 00:12:59.587 20:30:17 -- nvmf/common.sh@470 -- # waitforlisten 3957734 00:12:59.587 20:30:17 -- common/autotest_common.sh@819 -- # '[' -z 3957734 ']' 00:12:59.587 20:30:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:59.587 20:30:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:59.587 20:30:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:59.587 20:30:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:59.587 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:59.587 20:30:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:59.587 20:30:17 -- common/autotest_common.sh@10 -- # set +x 00:12:59.587 [2024-04-26 20:30:17.494605] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:12:59.587 [2024-04-26 20:30:17.494665] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:59.587 EAL: No free 2048 kB hugepages reported on node 1 00:12:59.587 [2024-04-26 20:30:17.557754] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:59.587 [2024-04-26 20:30:17.621669] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:59.587 [2024-04-26 20:30:17.621783] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:59.587 [2024-04-26 20:30:17.621792] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:59.587 [2024-04-26 20:30:17.621799] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:59.587 [2024-04-26 20:30:17.621950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:59.587 [2024-04-26 20:30:17.622080] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:59.587 [2024-04-26 20:30:17.622082] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:00.159 20:30:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:00.160 20:30:18 -- common/autotest_common.sh@852 -- # return 0 00:13:00.160 20:30:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:00.160 20:30:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:00.160 20:30:18 -- common/autotest_common.sh@10 -- # set +x 00:13:00.160 20:30:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:00.160 20:30:18 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:00.160 20:30:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:00.160 20:30:18 -- common/autotest_common.sh@10 -- # set +x 00:13:00.160 [2024-04-26 20:30:18.313715] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:00.160 20:30:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:00.160 20:30:18 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:00.160 20:30:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:00.160 20:30:18 -- common/autotest_common.sh@10 -- # set +x 00:13:00.160 Malloc0 00:13:00.160 20:30:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:00.160 20:30:18 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:00.160 20:30:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:00.160 20:30:18 -- common/autotest_common.sh@10 -- # set +x 00:13:00.160 Delay0 00:13:00.160 20:30:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:00.160 20:30:18 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:00.160 20:30:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:00.160 20:30:18 -- common/autotest_common.sh@10 -- # set +x 00:13:00.160 20:30:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:00.160 20:30:18 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:00.160 20:30:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:00.160 20:30:18 -- common/autotest_common.sh@10 -- # set +x 00:13:00.160 20:30:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:00.160 20:30:18 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:00.160 20:30:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:00.160 20:30:18 -- common/autotest_common.sh@10 -- # set +x 00:13:00.160 [2024-04-26 20:30:18.391748] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:00.160 20:30:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:00.160 20:30:18 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:00.160 20:30:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:00.160 20:30:18 -- common/autotest_common.sh@10 -- # set +x 00:13:00.160 20:30:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:00.160 20:30:18 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:00.160 EAL: No free 2048 kB hugepages reported on node 1 00:13:00.160 [2024-04-26 20:30:18.502748] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:02.734 Initializing NVMe Controllers 00:13:02.734 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:02.734 controller IO queue size 128 less than required 00:13:02.734 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:02.734 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:02.734 Initialization complete. Launching workers. 00:13:02.734 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 28506 00:13:02.734 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 28567, failed to submit 62 00:13:02.734 success 28506, unsuccess 61, failed 0 00:13:02.734 20:30:20 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:02.734 20:30:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.734 20:30:20 -- common/autotest_common.sh@10 -- # set +x 00:13:02.734 20:30:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.734 20:30:20 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:02.734 20:30:20 -- target/abort.sh@38 -- # nvmftestfini 00:13:02.734 20:30:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:02.734 20:30:20 -- nvmf/common.sh@116 -- # sync 00:13:02.734 20:30:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:02.734 20:30:20 -- nvmf/common.sh@119 -- # set +e 00:13:02.734 20:30:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:02.734 20:30:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:02.734 rmmod nvme_tcp 00:13:02.734 rmmod nvme_fabrics 00:13:02.734 rmmod nvme_keyring 00:13:02.734 20:30:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:02.734 20:30:20 -- nvmf/common.sh@123 -- # set -e 00:13:02.734 20:30:20 -- nvmf/common.sh@124 -- # return 0 00:13:02.734 20:30:20 -- nvmf/common.sh@477 -- # '[' -n 3957734 ']' 00:13:02.734 20:30:20 -- nvmf/common.sh@478 -- # killprocess 3957734 00:13:02.734 20:30:20 -- common/autotest_common.sh@926 -- # '[' -z 3957734 ']' 00:13:02.734 20:30:20 -- common/autotest_common.sh@930 -- # kill -0 3957734 00:13:02.734 20:30:20 -- common/autotest_common.sh@931 -- # uname 00:13:02.734 20:30:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:02.734 20:30:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3957734 00:13:02.734 20:30:20 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:02.734 20:30:20 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:02.734 20:30:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3957734' 00:13:02.734 killing process with pid 3957734 00:13:02.734 20:30:20 -- common/autotest_common.sh@945 -- # kill 3957734 00:13:02.734 20:30:20 -- common/autotest_common.sh@950 -- # wait 3957734 00:13:02.734 20:30:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:02.734 20:30:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:02.734 20:30:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:02.734 20:30:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:02.734 20:30:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:02.734 20:30:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:02.734 20:30:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:02.734 20:30:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:04.650 20:30:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:04.650 00:13:04.650 real 0m12.073s 00:13:04.650 user 0m12.955s 00:13:04.650 sys 0m5.767s 00:13:04.650 20:30:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:04.650 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:13:04.650 ************************************ 00:13:04.650 END TEST nvmf_abort 00:13:04.650 ************************************ 00:13:04.650 20:30:22 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:04.650 20:30:22 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:04.650 20:30:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:04.650 20:30:22 -- common/autotest_common.sh@10 -- # set +x 00:13:04.650 ************************************ 00:13:04.650 START TEST nvmf_ns_hotplug_stress 00:13:04.650 ************************************ 00:13:04.650 20:30:22 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:04.912 * Looking for test storage... 00:13:04.912 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:04.912 20:30:23 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:04.912 20:30:23 -- nvmf/common.sh@7 -- # uname -s 00:13:04.912 20:30:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:04.912 20:30:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:04.912 20:30:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:04.912 20:30:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:04.912 20:30:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:04.912 20:30:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:04.912 20:30:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:04.912 20:30:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:04.912 20:30:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:04.912 20:30:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:04.912 20:30:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:04.912 20:30:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:04.912 20:30:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:04.912 20:30:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:04.912 20:30:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:04.912 20:30:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:04.912 20:30:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:04.912 20:30:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:04.912 20:30:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:04.912 20:30:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:04.912 20:30:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:04.912 20:30:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:04.912 20:30:23 -- paths/export.sh@5 -- # export PATH 00:13:04.912 20:30:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:04.912 20:30:23 -- nvmf/common.sh@46 -- # : 0 00:13:04.912 20:30:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:04.912 20:30:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:04.912 20:30:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:04.912 20:30:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:04.912 20:30:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:04.912 20:30:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:04.912 20:30:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:04.912 20:30:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:04.912 20:30:23 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:04.912 20:30:23 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:13:04.912 20:30:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:04.912 20:30:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:04.912 20:30:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:04.912 20:30:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:04.912 20:30:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:04.912 20:30:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:04.912 20:30:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:04.912 20:30:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:04.912 20:30:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:04.912 20:30:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:04.912 20:30:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:04.913 20:30:23 -- common/autotest_common.sh@10 -- # set +x 00:13:11.506 20:30:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:11.506 20:30:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:11.506 20:30:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:11.506 20:30:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:11.506 20:30:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:11.506 20:30:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:11.506 20:30:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:11.506 20:30:29 -- nvmf/common.sh@294 -- # net_devs=() 00:13:11.506 20:30:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:11.506 20:30:29 -- nvmf/common.sh@295 -- # e810=() 00:13:11.506 20:30:29 -- nvmf/common.sh@295 -- # local -ga e810 00:13:11.506 20:30:29 -- nvmf/common.sh@296 -- # x722=() 00:13:11.506 20:30:29 -- nvmf/common.sh@296 -- # local -ga x722 00:13:11.506 20:30:29 -- nvmf/common.sh@297 -- # mlx=() 00:13:11.506 20:30:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:11.506 20:30:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:11.506 20:30:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:11.506 20:30:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:11.506 20:30:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:11.506 20:30:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:11.507 20:30:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:11.507 20:30:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:11.507 20:30:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:11.507 20:30:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:11.507 20:30:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:11.507 20:30:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:11.507 20:30:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:11.507 20:30:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:11.507 20:30:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:11.507 20:30:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:11.507 20:30:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:13:11.507 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:13:11.507 20:30:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:11.507 20:30:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:13:11.507 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:13:11.507 20:30:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:11.507 20:30:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:11.507 20:30:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:11.507 20:30:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:11.507 20:30:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:11.507 20:30:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:13:11.507 Found net devices under 0000:4b:00.0: cvl_0_0 00:13:11.507 20:30:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:11.507 20:30:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:11.507 20:30:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:11.507 20:30:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:11.507 20:30:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:11.507 20:30:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:13:11.507 Found net devices under 0000:4b:00.1: cvl_0_1 00:13:11.507 20:30:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:11.507 20:30:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:11.507 20:30:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:11.507 20:30:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:11.507 20:30:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:11.507 20:30:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:11.507 20:30:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:11.507 20:30:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:11.507 20:30:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:11.507 20:30:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:11.507 20:30:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:11.507 20:30:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:11.507 20:30:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:11.507 20:30:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:11.507 20:30:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:11.507 20:30:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:11.507 20:30:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:11.768 20:30:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:11.768 20:30:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:11.768 20:30:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:11.768 20:30:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:11.768 20:30:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:11.768 20:30:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:12.030 20:30:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:12.030 20:30:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:12.030 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:12.030 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.703 ms 00:13:12.030 00:13:12.030 --- 10.0.0.2 ping statistics --- 00:13:12.030 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:12.030 rtt min/avg/max/mdev = 0.703/0.703/0.703/0.000 ms 00:13:12.030 20:30:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:12.030 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:12.030 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.451 ms 00:13:12.030 00:13:12.030 --- 10.0.0.1 ping statistics --- 00:13:12.030 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:12.030 rtt min/avg/max/mdev = 0.451/0.451/0.451/0.000 ms 00:13:12.030 20:30:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:12.030 20:30:30 -- nvmf/common.sh@410 -- # return 0 00:13:12.030 20:30:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:12.030 20:30:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:12.030 20:30:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:12.030 20:30:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:12.030 20:30:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:12.030 20:30:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:12.030 20:30:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:12.030 20:30:30 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:13:12.030 20:30:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:12.030 20:30:30 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:12.030 20:30:30 -- common/autotest_common.sh@10 -- # set +x 00:13:12.030 20:30:30 -- nvmf/common.sh@469 -- # nvmfpid=3962731 00:13:12.030 20:30:30 -- nvmf/common.sh@470 -- # waitforlisten 3962731 00:13:12.030 20:30:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:12.030 20:30:30 -- common/autotest_common.sh@819 -- # '[' -z 3962731 ']' 00:13:12.030 20:30:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:12.030 20:30:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:12.030 20:30:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:12.030 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:12.030 20:30:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:12.030 20:30:30 -- common/autotest_common.sh@10 -- # set +x 00:13:12.030 [2024-04-26 20:30:30.255929] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:13:12.030 [2024-04-26 20:30:30.255993] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:12.030 EAL: No free 2048 kB hugepages reported on node 1 00:13:12.030 [2024-04-26 20:30:30.328657] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:12.291 [2024-04-26 20:30:30.399032] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:12.291 [2024-04-26 20:30:30.399164] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:12.291 [2024-04-26 20:30:30.399172] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:12.291 [2024-04-26 20:30:30.399179] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:12.291 [2024-04-26 20:30:30.399307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:12.291 [2024-04-26 20:30:30.399478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:12.291 [2024-04-26 20:30:30.399481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:12.910 20:30:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:12.910 20:30:31 -- common/autotest_common.sh@852 -- # return 0 00:13:12.910 20:30:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:12.910 20:30:31 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:12.910 20:30:31 -- common/autotest_common.sh@10 -- # set +x 00:13:12.910 20:30:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:12.910 20:30:31 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:13:12.910 20:30:31 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:12.910 [2024-04-26 20:30:31.215689] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:12.910 20:30:31 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:13.170 20:30:31 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:13.431 [2024-04-26 20:30:31.549137] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:13.431 20:30:31 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:13.431 20:30:31 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:13.693 Malloc0 00:13:13.693 20:30:31 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:13.955 Delay0 00:13:13.955 20:30:32 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:13.955 20:30:32 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:14.215 NULL1 00:13:14.216 20:30:32 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:14.476 20:30:32 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:14.476 20:30:32 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=3963148 00:13:14.476 20:30:32 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:14.476 20:30:32 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.476 EAL: No free 2048 kB hugepages reported on node 1 00:13:14.476 20:30:32 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:14.738 20:30:32 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:13:14.738 20:30:32 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:14.738 [2024-04-26 20:30:33.063666] bdev.c:4963:_tmp_bdev_event_cb: *NOTICE*: Unexpected event type: 1 00:13:14.738 true 00:13:15.000 20:30:33 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:15.000 20:30:33 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.000 20:30:33 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:15.261 20:30:33 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:13:15.261 20:30:33 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:13:15.261 true 00:13:15.261 20:30:33 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:15.261 20:30:33 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.522 20:30:33 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:15.782 20:30:33 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:13:15.782 20:30:33 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:13:15.782 true 00:13:15.782 20:30:34 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:15.782 20:30:34 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.043 20:30:34 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:16.304 20:30:34 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:13:16.304 20:30:34 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:13:16.304 true 00:13:16.304 20:30:34 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:16.304 20:30:34 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.566 20:30:34 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:16.827 20:30:34 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:13:16.827 20:30:34 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:13:16.827 true 00:13:16.827 20:30:35 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:16.827 20:30:35 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.088 20:30:35 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:17.350 20:30:35 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:13:17.350 20:30:35 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:13:17.350 true 00:13:17.350 20:30:35 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:17.350 20:30:35 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.611 20:30:35 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:17.872 20:30:35 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:13:17.872 20:30:35 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:13:17.872 true 00:13:17.872 20:30:36 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:17.872 20:30:36 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.133 20:30:36 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:18.394 20:30:36 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:13:18.394 20:30:36 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:13:18.394 true 00:13:18.394 20:30:36 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:18.394 20:30:36 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.655 20:30:36 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:18.655 20:30:36 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:13:18.655 20:30:36 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:13:18.965 true 00:13:18.965 20:30:37 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:18.965 20:30:37 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.225 20:30:37 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:19.225 20:30:37 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:13:19.225 20:30:37 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:13:19.485 true 00:13:19.485 20:30:37 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:19.485 20:30:37 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.745 20:30:37 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:19.745 20:30:38 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:13:19.745 20:30:38 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:20.005 true 00:13:20.005 20:30:38 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:20.005 20:30:38 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:20.005 20:30:38 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:20.266 20:30:38 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:13:20.266 20:30:38 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:20.527 true 00:13:20.527 20:30:38 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:20.527 20:30:38 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:20.527 20:30:38 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:20.787 20:30:39 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:13:20.787 20:30:39 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:21.047 true 00:13:21.047 20:30:39 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:21.047 20:30:39 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.047 20:30:39 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:21.308 20:30:39 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:13:21.308 20:30:39 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:21.570 true 00:13:21.570 20:30:39 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:21.570 20:30:39 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.570 20:30:39 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:21.831 20:30:40 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:13:21.831 20:30:40 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:21.831 true 00:13:22.092 20:30:40 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:22.092 20:30:40 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.092 20:30:40 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:22.353 20:30:40 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:13:22.353 20:30:40 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:22.353 true 00:13:22.353 20:30:40 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:22.353 20:30:40 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.614 20:30:40 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:22.875 20:30:41 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:13:22.875 20:30:41 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:22.875 true 00:13:22.875 20:30:41 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:22.875 20:30:41 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.137 20:30:41 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:23.398 20:30:41 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:13:23.398 20:30:41 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:23.398 true 00:13:23.398 20:30:41 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:23.398 20:30:41 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.659 20:30:41 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:23.920 20:30:42 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:13:23.920 20:30:42 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:23.920 true 00:13:23.920 20:30:42 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:23.920 20:30:42 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.181 20:30:42 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:24.442 20:30:42 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:13:24.442 20:30:42 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:24.442 true 00:13:24.442 20:30:42 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:24.442 20:30:42 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.709 20:30:42 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:24.709 20:30:43 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:13:24.709 20:30:43 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:24.975 true 00:13:24.975 20:30:43 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:24.975 20:30:43 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.236 20:30:43 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:25.236 20:30:43 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:13:25.236 20:30:43 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:25.497 true 00:13:25.497 20:30:43 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:25.497 20:30:43 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.758 20:30:43 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:25.758 20:30:44 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:13:25.758 20:30:44 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:26.019 true 00:13:26.019 20:30:44 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:26.019 20:30:44 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:26.281 20:30:44 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:26.281 20:30:44 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:13:26.281 20:30:44 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:26.542 true 00:13:26.542 20:30:44 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:26.542 20:30:44 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:26.542 20:30:44 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:26.803 20:30:45 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:13:26.803 20:30:45 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:27.064 true 00:13:27.064 20:30:45 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:27.064 20:30:45 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:27.064 20:30:45 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:27.325 20:30:45 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:13:27.325 20:30:45 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:27.325 true 00:13:27.587 20:30:45 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:27.587 20:30:45 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:27.587 20:30:45 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:27.847 20:30:46 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:13:27.847 20:30:46 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:27.847 true 00:13:28.108 20:30:46 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:28.108 20:30:46 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:28.108 20:30:46 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:28.378 20:30:46 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:13:28.378 20:30:46 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:28.378 true 00:13:28.378 20:30:46 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:28.378 20:30:46 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:28.647 20:30:46 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:28.907 20:30:47 -- target/ns_hotplug_stress.sh@40 -- # null_size=1029 00:13:28.907 20:30:47 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:28.907 true 00:13:28.907 20:30:47 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:28.907 20:30:47 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:29.168 20:30:47 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:29.429 20:30:47 -- target/ns_hotplug_stress.sh@40 -- # null_size=1030 00:13:29.429 20:30:47 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:13:29.429 true 00:13:29.429 20:30:47 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:29.429 20:30:47 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:29.690 20:30:47 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:29.951 20:30:48 -- target/ns_hotplug_stress.sh@40 -- # null_size=1031 00:13:29.951 20:30:48 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1031 00:13:29.951 true 00:13:29.951 20:30:48 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:29.951 20:30:48 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:30.212 20:30:48 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:30.473 20:30:48 -- target/ns_hotplug_stress.sh@40 -- # null_size=1032 00:13:30.473 20:30:48 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1032 00:13:30.473 true 00:13:30.474 20:30:48 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:30.474 20:30:48 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:30.735 20:30:48 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:30.735 20:30:49 -- target/ns_hotplug_stress.sh@40 -- # null_size=1033 00:13:30.735 20:30:49 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1033 00:13:30.996 true 00:13:30.996 20:30:49 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:30.996 20:30:49 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:31.257 20:30:49 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:31.257 20:30:49 -- target/ns_hotplug_stress.sh@40 -- # null_size=1034 00:13:31.257 20:30:49 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1034 00:13:31.518 true 00:13:31.518 20:30:49 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:31.518 20:30:49 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:31.779 20:30:49 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:31.779 20:30:50 -- target/ns_hotplug_stress.sh@40 -- # null_size=1035 00:13:31.779 20:30:50 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1035 00:13:32.040 true 00:13:32.040 20:30:50 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:32.040 20:30:50 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.301 20:30:50 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:32.301 20:30:50 -- target/ns_hotplug_stress.sh@40 -- # null_size=1036 00:13:32.301 20:30:50 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1036 00:13:32.561 true 00:13:32.561 20:30:50 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:32.561 20:30:50 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.561 20:30:50 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:32.822 20:30:51 -- target/ns_hotplug_stress.sh@40 -- # null_size=1037 00:13:32.822 20:30:51 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1037 00:13:33.083 true 00:13:33.083 20:30:51 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:33.083 20:30:51 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.345 20:30:51 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:33.345 20:30:51 -- target/ns_hotplug_stress.sh@40 -- # null_size=1038 00:13:33.345 20:30:51 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1038 00:13:33.606 true 00:13:33.606 20:30:51 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:33.606 20:30:51 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.606 20:30:51 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:33.867 20:30:52 -- target/ns_hotplug_stress.sh@40 -- # null_size=1039 00:13:33.867 20:30:52 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1039 00:13:34.129 true 00:13:34.129 20:30:52 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:34.129 20:30:52 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:34.129 20:30:52 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:34.390 20:30:52 -- target/ns_hotplug_stress.sh@40 -- # null_size=1040 00:13:34.390 20:30:52 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1040 00:13:34.390 true 00:13:34.651 20:30:52 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:34.651 20:30:52 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:34.651 20:30:52 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:34.912 20:30:53 -- target/ns_hotplug_stress.sh@40 -- # null_size=1041 00:13:34.912 20:30:53 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1041 00:13:34.912 true 00:13:35.172 20:30:53 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:35.172 20:30:53 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:35.172 20:30:53 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:35.433 20:30:53 -- target/ns_hotplug_stress.sh@40 -- # null_size=1042 00:13:35.433 20:30:53 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1042 00:13:35.433 true 00:13:35.433 20:30:53 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:35.433 20:30:53 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:35.711 20:30:53 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:36.020 20:30:54 -- target/ns_hotplug_stress.sh@40 -- # null_size=1043 00:13:36.020 20:30:54 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1043 00:13:36.020 true 00:13:36.020 20:30:54 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:36.020 20:30:54 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:36.280 20:30:54 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:36.280 20:30:54 -- target/ns_hotplug_stress.sh@40 -- # null_size=1044 00:13:36.280 20:30:54 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1044 00:13:36.541 true 00:13:36.541 20:30:54 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:36.541 20:30:54 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:36.802 20:30:54 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:36.802 20:30:55 -- target/ns_hotplug_stress.sh@40 -- # null_size=1045 00:13:36.802 20:30:55 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1045 00:13:37.062 true 00:13:37.062 20:30:55 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:37.063 20:30:55 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:37.323 20:30:55 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:37.323 20:30:55 -- target/ns_hotplug_stress.sh@40 -- # null_size=1046 00:13:37.323 20:30:55 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1046 00:13:37.584 true 00:13:37.584 20:30:55 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:37.584 20:30:55 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:37.844 20:30:55 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:37.844 20:30:56 -- target/ns_hotplug_stress.sh@40 -- # null_size=1047 00:13:37.844 20:30:56 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1047 00:13:38.105 true 00:13:38.105 20:30:56 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:38.105 20:30:56 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:38.365 20:30:56 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:38.365 20:30:56 -- target/ns_hotplug_stress.sh@40 -- # null_size=1048 00:13:38.365 20:30:56 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1048 00:13:38.626 true 00:13:38.626 20:30:56 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:38.626 20:30:56 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:38.887 20:30:56 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:38.887 20:30:57 -- target/ns_hotplug_stress.sh@40 -- # null_size=1049 00:13:38.887 20:30:57 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1049 00:13:39.148 true 00:13:39.148 20:30:57 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:39.148 20:30:57 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:39.409 20:30:57 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:39.409 20:30:57 -- target/ns_hotplug_stress.sh@40 -- # null_size=1050 00:13:39.409 20:30:57 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1050 00:13:39.671 true 00:13:39.671 20:30:57 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:39.671 20:30:57 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:39.671 20:30:58 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:39.932 20:30:58 -- target/ns_hotplug_stress.sh@40 -- # null_size=1051 00:13:39.932 20:30:58 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1051 00:13:40.192 true 00:13:40.192 20:30:58 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:40.192 20:30:58 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:40.192 20:30:58 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:40.453 20:30:58 -- target/ns_hotplug_stress.sh@40 -- # null_size=1052 00:13:40.453 20:30:58 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1052 00:13:40.714 true 00:13:40.714 20:30:58 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:40.714 20:30:58 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:40.714 20:30:59 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:40.975 20:30:59 -- target/ns_hotplug_stress.sh@40 -- # null_size=1053 00:13:40.975 20:30:59 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1053 00:13:41.236 true 00:13:41.236 20:30:59 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:41.236 20:30:59 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.236 20:30:59 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:41.496 20:30:59 -- target/ns_hotplug_stress.sh@40 -- # null_size=1054 00:13:41.496 20:30:59 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1054 00:13:41.496 true 00:13:41.757 20:30:59 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:41.757 20:30:59 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.757 20:31:00 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:42.018 20:31:00 -- target/ns_hotplug_stress.sh@40 -- # null_size=1055 00:13:42.018 20:31:00 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1055 00:13:42.018 true 00:13:42.279 20:31:00 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:42.279 20:31:00 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:42.279 20:31:00 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:42.540 20:31:00 -- target/ns_hotplug_stress.sh@40 -- # null_size=1056 00:13:42.540 20:31:00 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1056 00:13:42.540 true 00:13:42.801 20:31:00 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:42.801 20:31:00 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:42.801 20:31:01 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:43.061 20:31:01 -- target/ns_hotplug_stress.sh@40 -- # null_size=1057 00:13:43.061 20:31:01 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1057 00:13:43.322 true 00:13:43.322 20:31:01 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:43.322 20:31:01 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:43.322 20:31:01 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:43.583 20:31:01 -- target/ns_hotplug_stress.sh@40 -- # null_size=1058 00:13:43.583 20:31:01 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1058 00:13:43.583 true 00:13:43.844 20:31:01 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:43.844 20:31:01 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:43.844 20:31:02 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:44.104 20:31:02 -- target/ns_hotplug_stress.sh@40 -- # null_size=1059 00:13:44.104 20:31:02 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1059 00:13:44.104 true 00:13:44.104 20:31:02 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:44.104 20:31:02 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:44.364 20:31:02 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:44.626 20:31:02 -- target/ns_hotplug_stress.sh@40 -- # null_size=1060 00:13:44.626 20:31:02 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1060 00:13:44.626 Initializing NVMe Controllers 00:13:44.626 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:44.626 Controller IO queue size 128, less than required. 00:13:44.626 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:44.626 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:44.626 Initialization complete. Launching workers. 00:13:44.626 ======================================================== 00:13:44.626 Latency(us) 00:13:44.626 Device Information : IOPS MiB/s Average min max 00:13:44.626 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 23817.80 11.63 5374.24 2947.22 10384.18 00:13:44.626 ======================================================== 00:13:44.626 Total : 23817.80 11.63 5374.24 2947.22 10384.18 00:13:44.626 00:13:44.626 true 00:13:44.626 20:31:02 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3963148 00:13:44.626 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (3963148) - No such process 00:13:44.626 20:31:02 -- target/ns_hotplug_stress.sh@44 -- # wait 3963148 00:13:44.626 20:31:02 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:13:44.626 20:31:02 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:13:44.626 20:31:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:44.626 20:31:02 -- nvmf/common.sh@116 -- # sync 00:13:44.626 20:31:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:44.626 20:31:02 -- nvmf/common.sh@119 -- # set +e 00:13:44.626 20:31:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:44.626 20:31:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:44.626 rmmod nvme_tcp 00:13:44.885 rmmod nvme_fabrics 00:13:44.885 rmmod nvme_keyring 00:13:44.885 20:31:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:44.885 20:31:03 -- nvmf/common.sh@123 -- # set -e 00:13:44.885 20:31:03 -- nvmf/common.sh@124 -- # return 0 00:13:44.885 20:31:03 -- nvmf/common.sh@477 -- # '[' -n 3962731 ']' 00:13:44.885 20:31:03 -- nvmf/common.sh@478 -- # killprocess 3962731 00:13:44.886 20:31:03 -- common/autotest_common.sh@926 -- # '[' -z 3962731 ']' 00:13:44.886 20:31:03 -- common/autotest_common.sh@930 -- # kill -0 3962731 00:13:44.886 20:31:03 -- common/autotest_common.sh@931 -- # uname 00:13:44.886 20:31:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:44.886 20:31:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3962731 00:13:44.886 20:31:03 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:44.886 20:31:03 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:44.886 20:31:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3962731' 00:13:44.886 killing process with pid 3962731 00:13:44.886 20:31:03 -- common/autotest_common.sh@945 -- # kill 3962731 00:13:44.886 20:31:03 -- common/autotest_common.sh@950 -- # wait 3962731 00:13:44.886 20:31:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:44.886 20:31:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:44.886 20:31:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:44.886 20:31:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:44.886 20:31:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:44.886 20:31:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:44.886 20:31:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:44.886 20:31:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:47.430 20:31:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:47.430 00:13:47.430 real 0m42.336s 00:13:47.430 user 2m34.137s 00:13:47.430 sys 0m12.765s 00:13:47.430 20:31:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:47.430 20:31:05 -- common/autotest_common.sh@10 -- # set +x 00:13:47.430 ************************************ 00:13:47.430 END TEST nvmf_ns_hotplug_stress 00:13:47.430 ************************************ 00:13:47.430 20:31:05 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:47.430 20:31:05 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:47.430 20:31:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:47.430 20:31:05 -- common/autotest_common.sh@10 -- # set +x 00:13:47.430 ************************************ 00:13:47.430 START TEST nvmf_connect_stress 00:13:47.430 ************************************ 00:13:47.430 20:31:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:47.430 * Looking for test storage... 00:13:47.430 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:47.430 20:31:05 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:47.430 20:31:05 -- nvmf/common.sh@7 -- # uname -s 00:13:47.430 20:31:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:47.430 20:31:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:47.430 20:31:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:47.430 20:31:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:47.430 20:31:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:47.430 20:31:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:47.430 20:31:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:47.430 20:31:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:47.430 20:31:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:47.430 20:31:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:47.430 20:31:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:47.430 20:31:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:47.430 20:31:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:47.430 20:31:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:47.430 20:31:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:47.430 20:31:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:47.430 20:31:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:47.430 20:31:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:47.431 20:31:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:47.431 20:31:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.431 20:31:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.431 20:31:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.431 20:31:05 -- paths/export.sh@5 -- # export PATH 00:13:47.431 20:31:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.431 20:31:05 -- nvmf/common.sh@46 -- # : 0 00:13:47.431 20:31:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:47.431 20:31:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:47.431 20:31:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:47.431 20:31:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:47.431 20:31:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:47.431 20:31:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:47.431 20:31:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:47.431 20:31:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:47.431 20:31:05 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:47.431 20:31:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:47.431 20:31:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:47.431 20:31:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:47.431 20:31:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:47.431 20:31:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:47.431 20:31:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:47.431 20:31:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:47.431 20:31:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:47.431 20:31:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:47.431 20:31:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:47.431 20:31:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:47.431 20:31:05 -- common/autotest_common.sh@10 -- # set +x 00:13:54.024 20:31:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:54.024 20:31:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:54.024 20:31:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:54.024 20:31:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:54.024 20:31:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:54.024 20:31:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:54.024 20:31:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:54.024 20:31:12 -- nvmf/common.sh@294 -- # net_devs=() 00:13:54.024 20:31:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:54.024 20:31:12 -- nvmf/common.sh@295 -- # e810=() 00:13:54.024 20:31:12 -- nvmf/common.sh@295 -- # local -ga e810 00:13:54.024 20:31:12 -- nvmf/common.sh@296 -- # x722=() 00:13:54.024 20:31:12 -- nvmf/common.sh@296 -- # local -ga x722 00:13:54.024 20:31:12 -- nvmf/common.sh@297 -- # mlx=() 00:13:54.024 20:31:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:54.024 20:31:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:54.024 20:31:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:54.024 20:31:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:54.024 20:31:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:54.024 20:31:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:54.024 20:31:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:54.024 20:31:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:54.024 20:31:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:54.024 20:31:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:54.024 20:31:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:54.024 20:31:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:54.024 20:31:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:54.024 20:31:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:54.024 20:31:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:54.024 20:31:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:54.024 20:31:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:13:54.024 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:13:54.024 20:31:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:54.024 20:31:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:13:54.024 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:13:54.024 20:31:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:54.024 20:31:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:54.024 20:31:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:54.024 20:31:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:54.024 20:31:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:54.024 20:31:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:54.024 20:31:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:13:54.024 Found net devices under 0000:4b:00.0: cvl_0_0 00:13:54.024 20:31:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:54.024 20:31:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:54.024 20:31:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:54.024 20:31:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:54.024 20:31:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:54.025 20:31:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:13:54.025 Found net devices under 0000:4b:00.1: cvl_0_1 00:13:54.025 20:31:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:54.025 20:31:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:54.025 20:31:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:54.025 20:31:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:54.025 20:31:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:54.025 20:31:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:54.025 20:31:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:54.025 20:31:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:54.025 20:31:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:54.025 20:31:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:54.025 20:31:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:54.025 20:31:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:54.025 20:31:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:54.025 20:31:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:54.025 20:31:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:54.025 20:31:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:54.025 20:31:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:54.025 20:31:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:54.025 20:31:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:54.025 20:31:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:54.025 20:31:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:54.025 20:31:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:54.025 20:31:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:54.025 20:31:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:54.025 20:31:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:54.286 20:31:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:54.286 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:54.286 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=1.49 ms 00:13:54.286 00:13:54.286 --- 10.0.0.2 ping statistics --- 00:13:54.286 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:54.286 rtt min/avg/max/mdev = 1.490/1.490/1.490/0.000 ms 00:13:54.286 20:31:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:54.286 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:54.286 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.379 ms 00:13:54.286 00:13:54.286 --- 10.0.0.1 ping statistics --- 00:13:54.286 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:54.286 rtt min/avg/max/mdev = 0.379/0.379/0.379/0.000 ms 00:13:54.286 20:31:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:54.286 20:31:12 -- nvmf/common.sh@410 -- # return 0 00:13:54.286 20:31:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:54.286 20:31:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:54.286 20:31:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:54.286 20:31:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:54.286 20:31:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:54.286 20:31:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:54.286 20:31:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:54.286 20:31:12 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:54.286 20:31:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:54.286 20:31:12 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:54.286 20:31:12 -- common/autotest_common.sh@10 -- # set +x 00:13:54.286 20:31:12 -- nvmf/common.sh@469 -- # nvmfpid=3973512 00:13:54.286 20:31:12 -- nvmf/common.sh@470 -- # waitforlisten 3973512 00:13:54.286 20:31:12 -- common/autotest_common.sh@819 -- # '[' -z 3973512 ']' 00:13:54.286 20:31:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:54.286 20:31:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:54.286 20:31:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:54.286 20:31:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:54.286 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:54.286 20:31:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:54.286 20:31:12 -- common/autotest_common.sh@10 -- # set +x 00:13:54.286 [2024-04-26 20:31:12.490192] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:13:54.286 [2024-04-26 20:31:12.490256] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:54.286 EAL: No free 2048 kB hugepages reported on node 1 00:13:54.286 [2024-04-26 20:31:12.560456] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:54.547 [2024-04-26 20:31:12.632173] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:54.547 [2024-04-26 20:31:12.632298] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:54.547 [2024-04-26 20:31:12.632307] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:54.547 [2024-04-26 20:31:12.632314] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:54.547 [2024-04-26 20:31:12.632464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:54.547 [2024-04-26 20:31:12.632663] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:54.547 [2024-04-26 20:31:12.632667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:55.120 20:31:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:55.120 20:31:13 -- common/autotest_common.sh@852 -- # return 0 00:13:55.120 20:31:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:55.120 20:31:13 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:55.120 20:31:13 -- common/autotest_common.sh@10 -- # set +x 00:13:55.120 20:31:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:55.120 20:31:13 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:55.120 20:31:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:55.120 20:31:13 -- common/autotest_common.sh@10 -- # set +x 00:13:55.120 [2024-04-26 20:31:13.316634] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:55.120 20:31:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:55.120 20:31:13 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:55.120 20:31:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:55.120 20:31:13 -- common/autotest_common.sh@10 -- # set +x 00:13:55.120 20:31:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:55.120 20:31:13 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:55.120 20:31:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:55.120 20:31:13 -- common/autotest_common.sh@10 -- # set +x 00:13:55.120 [2024-04-26 20:31:13.340985] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:55.120 20:31:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:55.120 20:31:13 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:55.120 20:31:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:55.120 20:31:13 -- common/autotest_common.sh@10 -- # set +x 00:13:55.120 NULL1 00:13:55.120 20:31:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:55.120 20:31:13 -- target/connect_stress.sh@21 -- # PERF_PID=3973774 00:13:55.120 20:31:13 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:55.120 20:31:13 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:55.120 20:31:13 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:55.120 20:31:13 -- target/connect_stress.sh@28 -- # cat 00:13:55.120 20:31:13 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:55.120 20:31:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:55.120 20:31:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:55.120 20:31:13 -- common/autotest_common.sh@10 -- # set +x 00:13:55.695 20:31:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:55.695 20:31:13 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:55.695 20:31:13 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:55.695 20:31:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:55.695 20:31:13 -- common/autotest_common.sh@10 -- # set +x 00:13:55.955 20:31:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:55.955 20:31:14 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:55.955 20:31:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:55.955 20:31:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:55.955 20:31:14 -- common/autotest_common.sh@10 -- # set +x 00:13:56.217 20:31:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.217 20:31:14 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:56.217 20:31:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:56.217 20:31:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.217 20:31:14 -- common/autotest_common.sh@10 -- # set +x 00:13:56.478 20:31:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.478 20:31:14 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:56.478 20:31:14 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:56.478 20:31:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.478 20:31:14 -- common/autotest_common.sh@10 -- # set +x 00:13:56.739 20:31:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:56.739 20:31:15 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:56.739 20:31:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:56.739 20:31:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:56.739 20:31:15 -- common/autotest_common.sh@10 -- # set +x 00:13:57.311 20:31:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:57.311 20:31:15 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:57.311 20:31:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:57.311 20:31:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:57.311 20:31:15 -- common/autotest_common.sh@10 -- # set +x 00:13:57.572 20:31:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:57.572 20:31:15 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:57.572 20:31:15 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:57.572 20:31:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:57.572 20:31:15 -- common/autotest_common.sh@10 -- # set +x 00:13:57.832 20:31:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:57.832 20:31:16 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:57.833 20:31:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:57.833 20:31:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:57.833 20:31:16 -- common/autotest_common.sh@10 -- # set +x 00:13:58.093 20:31:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:58.093 20:31:16 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:58.093 20:31:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:58.093 20:31:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:58.093 20:31:16 -- common/autotest_common.sh@10 -- # set +x 00:13:58.663 20:31:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:58.663 20:31:16 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:58.663 20:31:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:58.663 20:31:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:58.663 20:31:16 -- common/autotest_common.sh@10 -- # set +x 00:13:58.923 20:31:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:58.923 20:31:17 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:58.923 20:31:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:58.923 20:31:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:58.923 20:31:17 -- common/autotest_common.sh@10 -- # set +x 00:13:59.184 20:31:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:59.184 20:31:17 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:59.184 20:31:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:59.184 20:31:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:59.184 20:31:17 -- common/autotest_common.sh@10 -- # set +x 00:13:59.446 20:31:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:59.446 20:31:17 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:59.446 20:31:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:59.446 20:31:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:59.446 20:31:17 -- common/autotest_common.sh@10 -- # set +x 00:13:59.706 20:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:59.706 20:31:18 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:13:59.706 20:31:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:59.706 20:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:59.706 20:31:18 -- common/autotest_common.sh@10 -- # set +x 00:14:00.277 20:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:00.277 20:31:18 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:00.277 20:31:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:00.277 20:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:00.277 20:31:18 -- common/autotest_common.sh@10 -- # set +x 00:14:00.538 20:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:00.538 20:31:18 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:00.538 20:31:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:00.538 20:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:00.538 20:31:18 -- common/autotest_common.sh@10 -- # set +x 00:14:00.799 20:31:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:00.799 20:31:18 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:00.799 20:31:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:00.799 20:31:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:00.799 20:31:18 -- common/autotest_common.sh@10 -- # set +x 00:14:01.062 20:31:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:01.062 20:31:19 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:01.062 20:31:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:01.062 20:31:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:01.062 20:31:19 -- common/autotest_common.sh@10 -- # set +x 00:14:01.324 20:31:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:01.324 20:31:19 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:01.324 20:31:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:01.324 20:31:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:01.324 20:31:19 -- common/autotest_common.sh@10 -- # set +x 00:14:01.899 20:31:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:01.899 20:31:19 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:01.899 20:31:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:01.899 20:31:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:01.899 20:31:19 -- common/autotest_common.sh@10 -- # set +x 00:14:02.160 20:31:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:02.160 20:31:20 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:02.160 20:31:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:02.160 20:31:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:02.160 20:31:20 -- common/autotest_common.sh@10 -- # set +x 00:14:02.421 20:31:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:02.421 20:31:20 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:02.421 20:31:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:02.421 20:31:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:02.421 20:31:20 -- common/autotest_common.sh@10 -- # set +x 00:14:02.683 20:31:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:02.683 20:31:20 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:02.683 20:31:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:02.683 20:31:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:02.683 20:31:20 -- common/autotest_common.sh@10 -- # set +x 00:14:02.944 20:31:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:02.944 20:31:21 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:02.944 20:31:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:02.944 20:31:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:02.944 20:31:21 -- common/autotest_common.sh@10 -- # set +x 00:14:03.517 20:31:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:03.517 20:31:21 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:03.517 20:31:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:03.517 20:31:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:03.517 20:31:21 -- common/autotest_common.sh@10 -- # set +x 00:14:03.778 20:31:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:03.778 20:31:21 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:03.778 20:31:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:03.778 20:31:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:03.778 20:31:21 -- common/autotest_common.sh@10 -- # set +x 00:14:04.038 20:31:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:04.038 20:31:22 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:04.038 20:31:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:04.038 20:31:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:04.038 20:31:22 -- common/autotest_common.sh@10 -- # set +x 00:14:04.324 20:31:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:04.324 20:31:22 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:04.324 20:31:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:04.324 20:31:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:04.324 20:31:22 -- common/autotest_common.sh@10 -- # set +x 00:14:04.593 20:31:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:04.593 20:31:22 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:04.593 20:31:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:04.593 20:31:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:04.593 20:31:22 -- common/autotest_common.sh@10 -- # set +x 00:14:05.164 20:31:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:05.164 20:31:23 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:05.164 20:31:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:05.164 20:31:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:05.164 20:31:23 -- common/autotest_common.sh@10 -- # set +x 00:14:05.164 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:05.425 20:31:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:05.425 20:31:23 -- target/connect_stress.sh@34 -- # kill -0 3973774 00:14:05.425 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3973774) - No such process 00:14:05.425 20:31:23 -- target/connect_stress.sh@38 -- # wait 3973774 00:14:05.425 20:31:23 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:05.425 20:31:23 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:05.425 20:31:23 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:05.425 20:31:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:05.425 20:31:23 -- nvmf/common.sh@116 -- # sync 00:14:05.425 20:31:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:05.425 20:31:23 -- nvmf/common.sh@119 -- # set +e 00:14:05.425 20:31:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:05.425 20:31:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:05.425 rmmod nvme_tcp 00:14:05.425 rmmod nvme_fabrics 00:14:05.425 rmmod nvme_keyring 00:14:05.425 20:31:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:05.425 20:31:23 -- nvmf/common.sh@123 -- # set -e 00:14:05.425 20:31:23 -- nvmf/common.sh@124 -- # return 0 00:14:05.425 20:31:23 -- nvmf/common.sh@477 -- # '[' -n 3973512 ']' 00:14:05.425 20:31:23 -- nvmf/common.sh@478 -- # killprocess 3973512 00:14:05.425 20:31:23 -- common/autotest_common.sh@926 -- # '[' -z 3973512 ']' 00:14:05.425 20:31:23 -- common/autotest_common.sh@930 -- # kill -0 3973512 00:14:05.425 20:31:23 -- common/autotest_common.sh@931 -- # uname 00:14:05.425 20:31:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:05.425 20:31:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3973512 00:14:05.425 20:31:23 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:05.425 20:31:23 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:05.425 20:31:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3973512' 00:14:05.425 killing process with pid 3973512 00:14:05.425 20:31:23 -- common/autotest_common.sh@945 -- # kill 3973512 00:14:05.425 20:31:23 -- common/autotest_common.sh@950 -- # wait 3973512 00:14:05.686 20:31:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:05.686 20:31:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:05.686 20:31:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:05.686 20:31:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:05.686 20:31:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:05.686 20:31:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:05.686 20:31:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:05.686 20:31:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:07.600 20:31:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:07.600 00:14:07.600 real 0m20.549s 00:14:07.600 user 0m41.988s 00:14:07.600 sys 0m8.461s 00:14:07.600 20:31:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:07.600 20:31:25 -- common/autotest_common.sh@10 -- # set +x 00:14:07.600 ************************************ 00:14:07.600 END TEST nvmf_connect_stress 00:14:07.600 ************************************ 00:14:07.600 20:31:25 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:07.600 20:31:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:07.600 20:31:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:07.600 20:31:25 -- common/autotest_common.sh@10 -- # set +x 00:14:07.600 ************************************ 00:14:07.600 START TEST nvmf_fused_ordering 00:14:07.600 ************************************ 00:14:07.600 20:31:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:07.861 * Looking for test storage... 00:14:07.861 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:07.861 20:31:26 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:07.861 20:31:26 -- nvmf/common.sh@7 -- # uname -s 00:14:07.861 20:31:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:07.861 20:31:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:07.861 20:31:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:07.861 20:31:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:07.861 20:31:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:07.861 20:31:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:07.861 20:31:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:07.861 20:31:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:07.861 20:31:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:07.861 20:31:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:07.861 20:31:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:07.861 20:31:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:07.861 20:31:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:07.861 20:31:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:07.861 20:31:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:07.861 20:31:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:07.861 20:31:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:07.861 20:31:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:07.861 20:31:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:07.861 20:31:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:07.861 20:31:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:07.861 20:31:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:07.861 20:31:26 -- paths/export.sh@5 -- # export PATH 00:14:07.861 20:31:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:07.861 20:31:26 -- nvmf/common.sh@46 -- # : 0 00:14:07.861 20:31:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:07.861 20:31:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:07.861 20:31:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:07.861 20:31:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:07.861 20:31:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:07.861 20:31:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:07.861 20:31:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:07.861 20:31:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:07.861 20:31:26 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:07.861 20:31:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:07.861 20:31:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:07.861 20:31:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:07.861 20:31:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:07.861 20:31:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:07.861 20:31:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:07.861 20:31:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:07.861 20:31:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:07.861 20:31:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:07.861 20:31:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:07.861 20:31:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:07.861 20:31:26 -- common/autotest_common.sh@10 -- # set +x 00:14:14.460 20:31:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:14.460 20:31:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:14.460 20:31:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:14.460 20:31:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:14.460 20:31:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:14.460 20:31:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:14.460 20:31:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:14.460 20:31:32 -- nvmf/common.sh@294 -- # net_devs=() 00:14:14.460 20:31:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:14.460 20:31:32 -- nvmf/common.sh@295 -- # e810=() 00:14:14.460 20:31:32 -- nvmf/common.sh@295 -- # local -ga e810 00:14:14.460 20:31:32 -- nvmf/common.sh@296 -- # x722=() 00:14:14.460 20:31:32 -- nvmf/common.sh@296 -- # local -ga x722 00:14:14.460 20:31:32 -- nvmf/common.sh@297 -- # mlx=() 00:14:14.460 20:31:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:14.460 20:31:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:14.460 20:31:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:14.460 20:31:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:14.460 20:31:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:14.460 20:31:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:14.460 20:31:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:14.460 20:31:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:14.460 20:31:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:14.460 20:31:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:14.460 20:31:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:14.460 20:31:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:14.460 20:31:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:14.460 20:31:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:14.460 20:31:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:14.460 20:31:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:14.460 20:31:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:14:14.460 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:14:14.460 20:31:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:14.460 20:31:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:14:14.460 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:14:14.460 20:31:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:14.460 20:31:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:14.460 20:31:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:14.460 20:31:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:14.460 20:31:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:14.460 20:31:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:14:14.460 Found net devices under 0000:4b:00.0: cvl_0_0 00:14:14.460 20:31:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:14.460 20:31:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:14.460 20:31:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:14.460 20:31:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:14.460 20:31:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:14.460 20:31:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:14:14.460 Found net devices under 0000:4b:00.1: cvl_0_1 00:14:14.460 20:31:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:14.460 20:31:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:14.460 20:31:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:14.460 20:31:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:14.460 20:31:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:14.460 20:31:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:14.460 20:31:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:14.460 20:31:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:14.460 20:31:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:14.460 20:31:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:14.460 20:31:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:14.460 20:31:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:14.460 20:31:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:14.460 20:31:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:14.460 20:31:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:14.460 20:31:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:14.460 20:31:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:14.460 20:31:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:14.460 20:31:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:14.460 20:31:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:14.460 20:31:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:14.460 20:31:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:14.723 20:31:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:14.723 20:31:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:14.723 20:31:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:14.723 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:14.723 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.705 ms 00:14:14.723 00:14:14.723 --- 10.0.0.2 ping statistics --- 00:14:14.723 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:14.723 rtt min/avg/max/mdev = 0.705/0.705/0.705/0.000 ms 00:14:14.723 20:31:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:14.723 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:14.723 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.471 ms 00:14:14.723 00:14:14.723 --- 10.0.0.1 ping statistics --- 00:14:14.723 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:14.723 rtt min/avg/max/mdev = 0.471/0.471/0.471/0.000 ms 00:14:14.723 20:31:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:14.723 20:31:32 -- nvmf/common.sh@410 -- # return 0 00:14:14.723 20:31:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:14.723 20:31:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:14.723 20:31:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:14.723 20:31:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:14.723 20:31:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:14.723 20:31:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:14.723 20:31:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:14.723 20:31:32 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:14.723 20:31:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:14.723 20:31:32 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:14.723 20:31:32 -- common/autotest_common.sh@10 -- # set +x 00:14:14.723 20:31:32 -- nvmf/common.sh@469 -- # nvmfpid=3979863 00:14:14.723 20:31:32 -- nvmf/common.sh@470 -- # waitforlisten 3979863 00:14:14.723 20:31:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:14.723 20:31:32 -- common/autotest_common.sh@819 -- # '[' -z 3979863 ']' 00:14:14.723 20:31:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:14.723 20:31:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:14.723 20:31:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:14.723 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:14.723 20:31:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:14.723 20:31:32 -- common/autotest_common.sh@10 -- # set +x 00:14:14.723 [2024-04-26 20:31:33.008562] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:14:14.723 [2024-04-26 20:31:33.008628] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:14.723 EAL: No free 2048 kB hugepages reported on node 1 00:14:14.984 [2024-04-26 20:31:33.081100] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:14.984 [2024-04-26 20:31:33.152141] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:14.984 [2024-04-26 20:31:33.152266] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:14.984 [2024-04-26 20:31:33.152274] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:14.984 [2024-04-26 20:31:33.152287] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:14.984 [2024-04-26 20:31:33.152307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:15.556 20:31:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:15.556 20:31:33 -- common/autotest_common.sh@852 -- # return 0 00:14:15.557 20:31:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:15.557 20:31:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:15.557 20:31:33 -- common/autotest_common.sh@10 -- # set +x 00:14:15.557 20:31:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:15.557 20:31:33 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:15.557 20:31:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:15.557 20:31:33 -- common/autotest_common.sh@10 -- # set +x 00:14:15.557 [2024-04-26 20:31:33.815118] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:15.557 20:31:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:15.557 20:31:33 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:15.557 20:31:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:15.557 20:31:33 -- common/autotest_common.sh@10 -- # set +x 00:14:15.557 20:31:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:15.557 20:31:33 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:15.557 20:31:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:15.557 20:31:33 -- common/autotest_common.sh@10 -- # set +x 00:14:15.557 [2024-04-26 20:31:33.839292] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:15.557 20:31:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:15.557 20:31:33 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:15.557 20:31:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:15.557 20:31:33 -- common/autotest_common.sh@10 -- # set +x 00:14:15.557 NULL1 00:14:15.557 20:31:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:15.557 20:31:33 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:14:15.557 20:31:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:15.557 20:31:33 -- common/autotest_common.sh@10 -- # set +x 00:14:15.557 20:31:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:15.557 20:31:33 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:15.557 20:31:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:15.557 20:31:33 -- common/autotest_common.sh@10 -- # set +x 00:14:15.557 20:31:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:15.557 20:31:33 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:15.818 [2024-04-26 20:31:33.902766] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:14:15.818 [2024-04-26 20:31:33.902833] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3980191 ] 00:14:15.818 EAL: No free 2048 kB hugepages reported on node 1 00:14:16.390 Attached to nqn.2016-06.io.spdk:cnode1 00:14:16.390 Namespace ID: 1 size: 1GB 00:14:16.390 fused_ordering(0) 00:14:16.390 fused_ordering(1) 00:14:16.390 fused_ordering(2) 00:14:16.390 fused_ordering(3) 00:14:16.390 fused_ordering(4) 00:14:16.390 fused_ordering(5) 00:14:16.390 fused_ordering(6) 00:14:16.390 fused_ordering(7) 00:14:16.390 fused_ordering(8) 00:14:16.390 fused_ordering(9) 00:14:16.390 fused_ordering(10) 00:14:16.390 fused_ordering(11) 00:14:16.390 fused_ordering(12) 00:14:16.390 fused_ordering(13) 00:14:16.390 fused_ordering(14) 00:14:16.390 fused_ordering(15) 00:14:16.390 fused_ordering(16) 00:14:16.390 fused_ordering(17) 00:14:16.390 fused_ordering(18) 00:14:16.390 fused_ordering(19) 00:14:16.390 fused_ordering(20) 00:14:16.390 fused_ordering(21) 00:14:16.390 fused_ordering(22) 00:14:16.390 fused_ordering(23) 00:14:16.390 fused_ordering(24) 00:14:16.390 fused_ordering(25) 00:14:16.390 fused_ordering(26) 00:14:16.390 fused_ordering(27) 00:14:16.390 fused_ordering(28) 00:14:16.390 fused_ordering(29) 00:14:16.390 fused_ordering(30) 00:14:16.390 fused_ordering(31) 00:14:16.390 fused_ordering(32) 00:14:16.390 fused_ordering(33) 00:14:16.390 fused_ordering(34) 00:14:16.390 fused_ordering(35) 00:14:16.390 fused_ordering(36) 00:14:16.390 fused_ordering(37) 00:14:16.390 fused_ordering(38) 00:14:16.390 fused_ordering(39) 00:14:16.390 fused_ordering(40) 00:14:16.390 fused_ordering(41) 00:14:16.390 fused_ordering(42) 00:14:16.390 fused_ordering(43) 00:14:16.390 fused_ordering(44) 00:14:16.390 fused_ordering(45) 00:14:16.390 fused_ordering(46) 00:14:16.390 fused_ordering(47) 00:14:16.390 fused_ordering(48) 00:14:16.390 fused_ordering(49) 00:14:16.390 fused_ordering(50) 00:14:16.390 fused_ordering(51) 00:14:16.390 fused_ordering(52) 00:14:16.390 fused_ordering(53) 00:14:16.390 fused_ordering(54) 00:14:16.390 fused_ordering(55) 00:14:16.390 fused_ordering(56) 00:14:16.390 fused_ordering(57) 00:14:16.390 fused_ordering(58) 00:14:16.390 fused_ordering(59) 00:14:16.390 fused_ordering(60) 00:14:16.390 fused_ordering(61) 00:14:16.390 fused_ordering(62) 00:14:16.390 fused_ordering(63) 00:14:16.390 fused_ordering(64) 00:14:16.391 fused_ordering(65) 00:14:16.391 fused_ordering(66) 00:14:16.391 fused_ordering(67) 00:14:16.391 fused_ordering(68) 00:14:16.391 fused_ordering(69) 00:14:16.391 fused_ordering(70) 00:14:16.391 fused_ordering(71) 00:14:16.391 fused_ordering(72) 00:14:16.391 fused_ordering(73) 00:14:16.391 fused_ordering(74) 00:14:16.391 fused_ordering(75) 00:14:16.391 fused_ordering(76) 00:14:16.391 fused_ordering(77) 00:14:16.391 fused_ordering(78) 00:14:16.391 fused_ordering(79) 00:14:16.391 fused_ordering(80) 00:14:16.391 fused_ordering(81) 00:14:16.391 fused_ordering(82) 00:14:16.391 fused_ordering(83) 00:14:16.391 fused_ordering(84) 00:14:16.391 fused_ordering(85) 00:14:16.391 fused_ordering(86) 00:14:16.391 fused_ordering(87) 00:14:16.391 fused_ordering(88) 00:14:16.391 fused_ordering(89) 00:14:16.391 fused_ordering(90) 00:14:16.391 fused_ordering(91) 00:14:16.391 fused_ordering(92) 00:14:16.391 fused_ordering(93) 00:14:16.391 fused_ordering(94) 00:14:16.391 fused_ordering(95) 00:14:16.391 fused_ordering(96) 00:14:16.391 fused_ordering(97) 00:14:16.391 fused_ordering(98) 00:14:16.391 fused_ordering(99) 00:14:16.391 fused_ordering(100) 00:14:16.391 fused_ordering(101) 00:14:16.391 fused_ordering(102) 00:14:16.391 fused_ordering(103) 00:14:16.391 fused_ordering(104) 00:14:16.391 fused_ordering(105) 00:14:16.391 fused_ordering(106) 00:14:16.391 fused_ordering(107) 00:14:16.391 fused_ordering(108) 00:14:16.391 fused_ordering(109) 00:14:16.391 fused_ordering(110) 00:14:16.391 fused_ordering(111) 00:14:16.391 fused_ordering(112) 00:14:16.391 fused_ordering(113) 00:14:16.391 fused_ordering(114) 00:14:16.391 fused_ordering(115) 00:14:16.391 fused_ordering(116) 00:14:16.391 fused_ordering(117) 00:14:16.391 fused_ordering(118) 00:14:16.391 fused_ordering(119) 00:14:16.391 fused_ordering(120) 00:14:16.391 fused_ordering(121) 00:14:16.391 fused_ordering(122) 00:14:16.391 fused_ordering(123) 00:14:16.391 fused_ordering(124) 00:14:16.391 fused_ordering(125) 00:14:16.391 fused_ordering(126) 00:14:16.391 fused_ordering(127) 00:14:16.391 fused_ordering(128) 00:14:16.391 fused_ordering(129) 00:14:16.391 fused_ordering(130) 00:14:16.391 fused_ordering(131) 00:14:16.391 fused_ordering(132) 00:14:16.391 fused_ordering(133) 00:14:16.391 fused_ordering(134) 00:14:16.391 fused_ordering(135) 00:14:16.391 fused_ordering(136) 00:14:16.391 fused_ordering(137) 00:14:16.391 fused_ordering(138) 00:14:16.391 fused_ordering(139) 00:14:16.391 fused_ordering(140) 00:14:16.391 fused_ordering(141) 00:14:16.391 fused_ordering(142) 00:14:16.391 fused_ordering(143) 00:14:16.391 fused_ordering(144) 00:14:16.391 fused_ordering(145) 00:14:16.391 fused_ordering(146) 00:14:16.391 fused_ordering(147) 00:14:16.391 fused_ordering(148) 00:14:16.391 fused_ordering(149) 00:14:16.391 fused_ordering(150) 00:14:16.391 fused_ordering(151) 00:14:16.391 fused_ordering(152) 00:14:16.391 fused_ordering(153) 00:14:16.391 fused_ordering(154) 00:14:16.391 fused_ordering(155) 00:14:16.391 fused_ordering(156) 00:14:16.391 fused_ordering(157) 00:14:16.391 fused_ordering(158) 00:14:16.391 fused_ordering(159) 00:14:16.391 fused_ordering(160) 00:14:16.391 fused_ordering(161) 00:14:16.391 fused_ordering(162) 00:14:16.391 fused_ordering(163) 00:14:16.391 fused_ordering(164) 00:14:16.391 fused_ordering(165) 00:14:16.391 fused_ordering(166) 00:14:16.391 fused_ordering(167) 00:14:16.391 fused_ordering(168) 00:14:16.391 fused_ordering(169) 00:14:16.391 fused_ordering(170) 00:14:16.391 fused_ordering(171) 00:14:16.391 fused_ordering(172) 00:14:16.391 fused_ordering(173) 00:14:16.391 fused_ordering(174) 00:14:16.391 fused_ordering(175) 00:14:16.391 fused_ordering(176) 00:14:16.391 fused_ordering(177) 00:14:16.391 fused_ordering(178) 00:14:16.391 fused_ordering(179) 00:14:16.391 fused_ordering(180) 00:14:16.391 fused_ordering(181) 00:14:16.391 fused_ordering(182) 00:14:16.391 fused_ordering(183) 00:14:16.391 fused_ordering(184) 00:14:16.391 fused_ordering(185) 00:14:16.391 fused_ordering(186) 00:14:16.391 fused_ordering(187) 00:14:16.391 fused_ordering(188) 00:14:16.391 fused_ordering(189) 00:14:16.391 fused_ordering(190) 00:14:16.391 fused_ordering(191) 00:14:16.391 fused_ordering(192) 00:14:16.391 fused_ordering(193) 00:14:16.391 fused_ordering(194) 00:14:16.391 fused_ordering(195) 00:14:16.391 fused_ordering(196) 00:14:16.391 fused_ordering(197) 00:14:16.391 fused_ordering(198) 00:14:16.391 fused_ordering(199) 00:14:16.391 fused_ordering(200) 00:14:16.391 fused_ordering(201) 00:14:16.391 fused_ordering(202) 00:14:16.391 fused_ordering(203) 00:14:16.391 fused_ordering(204) 00:14:16.391 fused_ordering(205) 00:14:16.652 fused_ordering(206) 00:14:16.652 fused_ordering(207) 00:14:16.652 fused_ordering(208) 00:14:16.652 fused_ordering(209) 00:14:16.652 fused_ordering(210) 00:14:16.652 fused_ordering(211) 00:14:16.652 fused_ordering(212) 00:14:16.652 fused_ordering(213) 00:14:16.652 fused_ordering(214) 00:14:16.652 fused_ordering(215) 00:14:16.652 fused_ordering(216) 00:14:16.652 fused_ordering(217) 00:14:16.652 fused_ordering(218) 00:14:16.652 fused_ordering(219) 00:14:16.652 fused_ordering(220) 00:14:16.652 fused_ordering(221) 00:14:16.652 fused_ordering(222) 00:14:16.652 fused_ordering(223) 00:14:16.652 fused_ordering(224) 00:14:16.652 fused_ordering(225) 00:14:16.652 fused_ordering(226) 00:14:16.652 fused_ordering(227) 00:14:16.652 fused_ordering(228) 00:14:16.652 fused_ordering(229) 00:14:16.652 fused_ordering(230) 00:14:16.652 fused_ordering(231) 00:14:16.652 fused_ordering(232) 00:14:16.652 fused_ordering(233) 00:14:16.652 fused_ordering(234) 00:14:16.652 fused_ordering(235) 00:14:16.652 fused_ordering(236) 00:14:16.653 fused_ordering(237) 00:14:16.653 fused_ordering(238) 00:14:16.653 fused_ordering(239) 00:14:16.653 fused_ordering(240) 00:14:16.653 fused_ordering(241) 00:14:16.653 fused_ordering(242) 00:14:16.653 fused_ordering(243) 00:14:16.653 fused_ordering(244) 00:14:16.653 fused_ordering(245) 00:14:16.653 fused_ordering(246) 00:14:16.653 fused_ordering(247) 00:14:16.653 fused_ordering(248) 00:14:16.653 fused_ordering(249) 00:14:16.653 fused_ordering(250) 00:14:16.653 fused_ordering(251) 00:14:16.653 fused_ordering(252) 00:14:16.653 fused_ordering(253) 00:14:16.653 fused_ordering(254) 00:14:16.653 fused_ordering(255) 00:14:16.653 fused_ordering(256) 00:14:16.653 fused_ordering(257) 00:14:16.653 fused_ordering(258) 00:14:16.653 fused_ordering(259) 00:14:16.653 fused_ordering(260) 00:14:16.653 fused_ordering(261) 00:14:16.653 fused_ordering(262) 00:14:16.653 fused_ordering(263) 00:14:16.653 fused_ordering(264) 00:14:16.653 fused_ordering(265) 00:14:16.653 fused_ordering(266) 00:14:16.653 fused_ordering(267) 00:14:16.653 fused_ordering(268) 00:14:16.653 fused_ordering(269) 00:14:16.653 fused_ordering(270) 00:14:16.653 fused_ordering(271) 00:14:16.653 fused_ordering(272) 00:14:16.653 fused_ordering(273) 00:14:16.653 fused_ordering(274) 00:14:16.653 fused_ordering(275) 00:14:16.653 fused_ordering(276) 00:14:16.653 fused_ordering(277) 00:14:16.653 fused_ordering(278) 00:14:16.653 fused_ordering(279) 00:14:16.653 fused_ordering(280) 00:14:16.653 fused_ordering(281) 00:14:16.653 fused_ordering(282) 00:14:16.653 fused_ordering(283) 00:14:16.653 fused_ordering(284) 00:14:16.653 fused_ordering(285) 00:14:16.653 fused_ordering(286) 00:14:16.653 fused_ordering(287) 00:14:16.653 fused_ordering(288) 00:14:16.653 fused_ordering(289) 00:14:16.653 fused_ordering(290) 00:14:16.653 fused_ordering(291) 00:14:16.653 fused_ordering(292) 00:14:16.653 fused_ordering(293) 00:14:16.653 fused_ordering(294) 00:14:16.653 fused_ordering(295) 00:14:16.653 fused_ordering(296) 00:14:16.653 fused_ordering(297) 00:14:16.653 fused_ordering(298) 00:14:16.653 fused_ordering(299) 00:14:16.653 fused_ordering(300) 00:14:16.653 fused_ordering(301) 00:14:16.653 fused_ordering(302) 00:14:16.653 fused_ordering(303) 00:14:16.653 fused_ordering(304) 00:14:16.653 fused_ordering(305) 00:14:16.653 fused_ordering(306) 00:14:16.653 fused_ordering(307) 00:14:16.653 fused_ordering(308) 00:14:16.653 fused_ordering(309) 00:14:16.653 fused_ordering(310) 00:14:16.653 fused_ordering(311) 00:14:16.653 fused_ordering(312) 00:14:16.653 fused_ordering(313) 00:14:16.653 fused_ordering(314) 00:14:16.653 fused_ordering(315) 00:14:16.653 fused_ordering(316) 00:14:16.653 fused_ordering(317) 00:14:16.653 fused_ordering(318) 00:14:16.653 fused_ordering(319) 00:14:16.653 fused_ordering(320) 00:14:16.653 fused_ordering(321) 00:14:16.653 fused_ordering(322) 00:14:16.653 fused_ordering(323) 00:14:16.653 fused_ordering(324) 00:14:16.653 fused_ordering(325) 00:14:16.653 fused_ordering(326) 00:14:16.653 fused_ordering(327) 00:14:16.653 fused_ordering(328) 00:14:16.653 fused_ordering(329) 00:14:16.653 fused_ordering(330) 00:14:16.653 fused_ordering(331) 00:14:16.653 fused_ordering(332) 00:14:16.653 fused_ordering(333) 00:14:16.653 fused_ordering(334) 00:14:16.653 fused_ordering(335) 00:14:16.653 fused_ordering(336) 00:14:16.653 fused_ordering(337) 00:14:16.653 fused_ordering(338) 00:14:16.653 fused_ordering(339) 00:14:16.653 fused_ordering(340) 00:14:16.653 fused_ordering(341) 00:14:16.653 fused_ordering(342) 00:14:16.653 fused_ordering(343) 00:14:16.653 fused_ordering(344) 00:14:16.653 fused_ordering(345) 00:14:16.653 fused_ordering(346) 00:14:16.653 fused_ordering(347) 00:14:16.653 fused_ordering(348) 00:14:16.653 fused_ordering(349) 00:14:16.653 fused_ordering(350) 00:14:16.653 fused_ordering(351) 00:14:16.653 fused_ordering(352) 00:14:16.653 fused_ordering(353) 00:14:16.653 fused_ordering(354) 00:14:16.653 fused_ordering(355) 00:14:16.653 fused_ordering(356) 00:14:16.653 fused_ordering(357) 00:14:16.653 fused_ordering(358) 00:14:16.653 fused_ordering(359) 00:14:16.653 fused_ordering(360) 00:14:16.653 fused_ordering(361) 00:14:16.653 fused_ordering(362) 00:14:16.653 fused_ordering(363) 00:14:16.653 fused_ordering(364) 00:14:16.653 fused_ordering(365) 00:14:16.653 fused_ordering(366) 00:14:16.653 fused_ordering(367) 00:14:16.653 fused_ordering(368) 00:14:16.653 fused_ordering(369) 00:14:16.653 fused_ordering(370) 00:14:16.653 fused_ordering(371) 00:14:16.653 fused_ordering(372) 00:14:16.653 fused_ordering(373) 00:14:16.653 fused_ordering(374) 00:14:16.653 fused_ordering(375) 00:14:16.653 fused_ordering(376) 00:14:16.653 fused_ordering(377) 00:14:16.653 fused_ordering(378) 00:14:16.653 fused_ordering(379) 00:14:16.653 fused_ordering(380) 00:14:16.653 fused_ordering(381) 00:14:16.653 fused_ordering(382) 00:14:16.653 fused_ordering(383) 00:14:16.653 fused_ordering(384) 00:14:16.653 fused_ordering(385) 00:14:16.653 fused_ordering(386) 00:14:16.653 fused_ordering(387) 00:14:16.653 fused_ordering(388) 00:14:16.653 fused_ordering(389) 00:14:16.653 fused_ordering(390) 00:14:16.653 fused_ordering(391) 00:14:16.653 fused_ordering(392) 00:14:16.653 fused_ordering(393) 00:14:16.653 fused_ordering(394) 00:14:16.653 fused_ordering(395) 00:14:16.653 fused_ordering(396) 00:14:16.653 fused_ordering(397) 00:14:16.653 fused_ordering(398) 00:14:16.653 fused_ordering(399) 00:14:16.653 fused_ordering(400) 00:14:16.653 fused_ordering(401) 00:14:16.653 fused_ordering(402) 00:14:16.653 fused_ordering(403) 00:14:16.653 fused_ordering(404) 00:14:16.653 fused_ordering(405) 00:14:16.653 fused_ordering(406) 00:14:16.653 fused_ordering(407) 00:14:16.653 fused_ordering(408) 00:14:16.653 fused_ordering(409) 00:14:16.653 fused_ordering(410) 00:14:17.597 fused_ordering(411) 00:14:17.597 fused_ordering(412) 00:14:17.597 fused_ordering(413) 00:14:17.597 fused_ordering(414) 00:14:17.597 fused_ordering(415) 00:14:17.597 fused_ordering(416) 00:14:17.597 fused_ordering(417) 00:14:17.597 fused_ordering(418) 00:14:17.597 fused_ordering(419) 00:14:17.597 fused_ordering(420) 00:14:17.597 fused_ordering(421) 00:14:17.597 fused_ordering(422) 00:14:17.597 fused_ordering(423) 00:14:17.597 fused_ordering(424) 00:14:17.597 fused_ordering(425) 00:14:17.597 fused_ordering(426) 00:14:17.597 fused_ordering(427) 00:14:17.597 fused_ordering(428) 00:14:17.597 fused_ordering(429) 00:14:17.597 fused_ordering(430) 00:14:17.597 fused_ordering(431) 00:14:17.597 fused_ordering(432) 00:14:17.597 fused_ordering(433) 00:14:17.597 fused_ordering(434) 00:14:17.597 fused_ordering(435) 00:14:17.597 fused_ordering(436) 00:14:17.597 fused_ordering(437) 00:14:17.597 fused_ordering(438) 00:14:17.597 fused_ordering(439) 00:14:17.597 fused_ordering(440) 00:14:17.597 fused_ordering(441) 00:14:17.597 fused_ordering(442) 00:14:17.597 fused_ordering(443) 00:14:17.597 fused_ordering(444) 00:14:17.597 fused_ordering(445) 00:14:17.597 fused_ordering(446) 00:14:17.597 fused_ordering(447) 00:14:17.597 fused_ordering(448) 00:14:17.597 fused_ordering(449) 00:14:17.597 fused_ordering(450) 00:14:17.597 fused_ordering(451) 00:14:17.597 fused_ordering(452) 00:14:17.597 fused_ordering(453) 00:14:17.597 fused_ordering(454) 00:14:17.597 fused_ordering(455) 00:14:17.597 fused_ordering(456) 00:14:17.597 fused_ordering(457) 00:14:17.597 fused_ordering(458) 00:14:17.597 fused_ordering(459) 00:14:17.597 fused_ordering(460) 00:14:17.597 fused_ordering(461) 00:14:17.597 fused_ordering(462) 00:14:17.597 fused_ordering(463) 00:14:17.597 fused_ordering(464) 00:14:17.597 fused_ordering(465) 00:14:17.597 fused_ordering(466) 00:14:17.597 fused_ordering(467) 00:14:17.597 fused_ordering(468) 00:14:17.597 fused_ordering(469) 00:14:17.597 fused_ordering(470) 00:14:17.597 fused_ordering(471) 00:14:17.597 fused_ordering(472) 00:14:17.597 fused_ordering(473) 00:14:17.597 fused_ordering(474) 00:14:17.597 fused_ordering(475) 00:14:17.597 fused_ordering(476) 00:14:17.597 fused_ordering(477) 00:14:17.597 fused_ordering(478) 00:14:17.597 fused_ordering(479) 00:14:17.597 fused_ordering(480) 00:14:17.597 fused_ordering(481) 00:14:17.597 fused_ordering(482) 00:14:17.597 fused_ordering(483) 00:14:17.597 fused_ordering(484) 00:14:17.597 fused_ordering(485) 00:14:17.597 fused_ordering(486) 00:14:17.597 fused_ordering(487) 00:14:17.597 fused_ordering(488) 00:14:17.597 fused_ordering(489) 00:14:17.597 fused_ordering(490) 00:14:17.597 fused_ordering(491) 00:14:17.597 fused_ordering(492) 00:14:17.597 fused_ordering(493) 00:14:17.597 fused_ordering(494) 00:14:17.597 fused_ordering(495) 00:14:17.597 fused_ordering(496) 00:14:17.597 fused_ordering(497) 00:14:17.597 fused_ordering(498) 00:14:17.597 fused_ordering(499) 00:14:17.597 fused_ordering(500) 00:14:17.597 fused_ordering(501) 00:14:17.597 fused_ordering(502) 00:14:17.597 fused_ordering(503) 00:14:17.597 fused_ordering(504) 00:14:17.597 fused_ordering(505) 00:14:17.597 fused_ordering(506) 00:14:17.597 fused_ordering(507) 00:14:17.597 fused_ordering(508) 00:14:17.597 fused_ordering(509) 00:14:17.597 fused_ordering(510) 00:14:17.597 fused_ordering(511) 00:14:17.597 fused_ordering(512) 00:14:17.597 fused_ordering(513) 00:14:17.597 fused_ordering(514) 00:14:17.597 fused_ordering(515) 00:14:17.597 fused_ordering(516) 00:14:17.597 fused_ordering(517) 00:14:17.597 fused_ordering(518) 00:14:17.597 fused_ordering(519) 00:14:17.597 fused_ordering(520) 00:14:17.597 fused_ordering(521) 00:14:17.597 fused_ordering(522) 00:14:17.597 fused_ordering(523) 00:14:17.597 fused_ordering(524) 00:14:17.597 fused_ordering(525) 00:14:17.597 fused_ordering(526) 00:14:17.597 fused_ordering(527) 00:14:17.597 fused_ordering(528) 00:14:17.597 fused_ordering(529) 00:14:17.597 fused_ordering(530) 00:14:17.597 fused_ordering(531) 00:14:17.597 fused_ordering(532) 00:14:17.597 fused_ordering(533) 00:14:17.597 fused_ordering(534) 00:14:17.597 fused_ordering(535) 00:14:17.597 fused_ordering(536) 00:14:17.597 fused_ordering(537) 00:14:17.597 fused_ordering(538) 00:14:17.597 fused_ordering(539) 00:14:17.597 fused_ordering(540) 00:14:17.597 fused_ordering(541) 00:14:17.597 fused_ordering(542) 00:14:17.597 fused_ordering(543) 00:14:17.597 fused_ordering(544) 00:14:17.597 fused_ordering(545) 00:14:17.597 fused_ordering(546) 00:14:17.597 fused_ordering(547) 00:14:17.597 fused_ordering(548) 00:14:17.597 fused_ordering(549) 00:14:17.597 fused_ordering(550) 00:14:17.597 fused_ordering(551) 00:14:17.597 fused_ordering(552) 00:14:17.597 fused_ordering(553) 00:14:17.597 fused_ordering(554) 00:14:17.597 fused_ordering(555) 00:14:17.597 fused_ordering(556) 00:14:17.597 fused_ordering(557) 00:14:17.597 fused_ordering(558) 00:14:17.597 fused_ordering(559) 00:14:17.597 fused_ordering(560) 00:14:17.597 fused_ordering(561) 00:14:17.597 fused_ordering(562) 00:14:17.597 fused_ordering(563) 00:14:17.597 fused_ordering(564) 00:14:17.597 fused_ordering(565) 00:14:17.597 fused_ordering(566) 00:14:17.597 fused_ordering(567) 00:14:17.597 fused_ordering(568) 00:14:17.597 fused_ordering(569) 00:14:17.597 fused_ordering(570) 00:14:17.597 fused_ordering(571) 00:14:17.597 fused_ordering(572) 00:14:17.597 fused_ordering(573) 00:14:17.597 fused_ordering(574) 00:14:17.597 fused_ordering(575) 00:14:17.597 fused_ordering(576) 00:14:17.597 fused_ordering(577) 00:14:17.597 fused_ordering(578) 00:14:17.597 fused_ordering(579) 00:14:17.597 fused_ordering(580) 00:14:17.597 fused_ordering(581) 00:14:17.597 fused_ordering(582) 00:14:17.597 fused_ordering(583) 00:14:17.597 fused_ordering(584) 00:14:17.597 fused_ordering(585) 00:14:17.597 fused_ordering(586) 00:14:17.597 fused_ordering(587) 00:14:17.597 fused_ordering(588) 00:14:17.597 fused_ordering(589) 00:14:17.597 fused_ordering(590) 00:14:17.597 fused_ordering(591) 00:14:17.597 fused_ordering(592) 00:14:17.597 fused_ordering(593) 00:14:17.597 fused_ordering(594) 00:14:17.597 fused_ordering(595) 00:14:17.597 fused_ordering(596) 00:14:17.597 fused_ordering(597) 00:14:17.598 fused_ordering(598) 00:14:17.598 fused_ordering(599) 00:14:17.598 fused_ordering(600) 00:14:17.598 fused_ordering(601) 00:14:17.598 fused_ordering(602) 00:14:17.598 fused_ordering(603) 00:14:17.598 fused_ordering(604) 00:14:17.598 fused_ordering(605) 00:14:17.598 fused_ordering(606) 00:14:17.598 fused_ordering(607) 00:14:17.598 fused_ordering(608) 00:14:17.598 fused_ordering(609) 00:14:17.598 fused_ordering(610) 00:14:17.598 fused_ordering(611) 00:14:17.598 fused_ordering(612) 00:14:17.598 fused_ordering(613) 00:14:17.598 fused_ordering(614) 00:14:17.598 fused_ordering(615) 00:14:18.170 fused_ordering(616) 00:14:18.170 fused_ordering(617) 00:14:18.170 fused_ordering(618) 00:14:18.170 fused_ordering(619) 00:14:18.170 fused_ordering(620) 00:14:18.170 fused_ordering(621) 00:14:18.170 fused_ordering(622) 00:14:18.170 fused_ordering(623) 00:14:18.170 fused_ordering(624) 00:14:18.170 fused_ordering(625) 00:14:18.171 fused_ordering(626) 00:14:18.171 fused_ordering(627) 00:14:18.171 fused_ordering(628) 00:14:18.171 fused_ordering(629) 00:14:18.171 fused_ordering(630) 00:14:18.171 fused_ordering(631) 00:14:18.171 fused_ordering(632) 00:14:18.171 fused_ordering(633) 00:14:18.171 fused_ordering(634) 00:14:18.171 fused_ordering(635) 00:14:18.171 fused_ordering(636) 00:14:18.171 fused_ordering(637) 00:14:18.171 fused_ordering(638) 00:14:18.171 fused_ordering(639) 00:14:18.171 fused_ordering(640) 00:14:18.171 fused_ordering(641) 00:14:18.171 fused_ordering(642) 00:14:18.171 fused_ordering(643) 00:14:18.171 fused_ordering(644) 00:14:18.171 fused_ordering(645) 00:14:18.171 fused_ordering(646) 00:14:18.171 fused_ordering(647) 00:14:18.171 fused_ordering(648) 00:14:18.171 fused_ordering(649) 00:14:18.171 fused_ordering(650) 00:14:18.171 fused_ordering(651) 00:14:18.171 fused_ordering(652) 00:14:18.171 fused_ordering(653) 00:14:18.171 fused_ordering(654) 00:14:18.171 fused_ordering(655) 00:14:18.171 fused_ordering(656) 00:14:18.171 fused_ordering(657) 00:14:18.171 fused_ordering(658) 00:14:18.171 fused_ordering(659) 00:14:18.171 fused_ordering(660) 00:14:18.171 fused_ordering(661) 00:14:18.171 fused_ordering(662) 00:14:18.171 fused_ordering(663) 00:14:18.171 fused_ordering(664) 00:14:18.171 fused_ordering(665) 00:14:18.171 fused_ordering(666) 00:14:18.171 fused_ordering(667) 00:14:18.171 fused_ordering(668) 00:14:18.171 fused_ordering(669) 00:14:18.171 fused_ordering(670) 00:14:18.171 fused_ordering(671) 00:14:18.171 fused_ordering(672) 00:14:18.171 fused_ordering(673) 00:14:18.171 fused_ordering(674) 00:14:18.171 fused_ordering(675) 00:14:18.171 fused_ordering(676) 00:14:18.171 fused_ordering(677) 00:14:18.171 fused_ordering(678) 00:14:18.171 fused_ordering(679) 00:14:18.171 fused_ordering(680) 00:14:18.171 fused_ordering(681) 00:14:18.171 fused_ordering(682) 00:14:18.171 fused_ordering(683) 00:14:18.171 fused_ordering(684) 00:14:18.171 fused_ordering(685) 00:14:18.171 fused_ordering(686) 00:14:18.171 fused_ordering(687) 00:14:18.171 fused_ordering(688) 00:14:18.171 fused_ordering(689) 00:14:18.171 fused_ordering(690) 00:14:18.171 fused_ordering(691) 00:14:18.171 fused_ordering(692) 00:14:18.171 fused_ordering(693) 00:14:18.171 fused_ordering(694) 00:14:18.171 fused_ordering(695) 00:14:18.171 fused_ordering(696) 00:14:18.171 fused_ordering(697) 00:14:18.171 fused_ordering(698) 00:14:18.171 fused_ordering(699) 00:14:18.171 fused_ordering(700) 00:14:18.171 fused_ordering(701) 00:14:18.171 fused_ordering(702) 00:14:18.171 fused_ordering(703) 00:14:18.171 fused_ordering(704) 00:14:18.171 fused_ordering(705) 00:14:18.171 fused_ordering(706) 00:14:18.171 fused_ordering(707) 00:14:18.171 fused_ordering(708) 00:14:18.171 fused_ordering(709) 00:14:18.171 fused_ordering(710) 00:14:18.171 fused_ordering(711) 00:14:18.171 fused_ordering(712) 00:14:18.171 fused_ordering(713) 00:14:18.171 fused_ordering(714) 00:14:18.171 fused_ordering(715) 00:14:18.171 fused_ordering(716) 00:14:18.171 fused_ordering(717) 00:14:18.171 fused_ordering(718) 00:14:18.171 fused_ordering(719) 00:14:18.171 fused_ordering(720) 00:14:18.171 fused_ordering(721) 00:14:18.171 fused_ordering(722) 00:14:18.171 fused_ordering(723) 00:14:18.171 fused_ordering(724) 00:14:18.171 fused_ordering(725) 00:14:18.171 fused_ordering(726) 00:14:18.171 fused_ordering(727) 00:14:18.171 fused_ordering(728) 00:14:18.171 fused_ordering(729) 00:14:18.171 fused_ordering(730) 00:14:18.171 fused_ordering(731) 00:14:18.171 fused_ordering(732) 00:14:18.171 fused_ordering(733) 00:14:18.171 fused_ordering(734) 00:14:18.171 fused_ordering(735) 00:14:18.171 fused_ordering(736) 00:14:18.171 fused_ordering(737) 00:14:18.171 fused_ordering(738) 00:14:18.171 fused_ordering(739) 00:14:18.171 fused_ordering(740) 00:14:18.171 fused_ordering(741) 00:14:18.171 fused_ordering(742) 00:14:18.171 fused_ordering(743) 00:14:18.171 fused_ordering(744) 00:14:18.171 fused_ordering(745) 00:14:18.171 fused_ordering(746) 00:14:18.171 fused_ordering(747) 00:14:18.171 fused_ordering(748) 00:14:18.171 fused_ordering(749) 00:14:18.171 fused_ordering(750) 00:14:18.171 fused_ordering(751) 00:14:18.171 fused_ordering(752) 00:14:18.171 fused_ordering(753) 00:14:18.171 fused_ordering(754) 00:14:18.171 fused_ordering(755) 00:14:18.171 fused_ordering(756) 00:14:18.171 fused_ordering(757) 00:14:18.171 fused_ordering(758) 00:14:18.171 fused_ordering(759) 00:14:18.171 fused_ordering(760) 00:14:18.171 fused_ordering(761) 00:14:18.171 fused_ordering(762) 00:14:18.171 fused_ordering(763) 00:14:18.171 fused_ordering(764) 00:14:18.171 fused_ordering(765) 00:14:18.171 fused_ordering(766) 00:14:18.171 fused_ordering(767) 00:14:18.171 fused_ordering(768) 00:14:18.171 fused_ordering(769) 00:14:18.171 fused_ordering(770) 00:14:18.171 fused_ordering(771) 00:14:18.171 fused_ordering(772) 00:14:18.171 fused_ordering(773) 00:14:18.171 fused_ordering(774) 00:14:18.171 fused_ordering(775) 00:14:18.171 fused_ordering(776) 00:14:18.171 fused_ordering(777) 00:14:18.171 fused_ordering(778) 00:14:18.171 fused_ordering(779) 00:14:18.171 fused_ordering(780) 00:14:18.171 fused_ordering(781) 00:14:18.171 fused_ordering(782) 00:14:18.171 fused_ordering(783) 00:14:18.171 fused_ordering(784) 00:14:18.171 fused_ordering(785) 00:14:18.171 fused_ordering(786) 00:14:18.171 fused_ordering(787) 00:14:18.171 fused_ordering(788) 00:14:18.171 fused_ordering(789) 00:14:18.171 fused_ordering(790) 00:14:18.171 fused_ordering(791) 00:14:18.171 fused_ordering(792) 00:14:18.171 fused_ordering(793) 00:14:18.171 fused_ordering(794) 00:14:18.171 fused_ordering(795) 00:14:18.171 fused_ordering(796) 00:14:18.171 fused_ordering(797) 00:14:18.171 fused_ordering(798) 00:14:18.171 fused_ordering(799) 00:14:18.171 fused_ordering(800) 00:14:18.171 fused_ordering(801) 00:14:18.171 fused_ordering(802) 00:14:18.171 fused_ordering(803) 00:14:18.171 fused_ordering(804) 00:14:18.171 fused_ordering(805) 00:14:18.171 fused_ordering(806) 00:14:18.171 fused_ordering(807) 00:14:18.171 fused_ordering(808) 00:14:18.171 fused_ordering(809) 00:14:18.171 fused_ordering(810) 00:14:18.171 fused_ordering(811) 00:14:18.171 fused_ordering(812) 00:14:18.171 fused_ordering(813) 00:14:18.171 fused_ordering(814) 00:14:18.171 fused_ordering(815) 00:14:18.171 fused_ordering(816) 00:14:18.171 fused_ordering(817) 00:14:18.172 fused_ordering(818) 00:14:18.172 fused_ordering(819) 00:14:18.172 fused_ordering(820) 00:14:19.116 fused_ordering(821) 00:14:19.116 fused_ordering(822) 00:14:19.116 fused_ordering(823) 00:14:19.116 fused_ordering(824) 00:14:19.116 fused_ordering(825) 00:14:19.116 fused_ordering(826) 00:14:19.116 fused_ordering(827) 00:14:19.116 fused_ordering(828) 00:14:19.116 fused_ordering(829) 00:14:19.116 fused_ordering(830) 00:14:19.116 fused_ordering(831) 00:14:19.116 fused_ordering(832) 00:14:19.116 fused_ordering(833) 00:14:19.116 fused_ordering(834) 00:14:19.116 fused_ordering(835) 00:14:19.116 fused_ordering(836) 00:14:19.116 fused_ordering(837) 00:14:19.116 fused_ordering(838) 00:14:19.116 fused_ordering(839) 00:14:19.116 fused_ordering(840) 00:14:19.116 fused_ordering(841) 00:14:19.116 fused_ordering(842) 00:14:19.116 fused_ordering(843) 00:14:19.116 fused_ordering(844) 00:14:19.116 fused_ordering(845) 00:14:19.116 fused_ordering(846) 00:14:19.116 fused_ordering(847) 00:14:19.116 fused_ordering(848) 00:14:19.116 fused_ordering(849) 00:14:19.116 fused_ordering(850) 00:14:19.116 fused_ordering(851) 00:14:19.116 fused_ordering(852) 00:14:19.116 fused_ordering(853) 00:14:19.116 fused_ordering(854) 00:14:19.116 fused_ordering(855) 00:14:19.116 fused_ordering(856) 00:14:19.116 fused_ordering(857) 00:14:19.116 fused_ordering(858) 00:14:19.116 fused_ordering(859) 00:14:19.116 fused_ordering(860) 00:14:19.116 fused_ordering(861) 00:14:19.116 fused_ordering(862) 00:14:19.116 fused_ordering(863) 00:14:19.116 fused_ordering(864) 00:14:19.116 fused_ordering(865) 00:14:19.116 fused_ordering(866) 00:14:19.116 fused_ordering(867) 00:14:19.116 fused_ordering(868) 00:14:19.116 fused_ordering(869) 00:14:19.116 fused_ordering(870) 00:14:19.116 fused_ordering(871) 00:14:19.116 fused_ordering(872) 00:14:19.116 fused_ordering(873) 00:14:19.116 fused_ordering(874) 00:14:19.116 fused_ordering(875) 00:14:19.116 fused_ordering(876) 00:14:19.116 fused_ordering(877) 00:14:19.116 fused_ordering(878) 00:14:19.116 fused_ordering(879) 00:14:19.116 fused_ordering(880) 00:14:19.116 fused_ordering(881) 00:14:19.116 fused_ordering(882) 00:14:19.116 fused_ordering(883) 00:14:19.116 fused_ordering(884) 00:14:19.116 fused_ordering(885) 00:14:19.116 fused_ordering(886) 00:14:19.116 fused_ordering(887) 00:14:19.116 fused_ordering(888) 00:14:19.116 fused_ordering(889) 00:14:19.116 fused_ordering(890) 00:14:19.116 fused_ordering(891) 00:14:19.116 fused_ordering(892) 00:14:19.116 fused_ordering(893) 00:14:19.116 fused_ordering(894) 00:14:19.116 fused_ordering(895) 00:14:19.116 fused_ordering(896) 00:14:19.116 fused_ordering(897) 00:14:19.116 fused_ordering(898) 00:14:19.116 fused_ordering(899) 00:14:19.116 fused_ordering(900) 00:14:19.116 fused_ordering(901) 00:14:19.116 fused_ordering(902) 00:14:19.116 fused_ordering(903) 00:14:19.116 fused_ordering(904) 00:14:19.116 fused_ordering(905) 00:14:19.116 fused_ordering(906) 00:14:19.116 fused_ordering(907) 00:14:19.116 fused_ordering(908) 00:14:19.116 fused_ordering(909) 00:14:19.116 fused_ordering(910) 00:14:19.116 fused_ordering(911) 00:14:19.116 fused_ordering(912) 00:14:19.116 fused_ordering(913) 00:14:19.116 fused_ordering(914) 00:14:19.116 fused_ordering(915) 00:14:19.116 fused_ordering(916) 00:14:19.116 fused_ordering(917) 00:14:19.116 fused_ordering(918) 00:14:19.116 fused_ordering(919) 00:14:19.116 fused_ordering(920) 00:14:19.116 fused_ordering(921) 00:14:19.116 fused_ordering(922) 00:14:19.116 fused_ordering(923) 00:14:19.116 fused_ordering(924) 00:14:19.116 fused_ordering(925) 00:14:19.116 fused_ordering(926) 00:14:19.116 fused_ordering(927) 00:14:19.116 fused_ordering(928) 00:14:19.116 fused_ordering(929) 00:14:19.116 fused_ordering(930) 00:14:19.116 fused_ordering(931) 00:14:19.116 fused_ordering(932) 00:14:19.116 fused_ordering(933) 00:14:19.116 fused_ordering(934) 00:14:19.116 fused_ordering(935) 00:14:19.116 fused_ordering(936) 00:14:19.116 fused_ordering(937) 00:14:19.116 fused_ordering(938) 00:14:19.116 fused_ordering(939) 00:14:19.116 fused_ordering(940) 00:14:19.116 fused_ordering(941) 00:14:19.116 fused_ordering(942) 00:14:19.116 fused_ordering(943) 00:14:19.116 fused_ordering(944) 00:14:19.116 fused_ordering(945) 00:14:19.116 fused_ordering(946) 00:14:19.116 fused_ordering(947) 00:14:19.116 fused_ordering(948) 00:14:19.116 fused_ordering(949) 00:14:19.116 fused_ordering(950) 00:14:19.116 fused_ordering(951) 00:14:19.116 fused_ordering(952) 00:14:19.116 fused_ordering(953) 00:14:19.116 fused_ordering(954) 00:14:19.116 fused_ordering(955) 00:14:19.116 fused_ordering(956) 00:14:19.116 fused_ordering(957) 00:14:19.116 fused_ordering(958) 00:14:19.116 fused_ordering(959) 00:14:19.116 fused_ordering(960) 00:14:19.116 fused_ordering(961) 00:14:19.116 fused_ordering(962) 00:14:19.116 fused_ordering(963) 00:14:19.116 fused_ordering(964) 00:14:19.116 fused_ordering(965) 00:14:19.116 fused_ordering(966) 00:14:19.116 fused_ordering(967) 00:14:19.116 fused_ordering(968) 00:14:19.116 fused_ordering(969) 00:14:19.116 fused_ordering(970) 00:14:19.116 fused_ordering(971) 00:14:19.116 fused_ordering(972) 00:14:19.116 fused_ordering(973) 00:14:19.116 fused_ordering(974) 00:14:19.116 fused_ordering(975) 00:14:19.116 fused_ordering(976) 00:14:19.116 fused_ordering(977) 00:14:19.116 fused_ordering(978) 00:14:19.116 fused_ordering(979) 00:14:19.116 fused_ordering(980) 00:14:19.116 fused_ordering(981) 00:14:19.116 fused_ordering(982) 00:14:19.116 fused_ordering(983) 00:14:19.116 fused_ordering(984) 00:14:19.116 fused_ordering(985) 00:14:19.116 fused_ordering(986) 00:14:19.116 fused_ordering(987) 00:14:19.116 fused_ordering(988) 00:14:19.116 fused_ordering(989) 00:14:19.116 fused_ordering(990) 00:14:19.116 fused_ordering(991) 00:14:19.116 fused_ordering(992) 00:14:19.116 fused_ordering(993) 00:14:19.116 fused_ordering(994) 00:14:19.116 fused_ordering(995) 00:14:19.116 fused_ordering(996) 00:14:19.116 fused_ordering(997) 00:14:19.116 fused_ordering(998) 00:14:19.116 fused_ordering(999) 00:14:19.116 fused_ordering(1000) 00:14:19.116 fused_ordering(1001) 00:14:19.116 fused_ordering(1002) 00:14:19.116 fused_ordering(1003) 00:14:19.116 fused_ordering(1004) 00:14:19.116 fused_ordering(1005) 00:14:19.116 fused_ordering(1006) 00:14:19.116 fused_ordering(1007) 00:14:19.116 fused_ordering(1008) 00:14:19.116 fused_ordering(1009) 00:14:19.116 fused_ordering(1010) 00:14:19.116 fused_ordering(1011) 00:14:19.116 fused_ordering(1012) 00:14:19.116 fused_ordering(1013) 00:14:19.116 fused_ordering(1014) 00:14:19.116 fused_ordering(1015) 00:14:19.116 fused_ordering(1016) 00:14:19.116 fused_ordering(1017) 00:14:19.116 fused_ordering(1018) 00:14:19.116 fused_ordering(1019) 00:14:19.116 fused_ordering(1020) 00:14:19.116 fused_ordering(1021) 00:14:19.116 fused_ordering(1022) 00:14:19.116 fused_ordering(1023) 00:14:19.117 20:31:37 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:14:19.117 20:31:37 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:14:19.117 20:31:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:19.117 20:31:37 -- nvmf/common.sh@116 -- # sync 00:14:19.117 20:31:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:19.117 20:31:37 -- nvmf/common.sh@119 -- # set +e 00:14:19.117 20:31:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:19.117 20:31:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:19.117 rmmod nvme_tcp 00:14:19.117 rmmod nvme_fabrics 00:14:19.117 rmmod nvme_keyring 00:14:19.117 20:31:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:19.117 20:31:37 -- nvmf/common.sh@123 -- # set -e 00:14:19.117 20:31:37 -- nvmf/common.sh@124 -- # return 0 00:14:19.117 20:31:37 -- nvmf/common.sh@477 -- # '[' -n 3979863 ']' 00:14:19.117 20:31:37 -- nvmf/common.sh@478 -- # killprocess 3979863 00:14:19.117 20:31:37 -- common/autotest_common.sh@926 -- # '[' -z 3979863 ']' 00:14:19.117 20:31:37 -- common/autotest_common.sh@930 -- # kill -0 3979863 00:14:19.117 20:31:37 -- common/autotest_common.sh@931 -- # uname 00:14:19.117 20:31:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:19.117 20:31:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3979863 00:14:19.117 20:31:37 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:19.117 20:31:37 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:19.117 20:31:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3979863' 00:14:19.117 killing process with pid 3979863 00:14:19.117 20:31:37 -- common/autotest_common.sh@945 -- # kill 3979863 00:14:19.117 20:31:37 -- common/autotest_common.sh@950 -- # wait 3979863 00:14:19.117 20:31:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:19.117 20:31:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:19.117 20:31:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:19.117 20:31:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:19.117 20:31:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:19.117 20:31:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:19.117 20:31:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:19.117 20:31:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:21.666 20:31:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:21.666 00:14:21.666 real 0m13.502s 00:14:21.666 user 0m7.458s 00:14:21.666 sys 0m7.476s 00:14:21.666 20:31:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:21.666 20:31:39 -- common/autotest_common.sh@10 -- # set +x 00:14:21.666 ************************************ 00:14:21.666 END TEST nvmf_fused_ordering 00:14:21.666 ************************************ 00:14:21.666 20:31:39 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:21.666 20:31:39 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:21.666 20:31:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:21.666 20:31:39 -- common/autotest_common.sh@10 -- # set +x 00:14:21.666 ************************************ 00:14:21.666 START TEST nvmf_delete_subsystem 00:14:21.666 ************************************ 00:14:21.666 20:31:39 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:21.666 * Looking for test storage... 00:14:21.666 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:21.666 20:31:39 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:21.666 20:31:39 -- nvmf/common.sh@7 -- # uname -s 00:14:21.666 20:31:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:21.666 20:31:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:21.666 20:31:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:21.666 20:31:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:21.666 20:31:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:21.666 20:31:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:21.666 20:31:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:21.666 20:31:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:21.666 20:31:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:21.666 20:31:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:21.666 20:31:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:21.666 20:31:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:21.666 20:31:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:21.666 20:31:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:21.666 20:31:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:21.666 20:31:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:21.666 20:31:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:21.666 20:31:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:21.666 20:31:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:21.666 20:31:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:21.666 20:31:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:21.666 20:31:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:21.666 20:31:39 -- paths/export.sh@5 -- # export PATH 00:14:21.667 20:31:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:21.667 20:31:39 -- nvmf/common.sh@46 -- # : 0 00:14:21.667 20:31:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:21.667 20:31:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:21.667 20:31:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:21.667 20:31:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:21.667 20:31:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:21.667 20:31:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:21.667 20:31:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:21.667 20:31:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:21.667 20:31:39 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:14:21.667 20:31:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:21.667 20:31:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:21.667 20:31:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:21.667 20:31:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:21.667 20:31:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:21.667 20:31:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:21.667 20:31:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:21.667 20:31:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:21.667 20:31:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:21.667 20:31:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:21.667 20:31:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:21.667 20:31:39 -- common/autotest_common.sh@10 -- # set +x 00:14:28.266 20:31:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:28.266 20:31:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:28.266 20:31:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:28.266 20:31:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:28.266 20:31:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:28.266 20:31:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:28.266 20:31:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:28.266 20:31:46 -- nvmf/common.sh@294 -- # net_devs=() 00:14:28.266 20:31:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:28.266 20:31:46 -- nvmf/common.sh@295 -- # e810=() 00:14:28.266 20:31:46 -- nvmf/common.sh@295 -- # local -ga e810 00:14:28.266 20:31:46 -- nvmf/common.sh@296 -- # x722=() 00:14:28.266 20:31:46 -- nvmf/common.sh@296 -- # local -ga x722 00:14:28.266 20:31:46 -- nvmf/common.sh@297 -- # mlx=() 00:14:28.266 20:31:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:28.266 20:31:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:28.266 20:31:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:28.266 20:31:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:28.266 20:31:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:28.266 20:31:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:28.266 20:31:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:28.266 20:31:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:28.266 20:31:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:28.266 20:31:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:28.266 20:31:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:28.266 20:31:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:28.266 20:31:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:28.266 20:31:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:28.266 20:31:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:28.266 20:31:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:28.266 20:31:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:14:28.266 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:14:28.266 20:31:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:28.266 20:31:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:14:28.266 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:14:28.266 20:31:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:28.266 20:31:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:28.266 20:31:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:28.266 20:31:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:28.266 20:31:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:28.266 20:31:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:14:28.266 Found net devices under 0000:4b:00.0: cvl_0_0 00:14:28.266 20:31:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:28.266 20:31:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:28.266 20:31:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:28.266 20:31:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:28.266 20:31:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:28.266 20:31:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:14:28.266 Found net devices under 0000:4b:00.1: cvl_0_1 00:14:28.266 20:31:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:28.266 20:31:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:28.266 20:31:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:28.266 20:31:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:28.266 20:31:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:28.266 20:31:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:28.266 20:31:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:28.266 20:31:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:28.266 20:31:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:28.266 20:31:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:28.266 20:31:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:28.266 20:31:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:28.266 20:31:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:28.266 20:31:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:28.266 20:31:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:28.266 20:31:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:28.266 20:31:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:28.266 20:31:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:28.266 20:31:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:28.266 20:31:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:28.266 20:31:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:28.266 20:31:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:28.266 20:31:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:28.266 20:31:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:28.266 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:28.266 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.658 ms 00:14:28.266 00:14:28.266 --- 10.0.0.2 ping statistics --- 00:14:28.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:28.266 rtt min/avg/max/mdev = 0.658/0.658/0.658/0.000 ms 00:14:28.266 20:31:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:28.266 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:28.266 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.360 ms 00:14:28.266 00:14:28.266 --- 10.0.0.1 ping statistics --- 00:14:28.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:28.266 rtt min/avg/max/mdev = 0.360/0.360/0.360/0.000 ms 00:14:28.266 20:31:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:28.266 20:31:46 -- nvmf/common.sh@410 -- # return 0 00:14:28.266 20:31:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:28.266 20:31:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:28.266 20:31:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:28.266 20:31:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:28.266 20:31:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:28.267 20:31:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:28.267 20:31:46 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:14:28.267 20:31:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:28.267 20:31:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:28.267 20:31:46 -- common/autotest_common.sh@10 -- # set +x 00:14:28.267 20:31:46 -- nvmf/common.sh@469 -- # nvmfpid=3984881 00:14:28.267 20:31:46 -- nvmf/common.sh@470 -- # waitforlisten 3984881 00:14:28.267 20:31:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:14:28.267 20:31:46 -- common/autotest_common.sh@819 -- # '[' -z 3984881 ']' 00:14:28.267 20:31:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:28.267 20:31:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:28.267 20:31:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:28.267 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:28.267 20:31:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:28.267 20:31:46 -- common/autotest_common.sh@10 -- # set +x 00:14:28.267 [2024-04-26 20:31:46.512227] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:14:28.267 [2024-04-26 20:31:46.512292] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:28.267 EAL: No free 2048 kB hugepages reported on node 1 00:14:28.267 [2024-04-26 20:31:46.579508] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:14:28.528 [2024-04-26 20:31:46.648269] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:28.528 [2024-04-26 20:31:46.648398] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:28.528 [2024-04-26 20:31:46.648407] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:28.528 [2024-04-26 20:31:46.648414] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:28.528 [2024-04-26 20:31:46.648525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:28.528 [2024-04-26 20:31:46.648530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:29.101 20:31:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:29.101 20:31:47 -- common/autotest_common.sh@852 -- # return 0 00:14:29.101 20:31:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:29.101 20:31:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:29.101 20:31:47 -- common/autotest_common.sh@10 -- # set +x 00:14:29.101 20:31:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:29.101 20:31:47 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:29.101 20:31:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:29.101 20:31:47 -- common/autotest_common.sh@10 -- # set +x 00:14:29.101 [2024-04-26 20:31:47.316302] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:29.101 20:31:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:29.101 20:31:47 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:29.101 20:31:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:29.101 20:31:47 -- common/autotest_common.sh@10 -- # set +x 00:14:29.101 20:31:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:29.101 20:31:47 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:29.101 20:31:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:29.101 20:31:47 -- common/autotest_common.sh@10 -- # set +x 00:14:29.101 [2024-04-26 20:31:47.332433] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:29.101 20:31:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:29.101 20:31:47 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:29.101 20:31:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:29.101 20:31:47 -- common/autotest_common.sh@10 -- # set +x 00:14:29.101 NULL1 00:14:29.101 20:31:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:29.101 20:31:47 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:29.101 20:31:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:29.101 20:31:47 -- common/autotest_common.sh@10 -- # set +x 00:14:29.101 Delay0 00:14:29.101 20:31:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:29.101 20:31:47 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:29.101 20:31:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:29.101 20:31:47 -- common/autotest_common.sh@10 -- # set +x 00:14:29.101 20:31:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:29.101 20:31:47 -- target/delete_subsystem.sh@28 -- # perf_pid=3985190 00:14:29.101 20:31:47 -- target/delete_subsystem.sh@30 -- # sleep 2 00:14:29.101 20:31:47 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:29.101 EAL: No free 2048 kB hugepages reported on node 1 00:14:29.101 [2024-04-26 20:31:47.407064] subsystem.c:1304:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:31.652 20:31:49 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:31.652 20:31:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:31.652 20:31:49 -- common/autotest_common.sh@10 -- # set +x 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 [2024-04-26 20:31:49.534006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1768e40 is same with the state(5) to be set 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 [2024-04-26 20:31:49.534721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17608f0 is same with the state(5) to be set 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 Read completed with error (sct=0, sc=8) 00:14:31.652 starting I/O failed: -6 00:14:31.652 Write completed with error (sct=0, sc=8) 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Write completed with error (sct=0, sc=8) 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 Write completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 Write completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Write completed with error (sct=0, sc=8) 00:14:31.653 Write completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 Write completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 Write completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Write completed with error (sct=0, sc=8) 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 Write completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 Write completed with error (sct=0, sc=8) 00:14:31.653 Read completed with error (sct=0, sc=8) 00:14:31.653 starting I/O failed: -6 00:14:31.653 starting I/O failed: -6 00:14:31.653 starting I/O failed: -6 00:14:31.653 starting I/O failed: -6 00:14:31.653 starting I/O failed: -6 00:14:31.653 starting I/O failed: -6 00:14:31.653 starting I/O failed: -6 00:14:31.653 starting I/O failed: -6 00:14:31.653 starting I/O failed: -6 00:14:31.653 starting I/O failed: -6 00:14:31.653 starting I/O failed: -6 00:14:31.653 starting I/O failed: -6 00:14:31.653 starting I/O failed: -6 00:14:31.653 starting I/O failed: -6 00:14:32.225 [2024-04-26 20:31:50.504681] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1757910 is same with the state(5) to be set 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 [2024-04-26 20:31:50.537313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1760640 is same with the state(5) to be set 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 [2024-04-26 20:31:50.538198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1760ba0 is same with the state(5) to be set 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 [2024-04-26 20:31:50.540583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fe51000bf20 is same with the state(5) to be set 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Write completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 Read completed with error (sct=0, sc=8) 00:14:32.225 [2024-04-26 20:31:50.540785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fe51000c600 is same with the state(5) to be set 00:14:32.225 [2024-04-26 20:31:50.541512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1757910 (9): Bad file descriptor 00:14:32.225 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:32.225 20:31:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.225 20:31:50 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:32.225 20:31:50 -- target/delete_subsystem.sh@35 -- # kill -0 3985190 00:14:32.225 20:31:50 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:32.225 Initializing NVMe Controllers 00:14:32.225 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:32.225 Controller IO queue size 128, less than required. 00:14:32.225 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:32.225 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:32.225 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:32.225 Initialization complete. Launching workers. 00:14:32.225 ======================================================== 00:14:32.225 Latency(us) 00:14:32.225 Device Information : IOPS MiB/s Average min max 00:14:32.225 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 166.61 0.08 902852.93 359.93 1008976.74 00:14:32.225 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 181.53 0.09 923016.10 378.35 1012500.30 00:14:32.225 ======================================================== 00:14:32.225 Total : 348.14 0.17 913366.58 359.93 1012500.30 00:14:32.225 00:14:32.797 20:31:51 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:32.797 20:31:51 -- target/delete_subsystem.sh@35 -- # kill -0 3985190 00:14:32.797 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3985190) - No such process 00:14:32.797 20:31:51 -- target/delete_subsystem.sh@45 -- # NOT wait 3985190 00:14:32.797 20:31:51 -- common/autotest_common.sh@640 -- # local es=0 00:14:32.797 20:31:51 -- common/autotest_common.sh@642 -- # valid_exec_arg wait 3985190 00:14:32.797 20:31:51 -- common/autotest_common.sh@628 -- # local arg=wait 00:14:32.797 20:31:51 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:32.797 20:31:51 -- common/autotest_common.sh@632 -- # type -t wait 00:14:32.797 20:31:51 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:32.797 20:31:51 -- common/autotest_common.sh@643 -- # wait 3985190 00:14:32.797 20:31:51 -- common/autotest_common.sh@643 -- # es=1 00:14:32.797 20:31:51 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:14:32.797 20:31:51 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:14:32.797 20:31:51 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:14:32.797 20:31:51 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:32.797 20:31:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.797 20:31:51 -- common/autotest_common.sh@10 -- # set +x 00:14:32.797 20:31:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.797 20:31:51 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:32.797 20:31:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.797 20:31:51 -- common/autotest_common.sh@10 -- # set +x 00:14:32.797 [2024-04-26 20:31:51.071450] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:32.797 20:31:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.797 20:31:51 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:32.797 20:31:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.797 20:31:51 -- common/autotest_common.sh@10 -- # set +x 00:14:32.797 20:31:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.797 20:31:51 -- target/delete_subsystem.sh@54 -- # perf_pid=3985917 00:14:32.797 20:31:51 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:32.797 20:31:51 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:32.797 20:31:51 -- target/delete_subsystem.sh@57 -- # kill -0 3985917 00:14:32.797 20:31:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:32.797 EAL: No free 2048 kB hugepages reported on node 1 00:14:32.797 [2024-04-26 20:31:51.137879] subsystem.c:1304:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:33.369 20:31:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:33.369 20:31:51 -- target/delete_subsystem.sh@57 -- # kill -0 3985917 00:14:33.369 20:31:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:33.941 20:31:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:33.941 20:31:52 -- target/delete_subsystem.sh@57 -- # kill -0 3985917 00:14:33.941 20:31:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:34.513 20:31:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:34.513 20:31:52 -- target/delete_subsystem.sh@57 -- # kill -0 3985917 00:14:34.513 20:31:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:34.773 20:31:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:34.773 20:31:53 -- target/delete_subsystem.sh@57 -- # kill -0 3985917 00:14:34.773 20:31:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:35.344 20:31:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:35.344 20:31:53 -- target/delete_subsystem.sh@57 -- # kill -0 3985917 00:14:35.344 20:31:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:35.915 20:31:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:35.915 20:31:54 -- target/delete_subsystem.sh@57 -- # kill -0 3985917 00:14:35.915 20:31:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:36.177 Initializing NVMe Controllers 00:14:36.177 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:36.177 Controller IO queue size 128, less than required. 00:14:36.177 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:36.177 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:36.177 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:36.177 Initialization complete. Launching workers. 00:14:36.177 ======================================================== 00:14:36.177 Latency(us) 00:14:36.177 Device Information : IOPS MiB/s Average min max 00:14:36.177 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1002809.29 1000246.16 1009738.92 00:14:36.177 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004703.01 1000517.32 1012068.25 00:14:36.177 ======================================================== 00:14:36.177 Total : 256.00 0.12 1003756.15 1000246.16 1012068.25 00:14:36.177 00:14:36.437 20:31:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:36.437 20:31:54 -- target/delete_subsystem.sh@57 -- # kill -0 3985917 00:14:36.437 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3985917) - No such process 00:14:36.437 20:31:54 -- target/delete_subsystem.sh@67 -- # wait 3985917 00:14:36.437 20:31:54 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:36.437 20:31:54 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:36.437 20:31:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:36.437 20:31:54 -- nvmf/common.sh@116 -- # sync 00:14:36.437 20:31:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:36.437 20:31:54 -- nvmf/common.sh@119 -- # set +e 00:14:36.437 20:31:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:36.437 20:31:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:36.437 rmmod nvme_tcp 00:14:36.437 rmmod nvme_fabrics 00:14:36.437 rmmod nvme_keyring 00:14:36.437 20:31:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:36.437 20:31:54 -- nvmf/common.sh@123 -- # set -e 00:14:36.437 20:31:54 -- nvmf/common.sh@124 -- # return 0 00:14:36.437 20:31:54 -- nvmf/common.sh@477 -- # '[' -n 3984881 ']' 00:14:36.437 20:31:54 -- nvmf/common.sh@478 -- # killprocess 3984881 00:14:36.437 20:31:54 -- common/autotest_common.sh@926 -- # '[' -z 3984881 ']' 00:14:36.437 20:31:54 -- common/autotest_common.sh@930 -- # kill -0 3984881 00:14:36.437 20:31:54 -- common/autotest_common.sh@931 -- # uname 00:14:36.437 20:31:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:36.437 20:31:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3984881 00:14:36.437 20:31:54 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:36.437 20:31:54 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:36.437 20:31:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3984881' 00:14:36.437 killing process with pid 3984881 00:14:36.437 20:31:54 -- common/autotest_common.sh@945 -- # kill 3984881 00:14:36.437 20:31:54 -- common/autotest_common.sh@950 -- # wait 3984881 00:14:36.697 20:31:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:36.697 20:31:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:36.697 20:31:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:36.698 20:31:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:36.698 20:31:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:36.698 20:31:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:36.698 20:31:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:36.698 20:31:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:38.609 20:31:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:38.609 00:14:38.609 real 0m17.480s 00:14:38.609 user 0m30.579s 00:14:38.609 sys 0m5.931s 00:14:38.609 20:31:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:38.609 20:31:56 -- common/autotest_common.sh@10 -- # set +x 00:14:38.609 ************************************ 00:14:38.609 END TEST nvmf_delete_subsystem 00:14:38.609 ************************************ 00:14:38.871 20:31:56 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:38.871 20:31:56 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:38.871 20:31:56 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:38.871 20:31:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:38.871 20:31:56 -- common/autotest_common.sh@10 -- # set +x 00:14:38.871 ************************************ 00:14:38.871 START TEST nvmf_nvme_cli 00:14:38.871 ************************************ 00:14:38.871 20:31:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:38.871 * Looking for test storage... 00:14:38.871 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:38.871 20:31:57 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:38.871 20:31:57 -- nvmf/common.sh@7 -- # uname -s 00:14:38.871 20:31:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:38.871 20:31:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:38.871 20:31:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:38.871 20:31:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:38.871 20:31:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:38.871 20:31:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:38.871 20:31:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:38.871 20:31:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:38.871 20:31:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:38.871 20:31:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:38.871 20:31:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:38.871 20:31:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:38.871 20:31:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:38.871 20:31:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:38.871 20:31:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:38.871 20:31:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:38.871 20:31:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:38.871 20:31:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:38.871 20:31:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:38.871 20:31:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.871 20:31:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.871 20:31:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.871 20:31:57 -- paths/export.sh@5 -- # export PATH 00:14:38.871 20:31:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.871 20:31:57 -- nvmf/common.sh@46 -- # : 0 00:14:38.871 20:31:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:38.871 20:31:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:38.871 20:31:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:38.871 20:31:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:38.871 20:31:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:38.871 20:31:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:38.871 20:31:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:38.871 20:31:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:38.871 20:31:57 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:38.871 20:31:57 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:38.871 20:31:57 -- target/nvme_cli.sh@14 -- # devs=() 00:14:38.871 20:31:57 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:38.871 20:31:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:38.871 20:31:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:38.871 20:31:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:38.871 20:31:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:38.871 20:31:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:38.871 20:31:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:38.871 20:31:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:38.871 20:31:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:38.871 20:31:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:38.871 20:31:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:38.871 20:31:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:38.871 20:31:57 -- common/autotest_common.sh@10 -- # set +x 00:14:45.505 20:32:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:45.505 20:32:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:45.505 20:32:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:45.505 20:32:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:45.505 20:32:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:45.505 20:32:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:45.505 20:32:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:45.505 20:32:03 -- nvmf/common.sh@294 -- # net_devs=() 00:14:45.505 20:32:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:45.505 20:32:03 -- nvmf/common.sh@295 -- # e810=() 00:14:45.505 20:32:03 -- nvmf/common.sh@295 -- # local -ga e810 00:14:45.505 20:32:03 -- nvmf/common.sh@296 -- # x722=() 00:14:45.505 20:32:03 -- nvmf/common.sh@296 -- # local -ga x722 00:14:45.505 20:32:03 -- nvmf/common.sh@297 -- # mlx=() 00:14:45.505 20:32:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:45.505 20:32:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:45.505 20:32:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:45.505 20:32:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:45.505 20:32:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:45.505 20:32:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:45.505 20:32:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:45.505 20:32:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:45.505 20:32:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:45.505 20:32:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:45.505 20:32:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:45.505 20:32:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:45.505 20:32:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:45.505 20:32:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:45.505 20:32:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:45.505 20:32:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:45.505 20:32:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:14:45.505 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:14:45.505 20:32:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:45.505 20:32:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:14:45.505 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:14:45.505 20:32:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:45.505 20:32:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:45.505 20:32:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:45.505 20:32:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:45.505 20:32:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:45.505 20:32:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:14:45.505 Found net devices under 0000:4b:00.0: cvl_0_0 00:14:45.505 20:32:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:45.505 20:32:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:45.505 20:32:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:45.505 20:32:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:45.505 20:32:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:45.505 20:32:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:14:45.505 Found net devices under 0000:4b:00.1: cvl_0_1 00:14:45.505 20:32:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:45.505 20:32:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:45.505 20:32:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:45.505 20:32:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:45.505 20:32:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:45.505 20:32:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:45.505 20:32:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:45.505 20:32:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:45.505 20:32:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:45.505 20:32:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:45.505 20:32:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:45.505 20:32:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:45.505 20:32:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:45.505 20:32:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:45.505 20:32:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:45.505 20:32:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:45.505 20:32:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:45.505 20:32:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:45.505 20:32:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:45.505 20:32:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:45.505 20:32:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:45.505 20:32:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:45.505 20:32:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:45.505 20:32:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:45.505 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:45.505 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.546 ms 00:14:45.505 00:14:45.505 --- 10.0.0.2 ping statistics --- 00:14:45.505 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:45.505 rtt min/avg/max/mdev = 0.546/0.546/0.546/0.000 ms 00:14:45.505 20:32:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:45.505 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:45.505 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.379 ms 00:14:45.505 00:14:45.505 --- 10.0.0.1 ping statistics --- 00:14:45.505 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:45.505 rtt min/avg/max/mdev = 0.379/0.379/0.379/0.000 ms 00:14:45.505 20:32:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:45.505 20:32:03 -- nvmf/common.sh@410 -- # return 0 00:14:45.505 20:32:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:45.505 20:32:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:45.505 20:32:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:45.505 20:32:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:45.505 20:32:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:45.505 20:32:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:45.505 20:32:03 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:45.505 20:32:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:45.505 20:32:03 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:45.505 20:32:03 -- common/autotest_common.sh@10 -- # set +x 00:14:45.505 20:32:03 -- nvmf/common.sh@469 -- # nvmfpid=3990615 00:14:45.506 20:32:03 -- nvmf/common.sh@470 -- # waitforlisten 3990615 00:14:45.506 20:32:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:45.506 20:32:03 -- common/autotest_common.sh@819 -- # '[' -z 3990615 ']' 00:14:45.506 20:32:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:45.506 20:32:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:45.506 20:32:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:45.506 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:45.506 20:32:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:45.506 20:32:03 -- common/autotest_common.sh@10 -- # set +x 00:14:45.506 [2024-04-26 20:32:03.736965] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:14:45.506 [2024-04-26 20:32:03.737017] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:45.506 EAL: No free 2048 kB hugepages reported on node 1 00:14:45.506 [2024-04-26 20:32:03.804454] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:45.766 [2024-04-26 20:32:03.870304] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:45.766 [2024-04-26 20:32:03.870447] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:45.766 [2024-04-26 20:32:03.870458] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:45.766 [2024-04-26 20:32:03.870466] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:45.766 [2024-04-26 20:32:03.870598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:45.766 [2024-04-26 20:32:03.870713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:45.766 [2024-04-26 20:32:03.870838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:45.766 [2024-04-26 20:32:03.870840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:46.339 20:32:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:46.339 20:32:04 -- common/autotest_common.sh@852 -- # return 0 00:14:46.339 20:32:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:46.339 20:32:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:46.339 20:32:04 -- common/autotest_common.sh@10 -- # set +x 00:14:46.339 20:32:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:46.339 20:32:04 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:46.339 20:32:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:46.339 20:32:04 -- common/autotest_common.sh@10 -- # set +x 00:14:46.339 [2024-04-26 20:32:04.552473] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:46.339 20:32:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:46.339 20:32:04 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:46.339 20:32:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:46.339 20:32:04 -- common/autotest_common.sh@10 -- # set +x 00:14:46.339 Malloc0 00:14:46.339 20:32:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:46.339 20:32:04 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:46.339 20:32:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:46.339 20:32:04 -- common/autotest_common.sh@10 -- # set +x 00:14:46.339 Malloc1 00:14:46.339 20:32:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:46.339 20:32:04 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:46.339 20:32:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:46.339 20:32:04 -- common/autotest_common.sh@10 -- # set +x 00:14:46.339 20:32:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:46.339 20:32:04 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:46.339 20:32:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:46.339 20:32:04 -- common/autotest_common.sh@10 -- # set +x 00:14:46.340 20:32:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:46.340 20:32:04 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:46.340 20:32:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:46.340 20:32:04 -- common/autotest_common.sh@10 -- # set +x 00:14:46.340 20:32:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:46.340 20:32:04 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:46.340 20:32:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:46.340 20:32:04 -- common/autotest_common.sh@10 -- # set +x 00:14:46.340 [2024-04-26 20:32:04.634397] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:46.340 20:32:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:46.340 20:32:04 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:46.340 20:32:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:46.340 20:32:04 -- common/autotest_common.sh@10 -- # set +x 00:14:46.340 20:32:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:46.340 20:32:04 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -a 10.0.0.2 -s 4420 00:14:46.601 00:14:46.601 Discovery Log Number of Records 2, Generation counter 2 00:14:46.601 =====Discovery Log Entry 0====== 00:14:46.601 trtype: tcp 00:14:46.601 adrfam: ipv4 00:14:46.601 subtype: current discovery subsystem 00:14:46.601 treq: not required 00:14:46.601 portid: 0 00:14:46.601 trsvcid: 4420 00:14:46.601 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:46.601 traddr: 10.0.0.2 00:14:46.601 eflags: explicit discovery connections, duplicate discovery information 00:14:46.601 sectype: none 00:14:46.601 =====Discovery Log Entry 1====== 00:14:46.601 trtype: tcp 00:14:46.601 adrfam: ipv4 00:14:46.601 subtype: nvme subsystem 00:14:46.601 treq: not required 00:14:46.601 portid: 0 00:14:46.601 trsvcid: 4420 00:14:46.601 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:46.601 traddr: 10.0.0.2 00:14:46.601 eflags: none 00:14:46.601 sectype: none 00:14:46.601 20:32:04 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:46.601 20:32:04 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:46.601 20:32:04 -- nvmf/common.sh@510 -- # local dev _ 00:14:46.601 20:32:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:46.601 20:32:04 -- nvmf/common.sh@509 -- # nvme list 00:14:46.601 20:32:04 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:46.601 20:32:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:46.601 20:32:04 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:46.601 20:32:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:46.601 20:32:04 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:46.601 20:32:04 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:48.514 20:32:06 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:48.514 20:32:06 -- common/autotest_common.sh@1177 -- # local i=0 00:14:48.514 20:32:06 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:14:48.514 20:32:06 -- common/autotest_common.sh@1179 -- # [[ -n 2 ]] 00:14:48.514 20:32:06 -- common/autotest_common.sh@1180 -- # nvme_device_counter=2 00:14:48.514 20:32:06 -- common/autotest_common.sh@1184 -- # sleep 2 00:14:50.429 20:32:08 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:14:50.429 20:32:08 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:14:50.429 20:32:08 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:14:50.429 20:32:08 -- common/autotest_common.sh@1186 -- # nvme_devices=2 00:14:50.429 20:32:08 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:14:50.429 20:32:08 -- common/autotest_common.sh@1187 -- # return 0 00:14:50.429 20:32:08 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:50.429 20:32:08 -- nvmf/common.sh@510 -- # local dev _ 00:14:50.429 20:32:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:50.429 20:32:08 -- nvmf/common.sh@509 -- # nvme list 00:14:50.429 20:32:08 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:50.429 20:32:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:50.429 20:32:08 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:50.430 20:32:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:50.430 20:32:08 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:50.430 20:32:08 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:50.430 20:32:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:50.430 20:32:08 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:50.430 20:32:08 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:50.430 20:32:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:50.430 20:32:08 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:14:50.430 /dev/nvme0n1 ]] 00:14:50.430 20:32:08 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:50.430 20:32:08 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:50.430 20:32:08 -- nvmf/common.sh@510 -- # local dev _ 00:14:50.430 20:32:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:50.430 20:32:08 -- nvmf/common.sh@509 -- # nvme list 00:14:50.430 20:32:08 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:50.430 20:32:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:50.430 20:32:08 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:50.430 20:32:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:50.430 20:32:08 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:50.430 20:32:08 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:50.430 20:32:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:50.430 20:32:08 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:50.430 20:32:08 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:50.430 20:32:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:50.430 20:32:08 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:50.430 20:32:08 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:50.430 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:50.430 20:32:08 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:50.430 20:32:08 -- common/autotest_common.sh@1198 -- # local i=0 00:14:50.430 20:32:08 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:14:50.430 20:32:08 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:50.430 20:32:08 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:14:50.430 20:32:08 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:50.430 20:32:08 -- common/autotest_common.sh@1210 -- # return 0 00:14:50.430 20:32:08 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:50.430 20:32:08 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:50.430 20:32:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:50.430 20:32:08 -- common/autotest_common.sh@10 -- # set +x 00:14:50.430 20:32:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:50.430 20:32:08 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:50.430 20:32:08 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:50.430 20:32:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:50.430 20:32:08 -- nvmf/common.sh@116 -- # sync 00:14:50.430 20:32:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:50.430 20:32:08 -- nvmf/common.sh@119 -- # set +e 00:14:50.430 20:32:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:50.430 20:32:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:50.430 rmmod nvme_tcp 00:14:50.430 rmmod nvme_fabrics 00:14:50.430 rmmod nvme_keyring 00:14:50.430 20:32:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:50.430 20:32:08 -- nvmf/common.sh@123 -- # set -e 00:14:50.430 20:32:08 -- nvmf/common.sh@124 -- # return 0 00:14:50.430 20:32:08 -- nvmf/common.sh@477 -- # '[' -n 3990615 ']' 00:14:50.430 20:32:08 -- nvmf/common.sh@478 -- # killprocess 3990615 00:14:50.430 20:32:08 -- common/autotest_common.sh@926 -- # '[' -z 3990615 ']' 00:14:50.430 20:32:08 -- common/autotest_common.sh@930 -- # kill -0 3990615 00:14:50.430 20:32:08 -- common/autotest_common.sh@931 -- # uname 00:14:50.430 20:32:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:50.430 20:32:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3990615 00:14:50.430 20:32:08 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:50.430 20:32:08 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:50.430 20:32:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3990615' 00:14:50.430 killing process with pid 3990615 00:14:50.691 20:32:08 -- common/autotest_common.sh@945 -- # kill 3990615 00:14:50.691 20:32:08 -- common/autotest_common.sh@950 -- # wait 3990615 00:14:50.691 20:32:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:50.691 20:32:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:50.691 20:32:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:50.691 20:32:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:50.691 20:32:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:50.691 20:32:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:50.691 20:32:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:50.691 20:32:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:53.236 20:32:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:53.236 00:14:53.236 real 0m14.013s 00:14:53.236 user 0m22.034s 00:14:53.236 sys 0m5.417s 00:14:53.236 20:32:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:53.236 20:32:11 -- common/autotest_common.sh@10 -- # set +x 00:14:53.236 ************************************ 00:14:53.236 END TEST nvmf_nvme_cli 00:14:53.236 ************************************ 00:14:53.236 20:32:11 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:53.236 20:32:11 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:53.236 20:32:11 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:53.236 20:32:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:53.236 20:32:11 -- common/autotest_common.sh@10 -- # set +x 00:14:53.236 ************************************ 00:14:53.236 START TEST nvmf_host_management 00:14:53.236 ************************************ 00:14:53.236 20:32:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:53.236 * Looking for test storage... 00:14:53.236 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:53.236 20:32:11 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:53.236 20:32:11 -- nvmf/common.sh@7 -- # uname -s 00:14:53.236 20:32:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:53.236 20:32:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:53.236 20:32:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:53.236 20:32:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:53.236 20:32:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:53.236 20:32:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:53.236 20:32:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:53.237 20:32:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:53.237 20:32:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:53.237 20:32:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:53.237 20:32:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:53.237 20:32:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:53.237 20:32:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:53.237 20:32:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:53.237 20:32:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:53.237 20:32:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:53.237 20:32:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:53.237 20:32:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:53.237 20:32:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:53.237 20:32:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:53.237 20:32:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:53.237 20:32:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:53.237 20:32:11 -- paths/export.sh@5 -- # export PATH 00:14:53.237 20:32:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:53.237 20:32:11 -- nvmf/common.sh@46 -- # : 0 00:14:53.237 20:32:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:53.237 20:32:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:53.237 20:32:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:53.237 20:32:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:53.237 20:32:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:53.237 20:32:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:53.237 20:32:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:53.237 20:32:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:53.237 20:32:11 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:53.237 20:32:11 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:53.237 20:32:11 -- target/host_management.sh@104 -- # nvmftestinit 00:14:53.237 20:32:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:53.237 20:32:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:53.237 20:32:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:53.237 20:32:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:53.237 20:32:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:53.237 20:32:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:53.237 20:32:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:53.237 20:32:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:53.237 20:32:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:53.237 20:32:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:53.237 20:32:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:53.237 20:32:11 -- common/autotest_common.sh@10 -- # set +x 00:14:59.843 20:32:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:59.843 20:32:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:59.843 20:32:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:59.843 20:32:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:59.843 20:32:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:59.843 20:32:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:59.843 20:32:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:59.843 20:32:17 -- nvmf/common.sh@294 -- # net_devs=() 00:14:59.843 20:32:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:59.843 20:32:17 -- nvmf/common.sh@295 -- # e810=() 00:14:59.843 20:32:17 -- nvmf/common.sh@295 -- # local -ga e810 00:14:59.843 20:32:17 -- nvmf/common.sh@296 -- # x722=() 00:14:59.843 20:32:17 -- nvmf/common.sh@296 -- # local -ga x722 00:14:59.843 20:32:17 -- nvmf/common.sh@297 -- # mlx=() 00:14:59.843 20:32:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:59.843 20:32:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:59.843 20:32:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:59.843 20:32:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:59.843 20:32:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:59.843 20:32:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:59.843 20:32:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:59.843 20:32:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:59.843 20:32:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:59.843 20:32:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:59.843 20:32:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:59.843 20:32:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:59.843 20:32:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:59.843 20:32:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:59.843 20:32:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:59.843 20:32:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:59.843 20:32:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:14:59.843 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:14:59.843 20:32:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:59.843 20:32:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:14:59.843 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:14:59.843 20:32:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:59.843 20:32:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:59.843 20:32:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:59.843 20:32:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:59.843 20:32:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:59.843 20:32:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:14:59.843 Found net devices under 0000:4b:00.0: cvl_0_0 00:14:59.843 20:32:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:59.843 20:32:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:59.843 20:32:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:59.843 20:32:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:59.843 20:32:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:59.843 20:32:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:14:59.843 Found net devices under 0000:4b:00.1: cvl_0_1 00:14:59.843 20:32:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:59.843 20:32:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:59.843 20:32:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:59.843 20:32:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:59.843 20:32:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:59.843 20:32:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:59.843 20:32:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:59.843 20:32:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:59.843 20:32:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:59.843 20:32:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:59.843 20:32:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:59.843 20:32:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:59.843 20:32:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:59.843 20:32:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:59.843 20:32:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:59.843 20:32:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:59.843 20:32:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:59.843 20:32:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:59.843 20:32:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:59.843 20:32:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:59.843 20:32:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:59.843 20:32:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:00.105 20:32:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:00.105 20:32:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:00.105 20:32:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:00.105 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:00.105 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.417 ms 00:15:00.105 00:15:00.105 --- 10.0.0.2 ping statistics --- 00:15:00.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:00.105 rtt min/avg/max/mdev = 0.417/0.417/0.417/0.000 ms 00:15:00.105 20:32:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:00.105 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:00.105 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.402 ms 00:15:00.105 00:15:00.105 --- 10.0.0.1 ping statistics --- 00:15:00.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:00.105 rtt min/avg/max/mdev = 0.402/0.402/0.402/0.000 ms 00:15:00.105 20:32:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:00.105 20:32:18 -- nvmf/common.sh@410 -- # return 0 00:15:00.105 20:32:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:00.105 20:32:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:00.105 20:32:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:00.105 20:32:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:00.105 20:32:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:00.105 20:32:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:00.105 20:32:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:00.105 20:32:18 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:15:00.105 20:32:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:15:00.105 20:32:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:00.105 20:32:18 -- common/autotest_common.sh@10 -- # set +x 00:15:00.106 ************************************ 00:15:00.106 START TEST nvmf_host_management 00:15:00.106 ************************************ 00:15:00.106 20:32:18 -- common/autotest_common.sh@1104 -- # nvmf_host_management 00:15:00.106 20:32:18 -- target/host_management.sh@69 -- # starttarget 00:15:00.106 20:32:18 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:15:00.106 20:32:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:00.106 20:32:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:00.106 20:32:18 -- common/autotest_common.sh@10 -- # set +x 00:15:00.106 20:32:18 -- nvmf/common.sh@469 -- # nvmfpid=3995919 00:15:00.106 20:32:18 -- nvmf/common.sh@470 -- # waitforlisten 3995919 00:15:00.106 20:32:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:15:00.106 20:32:18 -- common/autotest_common.sh@819 -- # '[' -z 3995919 ']' 00:15:00.106 20:32:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:00.106 20:32:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:00.106 20:32:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:00.106 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:00.106 20:32:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:00.106 20:32:18 -- common/autotest_common.sh@10 -- # set +x 00:15:00.106 [2024-04-26 20:32:18.413035] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:15:00.106 [2024-04-26 20:32:18.413100] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:00.106 EAL: No free 2048 kB hugepages reported on node 1 00:15:00.367 [2024-04-26 20:32:18.483757] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:00.367 [2024-04-26 20:32:18.556525] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:00.367 [2024-04-26 20:32:18.556661] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:00.367 [2024-04-26 20:32:18.556672] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:00.367 [2024-04-26 20:32:18.556681] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:00.367 [2024-04-26 20:32:18.556801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:00.367 [2024-04-26 20:32:18.556926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:00.367 [2024-04-26 20:32:18.557083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:00.367 [2024-04-26 20:32:18.557084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:00.939 20:32:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:00.939 20:32:19 -- common/autotest_common.sh@852 -- # return 0 00:15:00.939 20:32:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:00.939 20:32:19 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:00.939 20:32:19 -- common/autotest_common.sh@10 -- # set +x 00:15:00.939 20:32:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:00.939 20:32:19 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:00.939 20:32:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:00.939 20:32:19 -- common/autotest_common.sh@10 -- # set +x 00:15:00.939 [2024-04-26 20:32:19.240515] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:00.939 20:32:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:00.939 20:32:19 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:15:00.939 20:32:19 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:00.939 20:32:19 -- common/autotest_common.sh@10 -- # set +x 00:15:00.939 20:32:19 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:15:00.939 20:32:19 -- target/host_management.sh@23 -- # cat 00:15:00.939 20:32:19 -- target/host_management.sh@30 -- # rpc_cmd 00:15:00.939 20:32:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:00.939 20:32:19 -- common/autotest_common.sh@10 -- # set +x 00:15:00.939 Malloc0 00:15:01.200 [2024-04-26 20:32:19.299787] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:01.200 20:32:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:01.200 20:32:19 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:15:01.200 20:32:19 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:01.200 20:32:19 -- common/autotest_common.sh@10 -- # set +x 00:15:01.200 20:32:19 -- target/host_management.sh@73 -- # perfpid=3996068 00:15:01.200 20:32:19 -- target/host_management.sh@74 -- # waitforlisten 3996068 /var/tmp/bdevperf.sock 00:15:01.200 20:32:19 -- common/autotest_common.sh@819 -- # '[' -z 3996068 ']' 00:15:01.200 20:32:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:01.200 20:32:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:01.200 20:32:19 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:15:01.200 20:32:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:01.200 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:01.201 20:32:19 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:15:01.201 20:32:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:01.201 20:32:19 -- common/autotest_common.sh@10 -- # set +x 00:15:01.201 20:32:19 -- nvmf/common.sh@520 -- # config=() 00:15:01.201 20:32:19 -- nvmf/common.sh@520 -- # local subsystem config 00:15:01.201 20:32:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:01.201 20:32:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:01.201 { 00:15:01.201 "params": { 00:15:01.201 "name": "Nvme$subsystem", 00:15:01.201 "trtype": "$TEST_TRANSPORT", 00:15:01.201 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:01.201 "adrfam": "ipv4", 00:15:01.201 "trsvcid": "$NVMF_PORT", 00:15:01.201 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:01.201 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:01.201 "hdgst": ${hdgst:-false}, 00:15:01.201 "ddgst": ${ddgst:-false} 00:15:01.201 }, 00:15:01.201 "method": "bdev_nvme_attach_controller" 00:15:01.201 } 00:15:01.201 EOF 00:15:01.201 )") 00:15:01.201 20:32:19 -- nvmf/common.sh@542 -- # cat 00:15:01.201 20:32:19 -- nvmf/common.sh@544 -- # jq . 00:15:01.201 20:32:19 -- nvmf/common.sh@545 -- # IFS=, 00:15:01.201 20:32:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:01.201 "params": { 00:15:01.201 "name": "Nvme0", 00:15:01.201 "trtype": "tcp", 00:15:01.201 "traddr": "10.0.0.2", 00:15:01.201 "adrfam": "ipv4", 00:15:01.201 "trsvcid": "4420", 00:15:01.201 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:01.201 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:15:01.201 "hdgst": false, 00:15:01.201 "ddgst": false 00:15:01.201 }, 00:15:01.201 "method": "bdev_nvme_attach_controller" 00:15:01.201 }' 00:15:01.201 [2024-04-26 20:32:19.394537] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:15:01.201 [2024-04-26 20:32:19.394589] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3996068 ] 00:15:01.201 EAL: No free 2048 kB hugepages reported on node 1 00:15:01.201 [2024-04-26 20:32:19.453395] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:01.201 [2024-04-26 20:32:19.516092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:01.462 Running I/O for 10 seconds... 00:15:02.037 20:32:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:02.037 20:32:20 -- common/autotest_common.sh@852 -- # return 0 00:15:02.037 20:32:20 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:15:02.037 20:32:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:02.037 20:32:20 -- common/autotest_common.sh@10 -- # set +x 00:15:02.037 20:32:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:02.037 20:32:20 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:02.037 20:32:20 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:15:02.037 20:32:20 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:15:02.037 20:32:20 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:15:02.037 20:32:20 -- target/host_management.sh@52 -- # local ret=1 00:15:02.037 20:32:20 -- target/host_management.sh@53 -- # local i 00:15:02.037 20:32:20 -- target/host_management.sh@54 -- # (( i = 10 )) 00:15:02.037 20:32:20 -- target/host_management.sh@54 -- # (( i != 0 )) 00:15:02.037 20:32:20 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:15:02.037 20:32:20 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:15:02.037 20:32:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:02.037 20:32:20 -- common/autotest_common.sh@10 -- # set +x 00:15:02.037 20:32:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:02.037 20:32:20 -- target/host_management.sh@55 -- # read_io_count=820 00:15:02.037 20:32:20 -- target/host_management.sh@58 -- # '[' 820 -ge 100 ']' 00:15:02.037 20:32:20 -- target/host_management.sh@59 -- # ret=0 00:15:02.037 20:32:20 -- target/host_management.sh@60 -- # break 00:15:02.037 20:32:20 -- target/host_management.sh@64 -- # return 0 00:15:02.037 20:32:20 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:15:02.037 20:32:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:02.037 20:32:20 -- common/autotest_common.sh@10 -- # set +x 00:15:02.037 [2024-04-26 20:32:20.242906] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.037 [2024-04-26 20:32:20.242948] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.242956] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.242963] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.242969] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.242976] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.242983] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.242989] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.242995] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243002] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243008] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243014] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243021] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243027] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243042] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243050] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243056] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243062] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243069] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243075] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243081] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243088] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243095] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243101] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243107] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243113] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243120] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243126] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243133] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243139] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243146] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243152] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243158] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243165] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243171] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243177] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243184] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243191] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243197] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243204] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243211] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243226] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243232] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243239] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243252] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243258] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243265] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243271] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243283] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243290] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243296] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243303] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243309] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243316] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243322] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243328] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243335] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243341] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243347] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243354] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.243360] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1332540 is same with the state(5) to be set 00:15:02.038 [2024-04-26 20:32:20.244889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:118784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.038 [2024-04-26 20:32:20.244927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.038 [2024-04-26 20:32:20.244945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:118912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.038 [2024-04-26 20:32:20.244953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.038 [2024-04-26 20:32:20.244962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:119040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.038 [2024-04-26 20:32:20.244974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.038 [2024-04-26 20:32:20.244984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:119168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.038 [2024-04-26 20:32:20.244991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.038 [2024-04-26 20:32:20.245000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:119296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.038 [2024-04-26 20:32:20.245007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.038 [2024-04-26 20:32:20.245016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:119424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.038 [2024-04-26 20:32:20.245024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.038 [2024-04-26 20:32:20.245033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:119552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.038 [2024-04-26 20:32:20.245040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.038 [2024-04-26 20:32:20.245049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:119680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.038 [2024-04-26 20:32:20.245057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.038 [2024-04-26 20:32:20.245066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:119808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.038 [2024-04-26 20:32:20.245073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.038 [2024-04-26 20:32:20.245082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:119936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.038 [2024-04-26 20:32:20.245089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.038 [2024-04-26 20:32:20.245099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:113792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.038 [2024-04-26 20:32:20.245106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.038 [2024-04-26 20:32:20.245115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:114304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:114560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:120064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:120192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:120320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:120448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:120576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:114944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:120704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:115328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:115456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:120832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:120960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:121088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:115584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:121216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:115968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:121344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:121472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:116224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:121600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:121728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:121856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:121984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:116352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:116480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:122112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:116608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:116736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:122240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:122368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:117632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:117760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:122496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:122624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:118400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:118528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:122752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.039 [2024-04-26 20:32:20.245745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:122880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.039 [2024-04-26 20:32:20.245752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:118656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:123008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:123136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:123264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:123392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:123520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:123648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:123776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:123904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:124032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:124160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:124288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:124416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.245972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:124544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:02.040 [2024-04-26 20:32:20.245980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.246032] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x19b2370 was disconnected and freed. reset controller. 00:15:02.040 [2024-04-26 20:32:20.247220] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:15:02.040 20:32:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:02.040 20:32:20 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:15:02.040 20:32:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:02.040 20:32:20 -- common/autotest_common.sh@10 -- # set +x 00:15:02.040 task offset: 118784 on job bdev=Nvme0n1 fails 00:15:02.040 00:15:02.040 Latency(us) 00:15:02.040 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:02.040 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:15:02.040 Job: Nvme0n1 ended in about 0.47 seconds with error 00:15:02.040 Verification LBA range: start 0x0 length 0x400 00:15:02.040 Nvme0n1 : 0.47 1941.14 121.32 136.52 0.00 30360.53 6580.91 37573.97 00:15:02.040 =================================================================================================================== 00:15:02.040 Total : 1941.14 121.32 136.52 0.00 30360.53 6580.91 37573.97 00:15:02.040 [2024-04-26 20:32:20.249229] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:15:02.040 [2024-04-26 20:32:20.249253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19b49c0 (9): Bad file descriptor 00:15:02.040 [2024-04-26 20:32:20.252580] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode0' does not allow host 'nqn.2016-06.io.spdk:host0' 00:15:02.040 [2024-04-26 20:32:20.252703] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:15:02.040 [2024-04-26 20:32:20.252727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND SPECIFIC (01/84) qid:0 cid:3 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:02.040 [2024-04-26 20:32:20.252742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode0 00:15:02.040 [2024-04-26 20:32:20.252750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 132 00:15:02.040 [2024-04-26 20:32:20.252758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:15:02.040 [2024-04-26 20:32:20.252765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x19b49c0 00:15:02.040 [2024-04-26 20:32:20.252784] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19b49c0 (9): Bad file descriptor 00:15:02.040 [2024-04-26 20:32:20.252797] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:15:02.040 [2024-04-26 20:32:20.252805] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:15:02.040 [2024-04-26 20:32:20.252813] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:15:02.040 [2024-04-26 20:32:20.252825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:02.040 20:32:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:02.040 20:32:20 -- target/host_management.sh@87 -- # sleep 1 00:15:02.982 20:32:21 -- target/host_management.sh@91 -- # kill -9 3996068 00:15:02.982 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3996068) - No such process 00:15:02.982 20:32:21 -- target/host_management.sh@91 -- # true 00:15:02.982 20:32:21 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:15:02.982 20:32:21 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:15:02.982 20:32:21 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:15:02.982 20:32:21 -- nvmf/common.sh@520 -- # config=() 00:15:02.982 20:32:21 -- nvmf/common.sh@520 -- # local subsystem config 00:15:02.982 20:32:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:02.982 20:32:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:02.982 { 00:15:02.982 "params": { 00:15:02.982 "name": "Nvme$subsystem", 00:15:02.982 "trtype": "$TEST_TRANSPORT", 00:15:02.982 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:02.982 "adrfam": "ipv4", 00:15:02.982 "trsvcid": "$NVMF_PORT", 00:15:02.982 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:02.982 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:02.982 "hdgst": ${hdgst:-false}, 00:15:02.982 "ddgst": ${ddgst:-false} 00:15:02.982 }, 00:15:02.982 "method": "bdev_nvme_attach_controller" 00:15:02.982 } 00:15:02.982 EOF 00:15:02.982 )") 00:15:02.982 20:32:21 -- nvmf/common.sh@542 -- # cat 00:15:02.982 20:32:21 -- nvmf/common.sh@544 -- # jq . 00:15:02.982 20:32:21 -- nvmf/common.sh@545 -- # IFS=, 00:15:02.982 20:32:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:02.982 "params": { 00:15:02.982 "name": "Nvme0", 00:15:02.982 "trtype": "tcp", 00:15:02.982 "traddr": "10.0.0.2", 00:15:02.982 "adrfam": "ipv4", 00:15:02.982 "trsvcid": "4420", 00:15:02.982 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:02.982 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:15:02.982 "hdgst": false, 00:15:02.982 "ddgst": false 00:15:02.982 }, 00:15:02.982 "method": "bdev_nvme_attach_controller" 00:15:02.982 }' 00:15:02.982 [2024-04-26 20:32:21.312598] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:15:02.982 [2024-04-26 20:32:21.312652] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3996424 ] 00:15:03.243 EAL: No free 2048 kB hugepages reported on node 1 00:15:03.243 [2024-04-26 20:32:21.371336] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:03.243 [2024-04-26 20:32:21.432274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:03.504 Running I/O for 1 seconds... 00:15:04.447 00:15:04.447 Latency(us) 00:15:04.447 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:04.447 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:15:04.447 Verification LBA range: start 0x0 length 0x400 00:15:04.447 Nvme0n1 : 1.01 2557.51 159.84 0.00 0.00 24667.76 2471.25 40195.41 00:15:04.447 =================================================================================================================== 00:15:04.447 Total : 2557.51 159.84 0.00 0.00 24667.76 2471.25 40195.41 00:15:04.447 20:32:22 -- target/host_management.sh@101 -- # stoptarget 00:15:04.447 20:32:22 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:15:04.447 20:32:22 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:15:04.447 20:32:22 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:15:04.447 20:32:22 -- target/host_management.sh@40 -- # nvmftestfini 00:15:04.447 20:32:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:04.447 20:32:22 -- nvmf/common.sh@116 -- # sync 00:15:04.447 20:32:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:04.447 20:32:22 -- nvmf/common.sh@119 -- # set +e 00:15:04.447 20:32:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:04.447 20:32:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:04.447 rmmod nvme_tcp 00:15:04.709 rmmod nvme_fabrics 00:15:04.709 rmmod nvme_keyring 00:15:04.709 20:32:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:04.709 20:32:22 -- nvmf/common.sh@123 -- # set -e 00:15:04.709 20:32:22 -- nvmf/common.sh@124 -- # return 0 00:15:04.709 20:32:22 -- nvmf/common.sh@477 -- # '[' -n 3995919 ']' 00:15:04.709 20:32:22 -- nvmf/common.sh@478 -- # killprocess 3995919 00:15:04.709 20:32:22 -- common/autotest_common.sh@926 -- # '[' -z 3995919 ']' 00:15:04.709 20:32:22 -- common/autotest_common.sh@930 -- # kill -0 3995919 00:15:04.709 20:32:22 -- common/autotest_common.sh@931 -- # uname 00:15:04.709 20:32:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:04.709 20:32:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 3995919 00:15:04.709 20:32:22 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:04.709 20:32:22 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:04.709 20:32:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 3995919' 00:15:04.709 killing process with pid 3995919 00:15:04.709 20:32:22 -- common/autotest_common.sh@945 -- # kill 3995919 00:15:04.709 20:32:22 -- common/autotest_common.sh@950 -- # wait 3995919 00:15:04.709 [2024-04-26 20:32:22.993689] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:15:04.709 20:32:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:04.709 20:32:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:04.709 20:32:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:04.709 20:32:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:04.709 20:32:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:04.709 20:32:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:04.709 20:32:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:04.709 20:32:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:07.255 20:32:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:07.255 00:15:07.255 real 0m6.734s 00:15:07.255 user 0m20.157s 00:15:07.255 sys 0m1.053s 00:15:07.256 20:32:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:07.256 20:32:25 -- common/autotest_common.sh@10 -- # set +x 00:15:07.256 ************************************ 00:15:07.256 END TEST nvmf_host_management 00:15:07.256 ************************************ 00:15:07.256 20:32:25 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:15:07.256 00:15:07.256 real 0m14.080s 00:15:07.256 user 0m22.161s 00:15:07.256 sys 0m6.341s 00:15:07.256 20:32:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:07.256 20:32:25 -- common/autotest_common.sh@10 -- # set +x 00:15:07.256 ************************************ 00:15:07.256 END TEST nvmf_host_management 00:15:07.256 ************************************ 00:15:07.256 20:32:25 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:15:07.256 20:32:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:07.256 20:32:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:07.256 20:32:25 -- common/autotest_common.sh@10 -- # set +x 00:15:07.256 ************************************ 00:15:07.256 START TEST nvmf_lvol 00:15:07.256 ************************************ 00:15:07.256 20:32:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:15:07.256 * Looking for test storage... 00:15:07.256 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:07.256 20:32:25 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:07.256 20:32:25 -- nvmf/common.sh@7 -- # uname -s 00:15:07.256 20:32:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:07.256 20:32:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:07.256 20:32:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:07.256 20:32:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:07.256 20:32:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:07.256 20:32:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:07.256 20:32:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:07.256 20:32:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:07.256 20:32:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:07.256 20:32:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:07.256 20:32:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:07.256 20:32:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:07.256 20:32:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:07.256 20:32:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:07.256 20:32:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:07.256 20:32:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:07.256 20:32:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:07.256 20:32:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:07.256 20:32:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:07.256 20:32:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:07.256 20:32:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:07.256 20:32:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:07.256 20:32:25 -- paths/export.sh@5 -- # export PATH 00:15:07.256 20:32:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:07.256 20:32:25 -- nvmf/common.sh@46 -- # : 0 00:15:07.256 20:32:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:07.256 20:32:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:07.256 20:32:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:07.256 20:32:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:07.256 20:32:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:07.256 20:32:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:07.256 20:32:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:07.256 20:32:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:07.256 20:32:25 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:07.256 20:32:25 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:07.256 20:32:25 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:15:07.256 20:32:25 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:15:07.256 20:32:25 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:07.256 20:32:25 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:15:07.256 20:32:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:07.256 20:32:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:07.256 20:32:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:07.256 20:32:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:07.256 20:32:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:07.256 20:32:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:07.256 20:32:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:07.256 20:32:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:07.256 20:32:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:07.256 20:32:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:07.256 20:32:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:07.256 20:32:25 -- common/autotest_common.sh@10 -- # set +x 00:15:13.849 20:32:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:13.849 20:32:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:13.849 20:32:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:13.849 20:32:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:13.849 20:32:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:13.849 20:32:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:13.849 20:32:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:13.849 20:32:31 -- nvmf/common.sh@294 -- # net_devs=() 00:15:13.849 20:32:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:13.849 20:32:31 -- nvmf/common.sh@295 -- # e810=() 00:15:13.849 20:32:31 -- nvmf/common.sh@295 -- # local -ga e810 00:15:13.849 20:32:31 -- nvmf/common.sh@296 -- # x722=() 00:15:13.849 20:32:31 -- nvmf/common.sh@296 -- # local -ga x722 00:15:13.849 20:32:31 -- nvmf/common.sh@297 -- # mlx=() 00:15:13.849 20:32:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:13.849 20:32:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:13.849 20:32:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:13.849 20:32:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:13.849 20:32:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:13.849 20:32:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:13.849 20:32:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:13.849 20:32:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:13.849 20:32:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:13.849 20:32:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:13.849 20:32:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:13.849 20:32:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:13.849 20:32:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:13.849 20:32:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:13.849 20:32:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:13.849 20:32:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:13.849 20:32:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:15:13.849 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:15:13.849 20:32:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:13.849 20:32:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:15:13.849 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:15:13.849 20:32:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:13.849 20:32:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:13.849 20:32:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:13.849 20:32:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:13.849 20:32:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:13.849 20:32:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:15:13.849 Found net devices under 0000:4b:00.0: cvl_0_0 00:15:13.849 20:32:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:13.849 20:32:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:13.849 20:32:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:13.849 20:32:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:13.849 20:32:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:13.849 20:32:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:15:13.849 Found net devices under 0000:4b:00.1: cvl_0_1 00:15:13.849 20:32:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:13.849 20:32:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:13.849 20:32:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:13.849 20:32:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:13.849 20:32:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:13.849 20:32:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:13.849 20:32:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:13.849 20:32:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:13.849 20:32:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:13.849 20:32:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:13.849 20:32:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:13.849 20:32:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:13.849 20:32:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:13.849 20:32:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:13.849 20:32:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:13.849 20:32:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:13.849 20:32:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:13.849 20:32:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:13.849 20:32:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:13.849 20:32:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:13.849 20:32:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:13.849 20:32:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:14.110 20:32:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:14.110 20:32:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:14.110 20:32:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:14.110 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:14.110 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.388 ms 00:15:14.110 00:15:14.110 --- 10.0.0.2 ping statistics --- 00:15:14.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:14.110 rtt min/avg/max/mdev = 0.388/0.388/0.388/0.000 ms 00:15:14.110 20:32:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:14.110 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:14.110 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.491 ms 00:15:14.110 00:15:14.110 --- 10.0.0.1 ping statistics --- 00:15:14.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:14.110 rtt min/avg/max/mdev = 0.491/0.491/0.491/0.000 ms 00:15:14.110 20:32:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:14.110 20:32:32 -- nvmf/common.sh@410 -- # return 0 00:15:14.110 20:32:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:14.110 20:32:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:14.110 20:32:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:14.110 20:32:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:14.110 20:32:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:14.110 20:32:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:14.110 20:32:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:14.110 20:32:32 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:15:14.110 20:32:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:14.110 20:32:32 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:14.110 20:32:32 -- common/autotest_common.sh@10 -- # set +x 00:15:14.110 20:32:32 -- nvmf/common.sh@469 -- # nvmfpid=4001013 00:15:14.110 20:32:32 -- nvmf/common.sh@470 -- # waitforlisten 4001013 00:15:14.110 20:32:32 -- common/autotest_common.sh@819 -- # '[' -z 4001013 ']' 00:15:14.110 20:32:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:14.110 20:32:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:14.110 20:32:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:14.110 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:14.110 20:32:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:14.110 20:32:32 -- common/autotest_common.sh@10 -- # set +x 00:15:14.110 20:32:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:15:14.110 [2024-04-26 20:32:32.332700] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:15:14.110 [2024-04-26 20:32:32.332764] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:14.110 EAL: No free 2048 kB hugepages reported on node 1 00:15:14.110 [2024-04-26 20:32:32.403929] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:14.369 [2024-04-26 20:32:32.479245] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:14.369 [2024-04-26 20:32:32.479375] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:14.369 [2024-04-26 20:32:32.479384] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:14.369 [2024-04-26 20:32:32.479396] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:14.369 [2024-04-26 20:32:32.479548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:14.369 [2024-04-26 20:32:32.479687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:14.369 [2024-04-26 20:32:32.479690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:14.938 20:32:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:14.938 20:32:33 -- common/autotest_common.sh@852 -- # return 0 00:15:14.938 20:32:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:14.938 20:32:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:14.938 20:32:33 -- common/autotest_common.sh@10 -- # set +x 00:15:14.938 20:32:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:14.938 20:32:33 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:15:14.938 [2024-04-26 20:32:33.268888] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:15.199 20:32:33 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:15.199 20:32:33 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:15:15.199 20:32:33 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:15.459 20:32:33 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:15:15.460 20:32:33 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:15:15.460 20:32:33 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:15:15.721 20:32:33 -- target/nvmf_lvol.sh@29 -- # lvs=14879659-17f5-4186-8c76-c9bd2fc82bcb 00:15:15.721 20:32:33 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 14879659-17f5-4186-8c76-c9bd2fc82bcb lvol 20 00:15:15.982 20:32:34 -- target/nvmf_lvol.sh@32 -- # lvol=3362a035-bd76-4263-b05c-046c866dc6c4 00:15:15.982 20:32:34 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:15.982 20:32:34 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 3362a035-bd76-4263-b05c-046c866dc6c4 00:15:16.243 20:32:34 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:16.504 [2024-04-26 20:32:34.589810] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:16.504 20:32:34 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:16.504 20:32:34 -- target/nvmf_lvol.sh@42 -- # perf_pid=4001506 00:15:16.504 20:32:34 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:15:16.504 20:32:34 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:15:16.504 EAL: No free 2048 kB hugepages reported on node 1 00:15:17.891 20:32:35 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 3362a035-bd76-4263-b05c-046c866dc6c4 MY_SNAPSHOT 00:15:17.891 20:32:35 -- target/nvmf_lvol.sh@47 -- # snapshot=75e93340-db6c-469e-ad08-b86f6bfb8c83 00:15:17.891 20:32:35 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 3362a035-bd76-4263-b05c-046c866dc6c4 30 00:15:17.891 20:32:36 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 75e93340-db6c-469e-ad08-b86f6bfb8c83 MY_CLONE 00:15:18.152 20:32:36 -- target/nvmf_lvol.sh@49 -- # clone=24545ff2-d85c-4759-8b19-a66a79bda7bf 00:15:18.152 20:32:36 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 24545ff2-d85c-4759-8b19-a66a79bda7bf 00:15:18.412 20:32:36 -- target/nvmf_lvol.sh@53 -- # wait 4001506 00:15:28.494 Initializing NVMe Controllers 00:15:28.494 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:15:28.494 Controller IO queue size 128, less than required. 00:15:28.494 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:28.494 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:15:28.494 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:15:28.494 Initialization complete. Launching workers. 00:15:28.494 ======================================================== 00:15:28.494 Latency(us) 00:15:28.494 Device Information : IOPS MiB/s Average min max 00:15:28.494 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 12113.14 47.32 10571.65 1491.84 47381.69 00:15:28.494 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 12514.14 48.88 10233.32 3754.25 59182.22 00:15:28.494 ======================================================== 00:15:28.494 Total : 24627.28 96.20 10399.73 1491.84 59182.22 00:15:28.494 00:15:28.494 20:32:45 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:28.494 20:32:45 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 3362a035-bd76-4263-b05c-046c866dc6c4 00:15:28.494 20:32:45 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 14879659-17f5-4186-8c76-c9bd2fc82bcb 00:15:28.494 20:32:45 -- target/nvmf_lvol.sh@60 -- # rm -f 00:15:28.494 20:32:45 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:15:28.494 20:32:45 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:15:28.494 20:32:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:28.494 20:32:45 -- nvmf/common.sh@116 -- # sync 00:15:28.494 20:32:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:28.494 20:32:45 -- nvmf/common.sh@119 -- # set +e 00:15:28.494 20:32:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:28.494 20:32:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:28.494 rmmod nvme_tcp 00:15:28.494 rmmod nvme_fabrics 00:15:28.494 rmmod nvme_keyring 00:15:28.494 20:32:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:28.494 20:32:45 -- nvmf/common.sh@123 -- # set -e 00:15:28.495 20:32:45 -- nvmf/common.sh@124 -- # return 0 00:15:28.495 20:32:45 -- nvmf/common.sh@477 -- # '[' -n 4001013 ']' 00:15:28.495 20:32:45 -- nvmf/common.sh@478 -- # killprocess 4001013 00:15:28.495 20:32:45 -- common/autotest_common.sh@926 -- # '[' -z 4001013 ']' 00:15:28.495 20:32:45 -- common/autotest_common.sh@930 -- # kill -0 4001013 00:15:28.495 20:32:45 -- common/autotest_common.sh@931 -- # uname 00:15:28.495 20:32:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:28.495 20:32:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4001013 00:15:28.495 20:32:45 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:28.495 20:32:45 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:28.495 20:32:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4001013' 00:15:28.495 killing process with pid 4001013 00:15:28.495 20:32:45 -- common/autotest_common.sh@945 -- # kill 4001013 00:15:28.495 20:32:45 -- common/autotest_common.sh@950 -- # wait 4001013 00:15:28.495 20:32:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:28.495 20:32:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:28.495 20:32:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:28.495 20:32:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:28.495 20:32:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:28.495 20:32:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:28.495 20:32:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:28.495 20:32:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:29.884 20:32:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:29.884 00:15:29.884 real 0m22.760s 00:15:29.884 user 1m2.981s 00:15:29.884 sys 0m7.531s 00:15:29.884 20:32:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:29.884 20:32:47 -- common/autotest_common.sh@10 -- # set +x 00:15:29.884 ************************************ 00:15:29.884 END TEST nvmf_lvol 00:15:29.884 ************************************ 00:15:29.884 20:32:47 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:15:29.884 20:32:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:29.884 20:32:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:29.884 20:32:47 -- common/autotest_common.sh@10 -- # set +x 00:15:29.884 ************************************ 00:15:29.884 START TEST nvmf_lvs_grow 00:15:29.884 ************************************ 00:15:29.884 20:32:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:15:29.884 * Looking for test storage... 00:15:29.884 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:29.884 20:32:48 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:29.884 20:32:48 -- nvmf/common.sh@7 -- # uname -s 00:15:29.884 20:32:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:29.884 20:32:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:29.884 20:32:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:29.884 20:32:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:29.884 20:32:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:29.884 20:32:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:29.884 20:32:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:29.884 20:32:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:29.884 20:32:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:29.884 20:32:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:29.884 20:32:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:29.884 20:32:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:29.884 20:32:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:29.884 20:32:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:29.884 20:32:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:29.884 20:32:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:29.884 20:32:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:29.884 20:32:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:29.884 20:32:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:29.885 20:32:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.885 20:32:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.885 20:32:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.885 20:32:48 -- paths/export.sh@5 -- # export PATH 00:15:29.885 20:32:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:29.885 20:32:48 -- nvmf/common.sh@46 -- # : 0 00:15:29.885 20:32:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:29.885 20:32:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:29.885 20:32:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:29.885 20:32:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:29.885 20:32:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:29.885 20:32:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:29.885 20:32:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:29.885 20:32:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:29.885 20:32:48 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:29.885 20:32:48 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:29.885 20:32:48 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:15:29.885 20:32:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:29.885 20:32:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:29.885 20:32:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:29.885 20:32:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:29.885 20:32:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:29.885 20:32:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:29.885 20:32:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:29.885 20:32:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:29.885 20:32:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:29.885 20:32:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:29.885 20:32:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:29.885 20:32:48 -- common/autotest_common.sh@10 -- # set +x 00:15:38.034 20:32:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:38.034 20:32:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:38.034 20:32:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:38.034 20:32:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:38.034 20:32:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:38.034 20:32:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:38.034 20:32:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:38.034 20:32:54 -- nvmf/common.sh@294 -- # net_devs=() 00:15:38.034 20:32:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:38.034 20:32:54 -- nvmf/common.sh@295 -- # e810=() 00:15:38.034 20:32:54 -- nvmf/common.sh@295 -- # local -ga e810 00:15:38.034 20:32:54 -- nvmf/common.sh@296 -- # x722=() 00:15:38.034 20:32:54 -- nvmf/common.sh@296 -- # local -ga x722 00:15:38.034 20:32:54 -- nvmf/common.sh@297 -- # mlx=() 00:15:38.034 20:32:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:38.035 20:32:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:38.035 20:32:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:38.035 20:32:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:38.035 20:32:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:38.035 20:32:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:38.035 20:32:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:38.035 20:32:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:38.035 20:32:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:38.035 20:32:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:38.035 20:32:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:38.035 20:32:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:38.035 20:32:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:38.035 20:32:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:38.035 20:32:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:38.035 20:32:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:38.035 20:32:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:15:38.035 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:15:38.035 20:32:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:38.035 20:32:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:15:38.035 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:15:38.035 20:32:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:38.035 20:32:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:38.035 20:32:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:38.035 20:32:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:38.035 20:32:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:38.035 20:32:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:15:38.035 Found net devices under 0000:4b:00.0: cvl_0_0 00:15:38.035 20:32:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:38.035 20:32:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:38.035 20:32:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:38.035 20:32:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:38.035 20:32:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:38.035 20:32:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:15:38.035 Found net devices under 0000:4b:00.1: cvl_0_1 00:15:38.035 20:32:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:38.035 20:32:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:38.035 20:32:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:38.035 20:32:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:38.035 20:32:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:38.035 20:32:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:38.035 20:32:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:38.035 20:32:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:38.035 20:32:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:38.035 20:32:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:38.035 20:32:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:38.035 20:32:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:38.035 20:32:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:38.035 20:32:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:38.035 20:32:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:38.035 20:32:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:38.035 20:32:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:38.035 20:32:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:38.035 20:32:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:38.035 20:32:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:38.035 20:32:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:38.035 20:32:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:38.035 20:32:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:38.035 20:32:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:38.035 20:32:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:38.035 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:38.035 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.516 ms 00:15:38.035 00:15:38.035 --- 10.0.0.2 ping statistics --- 00:15:38.035 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:38.035 rtt min/avg/max/mdev = 0.516/0.516/0.516/0.000 ms 00:15:38.035 20:32:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:38.035 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:38.035 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.278 ms 00:15:38.035 00:15:38.035 --- 10.0.0.1 ping statistics --- 00:15:38.035 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:38.035 rtt min/avg/max/mdev = 0.278/0.278/0.278/0.000 ms 00:15:38.035 20:32:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:38.035 20:32:55 -- nvmf/common.sh@410 -- # return 0 00:15:38.035 20:32:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:38.035 20:32:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:38.035 20:32:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:38.035 20:32:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:38.035 20:32:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:38.035 20:32:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:38.035 20:32:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:38.035 20:32:55 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:15:38.035 20:32:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:38.035 20:32:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:38.035 20:32:55 -- common/autotest_common.sh@10 -- # set +x 00:15:38.035 20:32:55 -- nvmf/common.sh@469 -- # nvmfpid=4007885 00:15:38.035 20:32:55 -- nvmf/common.sh@470 -- # waitforlisten 4007885 00:15:38.035 20:32:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:38.035 20:32:55 -- common/autotest_common.sh@819 -- # '[' -z 4007885 ']' 00:15:38.035 20:32:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:38.035 20:32:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:38.035 20:32:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:38.035 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:38.035 20:32:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:38.035 20:32:55 -- common/autotest_common.sh@10 -- # set +x 00:15:38.035 [2024-04-26 20:32:55.290806] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:15:38.035 [2024-04-26 20:32:55.290889] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:38.035 EAL: No free 2048 kB hugepages reported on node 1 00:15:38.035 [2024-04-26 20:32:55.361386] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:38.035 [2024-04-26 20:32:55.433229] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:38.035 [2024-04-26 20:32:55.433362] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:38.035 [2024-04-26 20:32:55.433372] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:38.035 [2024-04-26 20:32:55.433380] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:38.035 [2024-04-26 20:32:55.433397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:38.035 20:32:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:38.035 20:32:56 -- common/autotest_common.sh@852 -- # return 0 00:15:38.035 20:32:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:38.035 20:32:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:38.035 20:32:56 -- common/autotest_common.sh@10 -- # set +x 00:15:38.035 20:32:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:38.035 20:32:56 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:15:38.035 [2024-04-26 20:32:56.220366] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:38.035 20:32:56 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:15:38.035 20:32:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:15:38.035 20:32:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:38.035 20:32:56 -- common/autotest_common.sh@10 -- # set +x 00:15:38.035 ************************************ 00:15:38.035 START TEST lvs_grow_clean 00:15:38.035 ************************************ 00:15:38.035 20:32:56 -- common/autotest_common.sh@1104 -- # lvs_grow 00:15:38.035 20:32:56 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:38.035 20:32:56 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:38.035 20:32:56 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:38.035 20:32:56 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:38.035 20:32:56 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:38.035 20:32:56 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:38.035 20:32:56 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:38.035 20:32:56 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:38.035 20:32:56 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:38.297 20:32:56 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:38.297 20:32:56 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:38.297 20:32:56 -- target/nvmf_lvs_grow.sh@28 -- # lvs=96ea7068-1113-4360-8092-0f15b7b35e1c 00:15:38.297 20:32:56 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 96ea7068-1113-4360-8092-0f15b7b35e1c 00:15:38.297 20:32:56 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:38.558 20:32:56 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:38.558 20:32:56 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:38.558 20:32:56 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 96ea7068-1113-4360-8092-0f15b7b35e1c lvol 150 00:15:38.819 20:32:56 -- target/nvmf_lvs_grow.sh@33 -- # lvol=3b272eb8-054c-411a-8710-df7de0e4b597 00:15:38.819 20:32:56 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:38.819 20:32:56 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:38.819 [2024-04-26 20:32:57.045327] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:38.819 [2024-04-26 20:32:57.045376] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:38.819 true 00:15:38.819 20:32:57 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 96ea7068-1113-4360-8092-0f15b7b35e1c 00:15:38.819 20:32:57 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:39.081 20:32:57 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:39.081 20:32:57 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:39.081 20:32:57 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 3b272eb8-054c-411a-8710-df7de0e4b597 00:15:39.342 20:32:57 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:39.342 [2024-04-26 20:32:57.655442] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:39.342 20:32:57 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:39.603 20:32:57 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:39.603 20:32:57 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=4008369 00:15:39.603 20:32:57 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:39.603 20:32:57 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 4008369 /var/tmp/bdevperf.sock 00:15:39.603 20:32:57 -- common/autotest_common.sh@819 -- # '[' -z 4008369 ']' 00:15:39.603 20:32:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:39.603 20:32:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:39.603 20:32:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:39.603 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:39.603 20:32:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:39.603 20:32:57 -- common/autotest_common.sh@10 -- # set +x 00:15:39.603 [2024-04-26 20:32:57.842838] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:15:39.603 [2024-04-26 20:32:57.842887] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4008369 ] 00:15:39.603 EAL: No free 2048 kB hugepages reported on node 1 00:15:39.603 [2024-04-26 20:32:57.900659] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:39.865 [2024-04-26 20:32:57.962814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:40.437 20:32:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:40.437 20:32:58 -- common/autotest_common.sh@852 -- # return 0 00:15:40.437 20:32:58 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:40.697 Nvme0n1 00:15:40.697 20:32:58 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:40.957 [ 00:15:40.957 { 00:15:40.957 "name": "Nvme0n1", 00:15:40.957 "aliases": [ 00:15:40.957 "3b272eb8-054c-411a-8710-df7de0e4b597" 00:15:40.957 ], 00:15:40.957 "product_name": "NVMe disk", 00:15:40.957 "block_size": 4096, 00:15:40.957 "num_blocks": 38912, 00:15:40.957 "uuid": "3b272eb8-054c-411a-8710-df7de0e4b597", 00:15:40.957 "assigned_rate_limits": { 00:15:40.957 "rw_ios_per_sec": 0, 00:15:40.957 "rw_mbytes_per_sec": 0, 00:15:40.957 "r_mbytes_per_sec": 0, 00:15:40.957 "w_mbytes_per_sec": 0 00:15:40.957 }, 00:15:40.957 "claimed": false, 00:15:40.957 "zoned": false, 00:15:40.957 "supported_io_types": { 00:15:40.957 "read": true, 00:15:40.957 "write": true, 00:15:40.957 "unmap": true, 00:15:40.957 "write_zeroes": true, 00:15:40.957 "flush": true, 00:15:40.957 "reset": true, 00:15:40.957 "compare": true, 00:15:40.957 "compare_and_write": true, 00:15:40.957 "abort": true, 00:15:40.957 "nvme_admin": true, 00:15:40.957 "nvme_io": true 00:15:40.957 }, 00:15:40.957 "driver_specific": { 00:15:40.957 "nvme": [ 00:15:40.957 { 00:15:40.957 "trid": { 00:15:40.957 "trtype": "TCP", 00:15:40.957 "adrfam": "IPv4", 00:15:40.957 "traddr": "10.0.0.2", 00:15:40.957 "trsvcid": "4420", 00:15:40.957 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:40.957 }, 00:15:40.957 "ctrlr_data": { 00:15:40.957 "cntlid": 1, 00:15:40.957 "vendor_id": "0x8086", 00:15:40.957 "model_number": "SPDK bdev Controller", 00:15:40.957 "serial_number": "SPDK0", 00:15:40.957 "firmware_revision": "24.01.1", 00:15:40.957 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:40.957 "oacs": { 00:15:40.957 "security": 0, 00:15:40.957 "format": 0, 00:15:40.957 "firmware": 0, 00:15:40.957 "ns_manage": 0 00:15:40.957 }, 00:15:40.957 "multi_ctrlr": true, 00:15:40.957 "ana_reporting": false 00:15:40.957 }, 00:15:40.957 "vs": { 00:15:40.957 "nvme_version": "1.3" 00:15:40.957 }, 00:15:40.957 "ns_data": { 00:15:40.957 "id": 1, 00:15:40.957 "can_share": true 00:15:40.957 } 00:15:40.957 } 00:15:40.957 ], 00:15:40.957 "mp_policy": "active_passive" 00:15:40.957 } 00:15:40.957 } 00:15:40.957 ] 00:15:40.957 20:32:59 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=4008612 00:15:40.957 20:32:59 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:40.957 20:32:59 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:40.957 Running I/O for 10 seconds... 00:15:41.900 Latency(us) 00:15:41.900 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:41.900 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:41.900 Nvme0n1 : 1.00 18406.00 71.90 0.00 0.00 0.00 0.00 0.00 00:15:41.900 =================================================================================================================== 00:15:41.900 Total : 18406.00 71.90 0.00 0.00 0.00 0.00 0.00 00:15:41.900 00:15:42.842 20:33:01 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 96ea7068-1113-4360-8092-0f15b7b35e1c 00:15:43.103 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:43.103 Nvme0n1 : 2.00 18553.50 72.47 0.00 0.00 0.00 0.00 0.00 00:15:43.103 =================================================================================================================== 00:15:43.103 Total : 18553.50 72.47 0.00 0.00 0.00 0.00 0.00 00:15:43.103 00:15:43.103 true 00:15:43.103 20:33:01 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 96ea7068-1113-4360-8092-0f15b7b35e1c 00:15:43.103 20:33:01 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:43.363 20:33:01 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:43.363 20:33:01 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:43.363 20:33:01 -- target/nvmf_lvs_grow.sh@65 -- # wait 4008612 00:15:43.935 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:43.935 Nvme0n1 : 3.00 18619.67 72.73 0.00 0.00 0.00 0.00 0.00 00:15:43.935 =================================================================================================================== 00:15:43.935 Total : 18619.67 72.73 0.00 0.00 0.00 0.00 0.00 00:15:43.935 00:15:45.321 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:45.321 Nvme0n1 : 4.00 18668.75 72.92 0.00 0.00 0.00 0.00 0.00 00:15:45.321 =================================================================================================================== 00:15:45.321 Total : 18668.75 72.92 0.00 0.00 0.00 0.00 0.00 00:15:45.321 00:15:46.264 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:46.264 Nvme0n1 : 5.00 18701.60 73.05 0.00 0.00 0.00 0.00 0.00 00:15:46.264 =================================================================================================================== 00:15:46.264 Total : 18701.60 73.05 0.00 0.00 0.00 0.00 0.00 00:15:46.264 00:15:47.206 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:47.206 Nvme0n1 : 6.00 18728.50 73.16 0.00 0.00 0.00 0.00 0.00 00:15:47.206 =================================================================================================================== 00:15:47.206 Total : 18728.50 73.16 0.00 0.00 0.00 0.00 0.00 00:15:47.206 00:15:48.149 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:48.149 Nvme0n1 : 7.00 18743.43 73.22 0.00 0.00 0.00 0.00 0.00 00:15:48.149 =================================================================================================================== 00:15:48.149 Total : 18743.43 73.22 0.00 0.00 0.00 0.00 0.00 00:15:48.149 00:15:49.092 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:49.092 Nvme0n1 : 8.00 18758.25 73.27 0.00 0.00 0.00 0.00 0.00 00:15:49.092 =================================================================================================================== 00:15:49.093 Total : 18758.25 73.27 0.00 0.00 0.00 0.00 0.00 00:15:49.093 00:15:50.034 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:50.034 Nvme0n1 : 9.00 18771.89 73.33 0.00 0.00 0.00 0.00 0.00 00:15:50.034 =================================================================================================================== 00:15:50.034 Total : 18771.89 73.33 0.00 0.00 0.00 0.00 0.00 00:15:50.034 00:15:50.979 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:50.979 Nvme0n1 : 10.00 18781.40 73.36 0.00 0.00 0.00 0.00 0.00 00:15:50.979 =================================================================================================================== 00:15:50.979 Total : 18781.40 73.36 0.00 0.00 0.00 0.00 0.00 00:15:50.979 00:15:50.979 00:15:50.979 Latency(us) 00:15:50.979 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:50.979 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:50.979 Nvme0n1 : 10.00 18780.45 73.36 0.00 0.00 6811.03 4778.67 16820.91 00:15:50.979 =================================================================================================================== 00:15:50.980 Total : 18780.45 73.36 0.00 0.00 6811.03 4778.67 16820.91 00:15:50.980 0 00:15:50.980 20:33:09 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 4008369 00:15:50.980 20:33:09 -- common/autotest_common.sh@926 -- # '[' -z 4008369 ']' 00:15:50.980 20:33:09 -- common/autotest_common.sh@930 -- # kill -0 4008369 00:15:50.980 20:33:09 -- common/autotest_common.sh@931 -- # uname 00:15:50.980 20:33:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:50.980 20:33:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4008369 00:15:51.240 20:33:09 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:51.240 20:33:09 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:51.240 20:33:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4008369' 00:15:51.240 killing process with pid 4008369 00:15:51.240 20:33:09 -- common/autotest_common.sh@945 -- # kill 4008369 00:15:51.240 Received shutdown signal, test time was about 10.000000 seconds 00:15:51.240 00:15:51.241 Latency(us) 00:15:51.241 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:51.241 =================================================================================================================== 00:15:51.241 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:51.241 20:33:09 -- common/autotest_common.sh@950 -- # wait 4008369 00:15:51.241 20:33:09 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:51.502 20:33:09 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 96ea7068-1113-4360-8092-0f15b7b35e1c 00:15:51.502 20:33:09 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:51.502 20:33:09 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:51.502 20:33:09 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:15:51.502 20:33:09 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:51.764 [2024-04-26 20:33:09.926767] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:51.764 20:33:09 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 96ea7068-1113-4360-8092-0f15b7b35e1c 00:15:51.764 20:33:09 -- common/autotest_common.sh@640 -- # local es=0 00:15:51.764 20:33:09 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 96ea7068-1113-4360-8092-0f15b7b35e1c 00:15:51.764 20:33:09 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:51.764 20:33:09 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:51.764 20:33:09 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:51.764 20:33:09 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:51.764 20:33:09 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:51.764 20:33:09 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:15:51.764 20:33:09 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:51.764 20:33:09 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:51.764 20:33:09 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 96ea7068-1113-4360-8092-0f15b7b35e1c 00:15:52.025 request: 00:15:52.025 { 00:15:52.025 "uuid": "96ea7068-1113-4360-8092-0f15b7b35e1c", 00:15:52.025 "method": "bdev_lvol_get_lvstores", 00:15:52.025 "req_id": 1 00:15:52.025 } 00:15:52.025 Got JSON-RPC error response 00:15:52.025 response: 00:15:52.025 { 00:15:52.025 "code": -19, 00:15:52.025 "message": "No such device" 00:15:52.025 } 00:15:52.025 20:33:10 -- common/autotest_common.sh@643 -- # es=1 00:15:52.025 20:33:10 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:15:52.025 20:33:10 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:15:52.025 20:33:10 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:15:52.025 20:33:10 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:52.025 aio_bdev 00:15:52.025 20:33:10 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 3b272eb8-054c-411a-8710-df7de0e4b597 00:15:52.025 20:33:10 -- common/autotest_common.sh@887 -- # local bdev_name=3b272eb8-054c-411a-8710-df7de0e4b597 00:15:52.025 20:33:10 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:15:52.025 20:33:10 -- common/autotest_common.sh@889 -- # local i 00:15:52.025 20:33:10 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:15:52.025 20:33:10 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:15:52.025 20:33:10 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:52.286 20:33:10 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 3b272eb8-054c-411a-8710-df7de0e4b597 -t 2000 00:15:52.286 [ 00:15:52.286 { 00:15:52.286 "name": "3b272eb8-054c-411a-8710-df7de0e4b597", 00:15:52.286 "aliases": [ 00:15:52.286 "lvs/lvol" 00:15:52.286 ], 00:15:52.286 "product_name": "Logical Volume", 00:15:52.286 "block_size": 4096, 00:15:52.286 "num_blocks": 38912, 00:15:52.286 "uuid": "3b272eb8-054c-411a-8710-df7de0e4b597", 00:15:52.286 "assigned_rate_limits": { 00:15:52.286 "rw_ios_per_sec": 0, 00:15:52.286 "rw_mbytes_per_sec": 0, 00:15:52.286 "r_mbytes_per_sec": 0, 00:15:52.286 "w_mbytes_per_sec": 0 00:15:52.286 }, 00:15:52.286 "claimed": false, 00:15:52.286 "zoned": false, 00:15:52.286 "supported_io_types": { 00:15:52.286 "read": true, 00:15:52.286 "write": true, 00:15:52.286 "unmap": true, 00:15:52.286 "write_zeroes": true, 00:15:52.287 "flush": false, 00:15:52.287 "reset": true, 00:15:52.287 "compare": false, 00:15:52.287 "compare_and_write": false, 00:15:52.287 "abort": false, 00:15:52.287 "nvme_admin": false, 00:15:52.287 "nvme_io": false 00:15:52.287 }, 00:15:52.287 "driver_specific": { 00:15:52.287 "lvol": { 00:15:52.287 "lvol_store_uuid": "96ea7068-1113-4360-8092-0f15b7b35e1c", 00:15:52.287 "base_bdev": "aio_bdev", 00:15:52.287 "thin_provision": false, 00:15:52.287 "snapshot": false, 00:15:52.287 "clone": false, 00:15:52.287 "esnap_clone": false 00:15:52.287 } 00:15:52.287 } 00:15:52.287 } 00:15:52.287 ] 00:15:52.287 20:33:10 -- common/autotest_common.sh@895 -- # return 0 00:15:52.287 20:33:10 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 96ea7068-1113-4360-8092-0f15b7b35e1c 00:15:52.287 20:33:10 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:52.547 20:33:10 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:52.547 20:33:10 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 96ea7068-1113-4360-8092-0f15b7b35e1c 00:15:52.547 20:33:10 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:52.808 20:33:10 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:52.808 20:33:10 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 3b272eb8-054c-411a-8710-df7de0e4b597 00:15:52.808 20:33:11 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 96ea7068-1113-4360-8092-0f15b7b35e1c 00:15:53.069 20:33:11 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:53.069 20:33:11 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:53.331 00:15:53.331 real 0m15.191s 00:15:53.331 user 0m14.967s 00:15:53.331 sys 0m1.234s 00:15:53.331 20:33:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:53.331 20:33:11 -- common/autotest_common.sh@10 -- # set +x 00:15:53.331 ************************************ 00:15:53.331 END TEST lvs_grow_clean 00:15:53.331 ************************************ 00:15:53.331 20:33:11 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:15:53.331 20:33:11 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:53.331 20:33:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:53.331 20:33:11 -- common/autotest_common.sh@10 -- # set +x 00:15:53.331 ************************************ 00:15:53.331 START TEST lvs_grow_dirty 00:15:53.331 ************************************ 00:15:53.331 20:33:11 -- common/autotest_common.sh@1104 -- # lvs_grow dirty 00:15:53.331 20:33:11 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:53.331 20:33:11 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:53.331 20:33:11 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:53.331 20:33:11 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:53.331 20:33:11 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:53.331 20:33:11 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:53.331 20:33:11 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:53.331 20:33:11 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:53.331 20:33:11 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:53.592 20:33:11 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:53.592 20:33:11 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:53.592 20:33:11 -- target/nvmf_lvs_grow.sh@28 -- # lvs=3987058a-8f2a-4b9b-a8a7-0563541d4729 00:15:53.592 20:33:11 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 00:15:53.592 20:33:11 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:53.854 20:33:11 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:53.854 20:33:11 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:53.854 20:33:11 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 lvol 150 00:15:53.854 20:33:12 -- target/nvmf_lvs_grow.sh@33 -- # lvol=cf4e4b9b-39c6-4e68-8424-04262b0a4091 00:15:53.854 20:33:12 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:53.854 20:33:12 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:54.115 [2024-04-26 20:33:12.268298] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:54.115 [2024-04-26 20:33:12.268348] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:54.115 true 00:15:54.115 20:33:12 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 00:15:54.115 20:33:12 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:54.115 20:33:12 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:54.116 20:33:12 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:54.376 20:33:12 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 cf4e4b9b-39c6-4e68-8424-04262b0a4091 00:15:54.377 20:33:12 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:54.636 20:33:12 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:54.897 20:33:13 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:54.897 20:33:13 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=4011952 00:15:54.897 20:33:13 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:54.897 20:33:13 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 4011952 /var/tmp/bdevperf.sock 00:15:54.897 20:33:13 -- common/autotest_common.sh@819 -- # '[' -z 4011952 ']' 00:15:54.897 20:33:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:54.897 20:33:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:54.897 20:33:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:54.897 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:54.898 20:33:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:54.898 20:33:13 -- common/autotest_common.sh@10 -- # set +x 00:15:54.898 [2024-04-26 20:33:13.046018] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:15:54.898 [2024-04-26 20:33:13.046068] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4011952 ] 00:15:54.898 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.898 [2024-04-26 20:33:13.108568] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:54.898 [2024-04-26 20:33:13.170675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:55.839 20:33:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:55.839 20:33:13 -- common/autotest_common.sh@852 -- # return 0 00:15:55.839 20:33:13 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:56.099 Nvme0n1 00:15:56.099 20:33:14 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:56.099 [ 00:15:56.099 { 00:15:56.099 "name": "Nvme0n1", 00:15:56.099 "aliases": [ 00:15:56.099 "cf4e4b9b-39c6-4e68-8424-04262b0a4091" 00:15:56.099 ], 00:15:56.099 "product_name": "NVMe disk", 00:15:56.099 "block_size": 4096, 00:15:56.099 "num_blocks": 38912, 00:15:56.099 "uuid": "cf4e4b9b-39c6-4e68-8424-04262b0a4091", 00:15:56.099 "assigned_rate_limits": { 00:15:56.099 "rw_ios_per_sec": 0, 00:15:56.099 "rw_mbytes_per_sec": 0, 00:15:56.099 "r_mbytes_per_sec": 0, 00:15:56.099 "w_mbytes_per_sec": 0 00:15:56.099 }, 00:15:56.099 "claimed": false, 00:15:56.099 "zoned": false, 00:15:56.099 "supported_io_types": { 00:15:56.099 "read": true, 00:15:56.099 "write": true, 00:15:56.099 "unmap": true, 00:15:56.099 "write_zeroes": true, 00:15:56.099 "flush": true, 00:15:56.099 "reset": true, 00:15:56.099 "compare": true, 00:15:56.099 "compare_and_write": true, 00:15:56.099 "abort": true, 00:15:56.099 "nvme_admin": true, 00:15:56.099 "nvme_io": true 00:15:56.099 }, 00:15:56.099 "driver_specific": { 00:15:56.099 "nvme": [ 00:15:56.099 { 00:15:56.099 "trid": { 00:15:56.099 "trtype": "TCP", 00:15:56.099 "adrfam": "IPv4", 00:15:56.099 "traddr": "10.0.0.2", 00:15:56.099 "trsvcid": "4420", 00:15:56.099 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:56.099 }, 00:15:56.099 "ctrlr_data": { 00:15:56.099 "cntlid": 1, 00:15:56.099 "vendor_id": "0x8086", 00:15:56.099 "model_number": "SPDK bdev Controller", 00:15:56.099 "serial_number": "SPDK0", 00:15:56.099 "firmware_revision": "24.01.1", 00:15:56.099 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:56.099 "oacs": { 00:15:56.099 "security": 0, 00:15:56.099 "format": 0, 00:15:56.099 "firmware": 0, 00:15:56.099 "ns_manage": 0 00:15:56.099 }, 00:15:56.099 "multi_ctrlr": true, 00:15:56.099 "ana_reporting": false 00:15:56.099 }, 00:15:56.099 "vs": { 00:15:56.099 "nvme_version": "1.3" 00:15:56.099 }, 00:15:56.099 "ns_data": { 00:15:56.099 "id": 1, 00:15:56.099 "can_share": true 00:15:56.099 } 00:15:56.099 } 00:15:56.099 ], 00:15:56.099 "mp_policy": "active_passive" 00:15:56.099 } 00:15:56.099 } 00:15:56.099 ] 00:15:56.099 20:33:14 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=4012291 00:15:56.099 20:33:14 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:56.099 20:33:14 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:56.369 Running I/O for 10 seconds... 00:15:57.337 Latency(us) 00:15:57.337 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:57.337 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:57.337 Nvme0n1 : 1.00 18504.00 72.28 0.00 0.00 0.00 0.00 0.00 00:15:57.337 =================================================================================================================== 00:15:57.337 Total : 18504.00 72.28 0.00 0.00 0.00 0.00 0.00 00:15:57.337 00:15:58.280 20:33:16 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 00:15:58.280 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:58.280 Nvme0n1 : 2.00 18596.00 72.64 0.00 0.00 0.00 0.00 0.00 00:15:58.280 =================================================================================================================== 00:15:58.280 Total : 18596.00 72.64 0.00 0.00 0.00 0.00 0.00 00:15:58.280 00:15:58.280 true 00:15:58.280 20:33:16 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 00:15:58.280 20:33:16 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:58.542 20:33:16 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:58.542 20:33:16 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:58.542 20:33:16 -- target/nvmf_lvs_grow.sh@65 -- # wait 4012291 00:15:59.484 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:59.484 Nvme0n1 : 3.00 18646.33 72.84 0.00 0.00 0.00 0.00 0.00 00:15:59.484 =================================================================================================================== 00:15:59.484 Total : 18646.33 72.84 0.00 0.00 0.00 0.00 0.00 00:15:59.484 00:16:00.427 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:00.427 Nvme0n1 : 4.00 18673.75 72.94 0.00 0.00 0.00 0.00 0.00 00:16:00.427 =================================================================================================================== 00:16:00.427 Total : 18673.75 72.94 0.00 0.00 0.00 0.00 0.00 00:16:00.427 00:16:01.370 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:01.370 Nvme0n1 : 5.00 18705.40 73.07 0.00 0.00 0.00 0.00 0.00 00:16:01.370 =================================================================================================================== 00:16:01.370 Total : 18705.40 73.07 0.00 0.00 0.00 0.00 0.00 00:16:01.370 00:16:02.312 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:02.312 Nvme0n1 : 6.00 18721.00 73.13 0.00 0.00 0.00 0.00 0.00 00:16:02.312 =================================================================================================================== 00:16:02.312 Total : 18721.00 73.13 0.00 0.00 0.00 0.00 0.00 00:16:02.312 00:16:03.253 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:03.253 Nvme0n1 : 7.00 18743.14 73.22 0.00 0.00 0.00 0.00 0.00 00:16:03.253 =================================================================================================================== 00:16:03.253 Total : 18743.14 73.22 0.00 0.00 0.00 0.00 0.00 00:16:03.253 00:16:04.197 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:04.197 Nvme0n1 : 8.00 18754.38 73.26 0.00 0.00 0.00 0.00 0.00 00:16:04.197 =================================================================================================================== 00:16:04.197 Total : 18754.38 73.26 0.00 0.00 0.00 0.00 0.00 00:16:04.197 00:16:05.582 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:05.582 Nvme0n1 : 9.00 18773.33 73.33 0.00 0.00 0.00 0.00 0.00 00:16:05.582 =================================================================================================================== 00:16:05.582 Total : 18773.33 73.33 0.00 0.00 0.00 0.00 0.00 00:16:05.582 00:16:06.526 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:06.527 Nvme0n1 : 10.00 18790.40 73.40 0.00 0.00 0.00 0.00 0.00 00:16:06.527 =================================================================================================================== 00:16:06.527 Total : 18790.40 73.40 0.00 0.00 0.00 0.00 0.00 00:16:06.527 00:16:06.527 00:16:06.527 Latency(us) 00:16:06.527 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:06.527 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:06.527 Nvme0n1 : 10.01 18790.38 73.40 0.00 0.00 6807.06 4177.92 12178.77 00:16:06.527 =================================================================================================================== 00:16:06.527 Total : 18790.38 73.40 0.00 0.00 6807.06 4177.92 12178.77 00:16:06.527 0 00:16:06.527 20:33:24 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 4011952 00:16:06.527 20:33:24 -- common/autotest_common.sh@926 -- # '[' -z 4011952 ']' 00:16:06.527 20:33:24 -- common/autotest_common.sh@930 -- # kill -0 4011952 00:16:06.527 20:33:24 -- common/autotest_common.sh@931 -- # uname 00:16:06.527 20:33:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:06.527 20:33:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4011952 00:16:06.527 20:33:24 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:16:06.527 20:33:24 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:16:06.527 20:33:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4011952' 00:16:06.527 killing process with pid 4011952 00:16:06.527 20:33:24 -- common/autotest_common.sh@945 -- # kill 4011952 00:16:06.527 Received shutdown signal, test time was about 10.000000 seconds 00:16:06.527 00:16:06.527 Latency(us) 00:16:06.527 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:06.527 =================================================================================================================== 00:16:06.527 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:06.527 20:33:24 -- common/autotest_common.sh@950 -- # wait 4011952 00:16:06.527 20:33:24 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:16:06.789 20:33:24 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 00:16:06.789 20:33:24 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:16:06.789 20:33:25 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:16:06.789 20:33:25 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:16:06.789 20:33:25 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 4007885 00:16:06.789 20:33:25 -- target/nvmf_lvs_grow.sh@74 -- # wait 4007885 00:16:06.789 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 4007885 Killed "${NVMF_APP[@]}" "$@" 00:16:06.789 20:33:25 -- target/nvmf_lvs_grow.sh@74 -- # true 00:16:06.789 20:33:25 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:16:06.789 20:33:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:06.789 20:33:25 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:06.789 20:33:25 -- common/autotest_common.sh@10 -- # set +x 00:16:06.789 20:33:25 -- nvmf/common.sh@469 -- # nvmfpid=4014341 00:16:06.789 20:33:25 -- nvmf/common.sh@470 -- # waitforlisten 4014341 00:16:06.789 20:33:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:06.789 20:33:25 -- common/autotest_common.sh@819 -- # '[' -z 4014341 ']' 00:16:06.789 20:33:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:06.789 20:33:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:06.789 20:33:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:06.789 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:06.789 20:33:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:06.789 20:33:25 -- common/autotest_common.sh@10 -- # set +x 00:16:07.051 [2024-04-26 20:33:25.149860] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:16:07.051 [2024-04-26 20:33:25.149913] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:07.051 EAL: No free 2048 kB hugepages reported on node 1 00:16:07.051 [2024-04-26 20:33:25.215701] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:07.051 [2024-04-26 20:33:25.280211] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:07.051 [2024-04-26 20:33:25.280335] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:07.051 [2024-04-26 20:33:25.280345] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:07.051 [2024-04-26 20:33:25.280352] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:07.051 [2024-04-26 20:33:25.280368] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:07.622 20:33:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:07.622 20:33:25 -- common/autotest_common.sh@852 -- # return 0 00:16:07.622 20:33:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:07.622 20:33:25 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:07.622 20:33:25 -- common/autotest_common.sh@10 -- # set +x 00:16:07.622 20:33:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:07.622 20:33:25 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:16:07.883 [2024-04-26 20:33:26.089360] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:16:07.883 [2024-04-26 20:33:26.089453] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:16:07.883 [2024-04-26 20:33:26.089483] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:16:07.883 20:33:26 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:16:07.883 20:33:26 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev cf4e4b9b-39c6-4e68-8424-04262b0a4091 00:16:07.883 20:33:26 -- common/autotest_common.sh@887 -- # local bdev_name=cf4e4b9b-39c6-4e68-8424-04262b0a4091 00:16:07.883 20:33:26 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:16:07.883 20:33:26 -- common/autotest_common.sh@889 -- # local i 00:16:07.883 20:33:26 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:16:07.883 20:33:26 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:16:07.883 20:33:26 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:16:08.144 20:33:26 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b cf4e4b9b-39c6-4e68-8424-04262b0a4091 -t 2000 00:16:08.144 [ 00:16:08.144 { 00:16:08.144 "name": "cf4e4b9b-39c6-4e68-8424-04262b0a4091", 00:16:08.144 "aliases": [ 00:16:08.144 "lvs/lvol" 00:16:08.144 ], 00:16:08.144 "product_name": "Logical Volume", 00:16:08.144 "block_size": 4096, 00:16:08.144 "num_blocks": 38912, 00:16:08.144 "uuid": "cf4e4b9b-39c6-4e68-8424-04262b0a4091", 00:16:08.144 "assigned_rate_limits": { 00:16:08.144 "rw_ios_per_sec": 0, 00:16:08.144 "rw_mbytes_per_sec": 0, 00:16:08.144 "r_mbytes_per_sec": 0, 00:16:08.144 "w_mbytes_per_sec": 0 00:16:08.144 }, 00:16:08.144 "claimed": false, 00:16:08.144 "zoned": false, 00:16:08.144 "supported_io_types": { 00:16:08.144 "read": true, 00:16:08.144 "write": true, 00:16:08.144 "unmap": true, 00:16:08.144 "write_zeroes": true, 00:16:08.144 "flush": false, 00:16:08.144 "reset": true, 00:16:08.144 "compare": false, 00:16:08.144 "compare_and_write": false, 00:16:08.144 "abort": false, 00:16:08.144 "nvme_admin": false, 00:16:08.144 "nvme_io": false 00:16:08.144 }, 00:16:08.144 "driver_specific": { 00:16:08.144 "lvol": { 00:16:08.144 "lvol_store_uuid": "3987058a-8f2a-4b9b-a8a7-0563541d4729", 00:16:08.144 "base_bdev": "aio_bdev", 00:16:08.144 "thin_provision": false, 00:16:08.144 "snapshot": false, 00:16:08.144 "clone": false, 00:16:08.144 "esnap_clone": false 00:16:08.144 } 00:16:08.144 } 00:16:08.144 } 00:16:08.144 ] 00:16:08.144 20:33:26 -- common/autotest_common.sh@895 -- # return 0 00:16:08.144 20:33:26 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 00:16:08.144 20:33:26 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:16:08.405 20:33:26 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:16:08.405 20:33:26 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 00:16:08.405 20:33:26 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:16:08.405 20:33:26 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:16:08.405 20:33:26 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:16:08.666 [2024-04-26 20:33:26.845239] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:16:08.666 20:33:26 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 00:16:08.666 20:33:26 -- common/autotest_common.sh@640 -- # local es=0 00:16:08.666 20:33:26 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 00:16:08.666 20:33:26 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:08.666 20:33:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:08.666 20:33:26 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:08.666 20:33:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:08.666 20:33:26 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:08.666 20:33:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:16:08.666 20:33:26 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:08.666 20:33:26 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:16:08.666 20:33:26 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 00:16:08.927 request: 00:16:08.927 { 00:16:08.927 "uuid": "3987058a-8f2a-4b9b-a8a7-0563541d4729", 00:16:08.927 "method": "bdev_lvol_get_lvstores", 00:16:08.927 "req_id": 1 00:16:08.927 } 00:16:08.927 Got JSON-RPC error response 00:16:08.927 response: 00:16:08.927 { 00:16:08.927 "code": -19, 00:16:08.927 "message": "No such device" 00:16:08.927 } 00:16:08.927 20:33:27 -- common/autotest_common.sh@643 -- # es=1 00:16:08.927 20:33:27 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:16:08.927 20:33:27 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:16:08.927 20:33:27 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:16:08.927 20:33:27 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:16:08.927 aio_bdev 00:16:08.927 20:33:27 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev cf4e4b9b-39c6-4e68-8424-04262b0a4091 00:16:08.927 20:33:27 -- common/autotest_common.sh@887 -- # local bdev_name=cf4e4b9b-39c6-4e68-8424-04262b0a4091 00:16:08.927 20:33:27 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:16:08.927 20:33:27 -- common/autotest_common.sh@889 -- # local i 00:16:08.927 20:33:27 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:16:08.927 20:33:27 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:16:08.927 20:33:27 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:16:09.188 20:33:27 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b cf4e4b9b-39c6-4e68-8424-04262b0a4091 -t 2000 00:16:09.188 [ 00:16:09.188 { 00:16:09.188 "name": "cf4e4b9b-39c6-4e68-8424-04262b0a4091", 00:16:09.188 "aliases": [ 00:16:09.188 "lvs/lvol" 00:16:09.188 ], 00:16:09.188 "product_name": "Logical Volume", 00:16:09.188 "block_size": 4096, 00:16:09.188 "num_blocks": 38912, 00:16:09.188 "uuid": "cf4e4b9b-39c6-4e68-8424-04262b0a4091", 00:16:09.188 "assigned_rate_limits": { 00:16:09.188 "rw_ios_per_sec": 0, 00:16:09.188 "rw_mbytes_per_sec": 0, 00:16:09.188 "r_mbytes_per_sec": 0, 00:16:09.188 "w_mbytes_per_sec": 0 00:16:09.188 }, 00:16:09.188 "claimed": false, 00:16:09.188 "zoned": false, 00:16:09.188 "supported_io_types": { 00:16:09.188 "read": true, 00:16:09.188 "write": true, 00:16:09.188 "unmap": true, 00:16:09.188 "write_zeroes": true, 00:16:09.188 "flush": false, 00:16:09.188 "reset": true, 00:16:09.188 "compare": false, 00:16:09.188 "compare_and_write": false, 00:16:09.188 "abort": false, 00:16:09.188 "nvme_admin": false, 00:16:09.188 "nvme_io": false 00:16:09.188 }, 00:16:09.188 "driver_specific": { 00:16:09.188 "lvol": { 00:16:09.188 "lvol_store_uuid": "3987058a-8f2a-4b9b-a8a7-0563541d4729", 00:16:09.188 "base_bdev": "aio_bdev", 00:16:09.188 "thin_provision": false, 00:16:09.188 "snapshot": false, 00:16:09.188 "clone": false, 00:16:09.188 "esnap_clone": false 00:16:09.188 } 00:16:09.188 } 00:16:09.188 } 00:16:09.188 ] 00:16:09.188 20:33:27 -- common/autotest_common.sh@895 -- # return 0 00:16:09.449 20:33:27 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 00:16:09.449 20:33:27 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:16:09.449 20:33:27 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:16:09.449 20:33:27 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 00:16:09.449 20:33:27 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:16:09.709 20:33:27 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:16:09.709 20:33:27 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete cf4e4b9b-39c6-4e68-8424-04262b0a4091 00:16:09.709 20:33:27 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 3987058a-8f2a-4b9b-a8a7-0563541d4729 00:16:09.969 20:33:28 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:16:09.969 20:33:28 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:16:10.231 00:16:10.231 real 0m16.842s 00:16:10.231 user 0m44.008s 00:16:10.231 sys 0m2.881s 00:16:10.231 20:33:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:10.231 20:33:28 -- common/autotest_common.sh@10 -- # set +x 00:16:10.231 ************************************ 00:16:10.231 END TEST lvs_grow_dirty 00:16:10.231 ************************************ 00:16:10.231 20:33:28 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:16:10.231 20:33:28 -- common/autotest_common.sh@796 -- # type=--id 00:16:10.231 20:33:28 -- common/autotest_common.sh@797 -- # id=0 00:16:10.231 20:33:28 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:16:10.231 20:33:28 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:16:10.231 20:33:28 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:16:10.231 20:33:28 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:16:10.231 20:33:28 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:16:10.231 20:33:28 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:16:10.231 nvmf_trace.0 00:16:10.231 20:33:28 -- common/autotest_common.sh@811 -- # return 0 00:16:10.231 20:33:28 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:16:10.231 20:33:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:10.231 20:33:28 -- nvmf/common.sh@116 -- # sync 00:16:10.231 20:33:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:10.231 20:33:28 -- nvmf/common.sh@119 -- # set +e 00:16:10.231 20:33:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:10.231 20:33:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:10.231 rmmod nvme_tcp 00:16:10.231 rmmod nvme_fabrics 00:16:10.231 rmmod nvme_keyring 00:16:10.231 20:33:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:10.231 20:33:28 -- nvmf/common.sh@123 -- # set -e 00:16:10.231 20:33:28 -- nvmf/common.sh@124 -- # return 0 00:16:10.231 20:33:28 -- nvmf/common.sh@477 -- # '[' -n 4014341 ']' 00:16:10.231 20:33:28 -- nvmf/common.sh@478 -- # killprocess 4014341 00:16:10.231 20:33:28 -- common/autotest_common.sh@926 -- # '[' -z 4014341 ']' 00:16:10.231 20:33:28 -- common/autotest_common.sh@930 -- # kill -0 4014341 00:16:10.231 20:33:28 -- common/autotest_common.sh@931 -- # uname 00:16:10.231 20:33:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:10.231 20:33:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4014341 00:16:10.231 20:33:28 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:10.231 20:33:28 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:10.231 20:33:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4014341' 00:16:10.231 killing process with pid 4014341 00:16:10.231 20:33:28 -- common/autotest_common.sh@945 -- # kill 4014341 00:16:10.231 20:33:28 -- common/autotest_common.sh@950 -- # wait 4014341 00:16:10.493 20:33:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:10.493 20:33:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:10.493 20:33:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:10.493 20:33:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:10.493 20:33:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:10.493 20:33:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:10.493 20:33:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:10.493 20:33:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:12.409 20:33:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:12.409 00:16:12.409 real 0m42.729s 00:16:12.409 user 1m4.779s 00:16:12.409 sys 0m9.755s 00:16:12.409 20:33:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:12.409 20:33:30 -- common/autotest_common.sh@10 -- # set +x 00:16:12.409 ************************************ 00:16:12.409 END TEST nvmf_lvs_grow 00:16:12.409 ************************************ 00:16:12.409 20:33:30 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:16:12.409 20:33:30 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:12.409 20:33:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:12.409 20:33:30 -- common/autotest_common.sh@10 -- # set +x 00:16:12.409 ************************************ 00:16:12.409 START TEST nvmf_bdev_io_wait 00:16:12.409 ************************************ 00:16:12.409 20:33:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:16:12.671 * Looking for test storage... 00:16:12.671 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:12.671 20:33:30 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:12.671 20:33:30 -- nvmf/common.sh@7 -- # uname -s 00:16:12.671 20:33:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:12.671 20:33:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:12.671 20:33:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:12.671 20:33:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:12.671 20:33:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:12.671 20:33:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:12.671 20:33:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:12.671 20:33:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:12.671 20:33:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:12.671 20:33:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:12.671 20:33:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:12.671 20:33:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:12.671 20:33:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:12.671 20:33:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:12.671 20:33:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:12.671 20:33:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:12.671 20:33:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:12.671 20:33:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:12.671 20:33:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:12.671 20:33:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.671 20:33:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.671 20:33:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.671 20:33:30 -- paths/export.sh@5 -- # export PATH 00:16:12.671 20:33:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.671 20:33:30 -- nvmf/common.sh@46 -- # : 0 00:16:12.671 20:33:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:12.671 20:33:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:12.671 20:33:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:12.671 20:33:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:12.671 20:33:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:12.671 20:33:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:12.671 20:33:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:12.671 20:33:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:12.671 20:33:30 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:12.671 20:33:30 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:12.671 20:33:30 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:16:12.671 20:33:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:12.671 20:33:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:12.671 20:33:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:12.671 20:33:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:12.671 20:33:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:12.671 20:33:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:12.671 20:33:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:12.671 20:33:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:12.671 20:33:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:12.671 20:33:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:12.671 20:33:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:12.671 20:33:30 -- common/autotest_common.sh@10 -- # set +x 00:16:19.259 20:33:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:19.259 20:33:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:19.259 20:33:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:19.259 20:33:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:19.259 20:33:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:19.259 20:33:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:19.259 20:33:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:19.259 20:33:37 -- nvmf/common.sh@294 -- # net_devs=() 00:16:19.259 20:33:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:19.259 20:33:37 -- nvmf/common.sh@295 -- # e810=() 00:16:19.259 20:33:37 -- nvmf/common.sh@295 -- # local -ga e810 00:16:19.259 20:33:37 -- nvmf/common.sh@296 -- # x722=() 00:16:19.259 20:33:37 -- nvmf/common.sh@296 -- # local -ga x722 00:16:19.259 20:33:37 -- nvmf/common.sh@297 -- # mlx=() 00:16:19.259 20:33:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:19.259 20:33:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:19.259 20:33:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:19.259 20:33:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:19.259 20:33:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:19.259 20:33:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:19.259 20:33:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:19.259 20:33:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:19.259 20:33:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:19.259 20:33:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:19.259 20:33:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:19.259 20:33:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:19.259 20:33:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:19.259 20:33:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:19.259 20:33:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:19.259 20:33:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:19.259 20:33:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:16:19.259 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:16:19.259 20:33:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:19.259 20:33:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:16:19.259 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:16:19.259 20:33:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:19.259 20:33:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:19.259 20:33:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:19.259 20:33:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:19.259 20:33:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:19.259 20:33:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:16:19.259 Found net devices under 0000:4b:00.0: cvl_0_0 00:16:19.259 20:33:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:19.259 20:33:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:19.259 20:33:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:19.259 20:33:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:19.259 20:33:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:19.259 20:33:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:16:19.259 Found net devices under 0000:4b:00.1: cvl_0_1 00:16:19.259 20:33:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:19.259 20:33:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:19.259 20:33:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:19.259 20:33:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:19.259 20:33:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:19.259 20:33:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:19.259 20:33:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:19.259 20:33:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:19.259 20:33:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:19.259 20:33:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:19.259 20:33:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:19.259 20:33:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:19.259 20:33:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:19.259 20:33:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:19.259 20:33:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:19.259 20:33:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:19.259 20:33:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:19.259 20:33:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:19.521 20:33:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:19.521 20:33:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:19.521 20:33:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:19.521 20:33:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:19.521 20:33:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:19.521 20:33:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:19.521 20:33:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:19.521 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:19.521 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.695 ms 00:16:19.521 00:16:19.521 --- 10.0.0.2 ping statistics --- 00:16:19.521 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:19.521 rtt min/avg/max/mdev = 0.695/0.695/0.695/0.000 ms 00:16:19.521 20:33:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:19.782 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:19.782 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.377 ms 00:16:19.782 00:16:19.782 --- 10.0.0.1 ping statistics --- 00:16:19.782 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:19.782 rtt min/avg/max/mdev = 0.377/0.377/0.377/0.000 ms 00:16:19.782 20:33:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:19.782 20:33:37 -- nvmf/common.sh@410 -- # return 0 00:16:19.782 20:33:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:19.782 20:33:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:19.782 20:33:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:19.782 20:33:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:19.782 20:33:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:19.782 20:33:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:19.782 20:33:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:19.782 20:33:37 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:16:19.782 20:33:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:19.782 20:33:37 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:19.782 20:33:37 -- common/autotest_common.sh@10 -- # set +x 00:16:19.782 20:33:37 -- nvmf/common.sh@469 -- # nvmfpid=4019349 00:16:19.782 20:33:37 -- nvmf/common.sh@470 -- # waitforlisten 4019349 00:16:19.782 20:33:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:16:19.782 20:33:37 -- common/autotest_common.sh@819 -- # '[' -z 4019349 ']' 00:16:19.782 20:33:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:19.782 20:33:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:19.782 20:33:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:19.782 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:19.782 20:33:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:19.782 20:33:37 -- common/autotest_common.sh@10 -- # set +x 00:16:19.782 [2024-04-26 20:33:37.956093] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:16:19.782 [2024-04-26 20:33:37.956159] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:19.782 EAL: No free 2048 kB hugepages reported on node 1 00:16:19.782 [2024-04-26 20:33:38.028863] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:19.782 [2024-04-26 20:33:38.102294] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:19.782 [2024-04-26 20:33:38.102433] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:19.782 [2024-04-26 20:33:38.102444] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:19.782 [2024-04-26 20:33:38.102452] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:19.782 [2024-04-26 20:33:38.102597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:19.782 [2024-04-26 20:33:38.102702] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:19.782 [2024-04-26 20:33:38.102830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:19.782 [2024-04-26 20:33:38.102832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:20.725 20:33:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:20.725 20:33:38 -- common/autotest_common.sh@852 -- # return 0 00:16:20.725 20:33:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:20.725 20:33:38 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:20.725 20:33:38 -- common/autotest_common.sh@10 -- # set +x 00:16:20.725 20:33:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:20.725 20:33:38 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:16:20.725 20:33:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:20.725 20:33:38 -- common/autotest_common.sh@10 -- # set +x 00:16:20.725 20:33:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:20.725 20:33:38 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:16:20.725 20:33:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:20.725 20:33:38 -- common/autotest_common.sh@10 -- # set +x 00:16:20.725 20:33:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:20.725 20:33:38 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:20.725 20:33:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:20.725 20:33:38 -- common/autotest_common.sh@10 -- # set +x 00:16:20.726 [2024-04-26 20:33:38.842880] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:20.726 20:33:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:20.726 20:33:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:20.726 20:33:38 -- common/autotest_common.sh@10 -- # set +x 00:16:20.726 Malloc0 00:16:20.726 20:33:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:20.726 20:33:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:20.726 20:33:38 -- common/autotest_common.sh@10 -- # set +x 00:16:20.726 20:33:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:20.726 20:33:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:20.726 20:33:38 -- common/autotest_common.sh@10 -- # set +x 00:16:20.726 20:33:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:20.726 20:33:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:20.726 20:33:38 -- common/autotest_common.sh@10 -- # set +x 00:16:20.726 [2024-04-26 20:33:38.905559] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:20.726 20:33:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=4019443 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@30 -- # READ_PID=4019445 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:16:20.726 20:33:38 -- nvmf/common.sh@520 -- # config=() 00:16:20.726 20:33:38 -- nvmf/common.sh@520 -- # local subsystem config 00:16:20.726 20:33:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:20.726 20:33:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:20.726 { 00:16:20.726 "params": { 00:16:20.726 "name": "Nvme$subsystem", 00:16:20.726 "trtype": "$TEST_TRANSPORT", 00:16:20.726 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:20.726 "adrfam": "ipv4", 00:16:20.726 "trsvcid": "$NVMF_PORT", 00:16:20.726 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:20.726 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:20.726 "hdgst": ${hdgst:-false}, 00:16:20.726 "ddgst": ${ddgst:-false} 00:16:20.726 }, 00:16:20.726 "method": "bdev_nvme_attach_controller" 00:16:20.726 } 00:16:20.726 EOF 00:16:20.726 )") 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=4019447 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:16:20.726 20:33:38 -- nvmf/common.sh@520 -- # config=() 00:16:20.726 20:33:38 -- nvmf/common.sh@520 -- # local subsystem config 00:16:20.726 20:33:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:20.726 20:33:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:20.726 { 00:16:20.726 "params": { 00:16:20.726 "name": "Nvme$subsystem", 00:16:20.726 "trtype": "$TEST_TRANSPORT", 00:16:20.726 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:20.726 "adrfam": "ipv4", 00:16:20.726 "trsvcid": "$NVMF_PORT", 00:16:20.726 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:20.726 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:20.726 "hdgst": ${hdgst:-false}, 00:16:20.726 "ddgst": ${ddgst:-false} 00:16:20.726 }, 00:16:20.726 "method": "bdev_nvme_attach_controller" 00:16:20.726 } 00:16:20.726 EOF 00:16:20.726 )") 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=4019450 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@35 -- # sync 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:16:20.726 20:33:38 -- nvmf/common.sh@542 -- # cat 00:16:20.726 20:33:38 -- nvmf/common.sh@520 -- # config=() 00:16:20.726 20:33:38 -- nvmf/common.sh@520 -- # local subsystem config 00:16:20.726 20:33:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:20.726 20:33:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:20.726 { 00:16:20.726 "params": { 00:16:20.726 "name": "Nvme$subsystem", 00:16:20.726 "trtype": "$TEST_TRANSPORT", 00:16:20.726 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:20.726 "adrfam": "ipv4", 00:16:20.726 "trsvcid": "$NVMF_PORT", 00:16:20.726 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:20.726 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:20.726 "hdgst": ${hdgst:-false}, 00:16:20.726 "ddgst": ${ddgst:-false} 00:16:20.726 }, 00:16:20.726 "method": "bdev_nvme_attach_controller" 00:16:20.726 } 00:16:20.726 EOF 00:16:20.726 )") 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:16:20.726 20:33:38 -- nvmf/common.sh@520 -- # config=() 00:16:20.726 20:33:38 -- nvmf/common.sh@542 -- # cat 00:16:20.726 20:33:38 -- nvmf/common.sh@520 -- # local subsystem config 00:16:20.726 20:33:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:20.726 20:33:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:20.726 { 00:16:20.726 "params": { 00:16:20.726 "name": "Nvme$subsystem", 00:16:20.726 "trtype": "$TEST_TRANSPORT", 00:16:20.726 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:20.726 "adrfam": "ipv4", 00:16:20.726 "trsvcid": "$NVMF_PORT", 00:16:20.726 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:20.726 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:20.726 "hdgst": ${hdgst:-false}, 00:16:20.726 "ddgst": ${ddgst:-false} 00:16:20.726 }, 00:16:20.726 "method": "bdev_nvme_attach_controller" 00:16:20.726 } 00:16:20.726 EOF 00:16:20.726 )") 00:16:20.726 20:33:38 -- nvmf/common.sh@542 -- # cat 00:16:20.726 20:33:38 -- target/bdev_io_wait.sh@37 -- # wait 4019443 00:16:20.726 20:33:38 -- nvmf/common.sh@542 -- # cat 00:16:20.726 20:33:38 -- nvmf/common.sh@544 -- # jq . 00:16:20.726 20:33:38 -- nvmf/common.sh@544 -- # jq . 00:16:20.726 20:33:38 -- nvmf/common.sh@544 -- # jq . 00:16:20.726 20:33:38 -- nvmf/common.sh@545 -- # IFS=, 00:16:20.726 20:33:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:20.726 "params": { 00:16:20.726 "name": "Nvme1", 00:16:20.726 "trtype": "tcp", 00:16:20.726 "traddr": "10.0.0.2", 00:16:20.726 "adrfam": "ipv4", 00:16:20.726 "trsvcid": "4420", 00:16:20.726 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:20.726 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:20.726 "hdgst": false, 00:16:20.726 "ddgst": false 00:16:20.726 }, 00:16:20.726 "method": "bdev_nvme_attach_controller" 00:16:20.726 }' 00:16:20.726 20:33:38 -- nvmf/common.sh@544 -- # jq . 00:16:20.726 20:33:38 -- nvmf/common.sh@545 -- # IFS=, 00:16:20.726 20:33:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:20.726 "params": { 00:16:20.726 "name": "Nvme1", 00:16:20.726 "trtype": "tcp", 00:16:20.726 "traddr": "10.0.0.2", 00:16:20.726 "adrfam": "ipv4", 00:16:20.726 "trsvcid": "4420", 00:16:20.726 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:20.726 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:20.726 "hdgst": false, 00:16:20.726 "ddgst": false 00:16:20.726 }, 00:16:20.726 "method": "bdev_nvme_attach_controller" 00:16:20.726 }' 00:16:20.726 20:33:38 -- nvmf/common.sh@545 -- # IFS=, 00:16:20.726 20:33:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:20.726 "params": { 00:16:20.726 "name": "Nvme1", 00:16:20.727 "trtype": "tcp", 00:16:20.727 "traddr": "10.0.0.2", 00:16:20.727 "adrfam": "ipv4", 00:16:20.727 "trsvcid": "4420", 00:16:20.727 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:20.727 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:20.727 "hdgst": false, 00:16:20.727 "ddgst": false 00:16:20.727 }, 00:16:20.727 "method": "bdev_nvme_attach_controller" 00:16:20.727 }' 00:16:20.727 20:33:38 -- nvmf/common.sh@545 -- # IFS=, 00:16:20.727 20:33:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:20.727 "params": { 00:16:20.727 "name": "Nvme1", 00:16:20.727 "trtype": "tcp", 00:16:20.727 "traddr": "10.0.0.2", 00:16:20.727 "adrfam": "ipv4", 00:16:20.727 "trsvcid": "4420", 00:16:20.727 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:20.727 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:20.727 "hdgst": false, 00:16:20.727 "ddgst": false 00:16:20.727 }, 00:16:20.727 "method": "bdev_nvme_attach_controller" 00:16:20.727 }' 00:16:20.727 [2024-04-26 20:33:38.955392] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:16:20.727 [2024-04-26 20:33:38.955443] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:16:20.727 [2024-04-26 20:33:38.956047] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:16:20.727 [2024-04-26 20:33:38.956091] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:16:20.727 [2024-04-26 20:33:38.956361] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:16:20.727 [2024-04-26 20:33:38.956404] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:16:20.727 [2024-04-26 20:33:38.957071] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:16:20.727 [2024-04-26 20:33:38.957119] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:16:20.727 EAL: No free 2048 kB hugepages reported on node 1 00:16:20.727 EAL: No free 2048 kB hugepages reported on node 1 00:16:20.988 [2024-04-26 20:33:39.094260] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:20.988 EAL: No free 2048 kB hugepages reported on node 1 00:16:20.988 [2024-04-26 20:33:39.142736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:20.988 [2024-04-26 20:33:39.160527] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:20.988 EAL: No free 2048 kB hugepages reported on node 1 00:16:20.988 [2024-04-26 20:33:39.210060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:20.988 [2024-04-26 20:33:39.219829] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:20.988 [2024-04-26 20:33:39.256716] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:20.988 [2024-04-26 20:33:39.270793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:16:20.988 [2024-04-26 20:33:39.305810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:21.249 Running I/O for 1 seconds... 00:16:21.249 Running I/O for 1 seconds... 00:16:21.249 Running I/O for 1 seconds... 00:16:21.249 Running I/O for 1 seconds... 00:16:22.189 00:16:22.189 Latency(us) 00:16:22.190 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:22.190 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:16:22.190 Nvme1n1 : 1.00 21160.90 82.66 0.00 0.00 6034.81 2635.09 12178.77 00:16:22.190 =================================================================================================================== 00:16:22.190 Total : 21160.90 82.66 0.00 0.00 6034.81 2635.09 12178.77 00:16:22.190 00:16:22.190 Latency(us) 00:16:22.190 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:22.190 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:16:22.190 Nvme1n1 : 1.01 12649.82 49.41 0.00 0.00 10085.33 4805.97 21517.65 00:16:22.190 =================================================================================================================== 00:16:22.190 Total : 12649.82 49.41 0.00 0.00 10085.33 4805.97 21517.65 00:16:22.190 00:16:22.190 Latency(us) 00:16:22.190 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:22.190 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:16:22.190 Nvme1n1 : 1.00 191517.01 748.11 0.00 0.00 666.16 264.53 1167.36 00:16:22.190 =================================================================================================================== 00:16:22.190 Total : 191517.01 748.11 0.00 0.00 666.16 264.53 1167.36 00:16:22.190 00:16:22.190 Latency(us) 00:16:22.190 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:22.190 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:16:22.190 Nvme1n1 : 1.00 11563.74 45.17 0.00 0.00 11037.54 4997.12 26760.53 00:16:22.190 =================================================================================================================== 00:16:22.190 Total : 11563.74 45.17 0.00 0.00 11037.54 4997.12 26760.53 00:16:22.451 20:33:40 -- target/bdev_io_wait.sh@38 -- # wait 4019445 00:16:22.451 20:33:40 -- target/bdev_io_wait.sh@39 -- # wait 4019447 00:16:22.451 20:33:40 -- target/bdev_io_wait.sh@40 -- # wait 4019450 00:16:22.451 20:33:40 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:22.451 20:33:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:22.451 20:33:40 -- common/autotest_common.sh@10 -- # set +x 00:16:22.451 20:33:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:22.451 20:33:40 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:16:22.451 20:33:40 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:16:22.451 20:33:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:22.451 20:33:40 -- nvmf/common.sh@116 -- # sync 00:16:22.451 20:33:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:22.451 20:33:40 -- nvmf/common.sh@119 -- # set +e 00:16:22.451 20:33:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:22.451 20:33:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:22.451 rmmod nvme_tcp 00:16:22.451 rmmod nvme_fabrics 00:16:22.451 rmmod nvme_keyring 00:16:22.451 20:33:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:22.451 20:33:40 -- nvmf/common.sh@123 -- # set -e 00:16:22.451 20:33:40 -- nvmf/common.sh@124 -- # return 0 00:16:22.451 20:33:40 -- nvmf/common.sh@477 -- # '[' -n 4019349 ']' 00:16:22.451 20:33:40 -- nvmf/common.sh@478 -- # killprocess 4019349 00:16:22.451 20:33:40 -- common/autotest_common.sh@926 -- # '[' -z 4019349 ']' 00:16:22.451 20:33:40 -- common/autotest_common.sh@930 -- # kill -0 4019349 00:16:22.451 20:33:40 -- common/autotest_common.sh@931 -- # uname 00:16:22.451 20:33:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:22.451 20:33:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4019349 00:16:22.712 20:33:40 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:22.712 20:33:40 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:22.712 20:33:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4019349' 00:16:22.712 killing process with pid 4019349 00:16:22.712 20:33:40 -- common/autotest_common.sh@945 -- # kill 4019349 00:16:22.712 20:33:40 -- common/autotest_common.sh@950 -- # wait 4019349 00:16:22.712 20:33:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:22.712 20:33:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:22.712 20:33:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:22.712 20:33:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:22.712 20:33:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:22.712 20:33:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:22.712 20:33:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:22.712 20:33:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:25.259 20:33:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:25.259 00:16:25.259 real 0m12.247s 00:16:25.259 user 0m18.588s 00:16:25.259 sys 0m6.592s 00:16:25.259 20:33:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:25.259 20:33:42 -- common/autotest_common.sh@10 -- # set +x 00:16:25.259 ************************************ 00:16:25.259 END TEST nvmf_bdev_io_wait 00:16:25.259 ************************************ 00:16:25.259 20:33:43 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:16:25.259 20:33:43 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:25.259 20:33:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:25.259 20:33:43 -- common/autotest_common.sh@10 -- # set +x 00:16:25.259 ************************************ 00:16:25.259 START TEST nvmf_queue_depth 00:16:25.259 ************************************ 00:16:25.259 20:33:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:16:25.259 * Looking for test storage... 00:16:25.259 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:25.259 20:33:43 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:25.259 20:33:43 -- nvmf/common.sh@7 -- # uname -s 00:16:25.259 20:33:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:25.259 20:33:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:25.259 20:33:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:25.259 20:33:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:25.259 20:33:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:25.259 20:33:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:25.259 20:33:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:25.259 20:33:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:25.259 20:33:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:25.259 20:33:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:25.259 20:33:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:25.259 20:33:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:25.259 20:33:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:25.259 20:33:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:25.259 20:33:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:25.259 20:33:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:25.259 20:33:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:25.259 20:33:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:25.259 20:33:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:25.259 20:33:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.259 20:33:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.259 20:33:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.259 20:33:43 -- paths/export.sh@5 -- # export PATH 00:16:25.259 20:33:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.259 20:33:43 -- nvmf/common.sh@46 -- # : 0 00:16:25.259 20:33:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:25.259 20:33:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:25.259 20:33:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:25.259 20:33:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:25.259 20:33:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:25.259 20:33:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:25.259 20:33:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:25.259 20:33:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:25.259 20:33:43 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:16:25.259 20:33:43 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:16:25.259 20:33:43 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:25.259 20:33:43 -- target/queue_depth.sh@19 -- # nvmftestinit 00:16:25.259 20:33:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:25.259 20:33:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:25.259 20:33:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:25.259 20:33:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:25.259 20:33:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:25.259 20:33:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:25.259 20:33:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:25.259 20:33:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:25.259 20:33:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:25.259 20:33:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:25.259 20:33:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:25.259 20:33:43 -- common/autotest_common.sh@10 -- # set +x 00:16:31.885 20:33:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:31.885 20:33:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:31.885 20:33:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:31.885 20:33:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:31.885 20:33:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:31.885 20:33:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:31.885 20:33:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:31.885 20:33:49 -- nvmf/common.sh@294 -- # net_devs=() 00:16:31.885 20:33:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:31.885 20:33:49 -- nvmf/common.sh@295 -- # e810=() 00:16:31.885 20:33:49 -- nvmf/common.sh@295 -- # local -ga e810 00:16:31.885 20:33:49 -- nvmf/common.sh@296 -- # x722=() 00:16:31.885 20:33:49 -- nvmf/common.sh@296 -- # local -ga x722 00:16:31.885 20:33:49 -- nvmf/common.sh@297 -- # mlx=() 00:16:31.885 20:33:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:31.885 20:33:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:31.885 20:33:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:31.885 20:33:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:31.885 20:33:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:31.885 20:33:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:31.885 20:33:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:31.885 20:33:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:31.885 20:33:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:31.885 20:33:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:31.885 20:33:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:31.885 20:33:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:31.885 20:33:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:31.885 20:33:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:31.885 20:33:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:31.885 20:33:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:31.885 20:33:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:16:31.885 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:16:31.885 20:33:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:31.885 20:33:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:16:31.885 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:16:31.885 20:33:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:31.885 20:33:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:31.885 20:33:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:31.885 20:33:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:31.885 20:33:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:31.885 20:33:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:16:31.885 Found net devices under 0000:4b:00.0: cvl_0_0 00:16:31.885 20:33:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:31.885 20:33:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:31.885 20:33:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:31.885 20:33:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:31.885 20:33:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:31.885 20:33:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:16:31.885 Found net devices under 0000:4b:00.1: cvl_0_1 00:16:31.885 20:33:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:31.885 20:33:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:31.885 20:33:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:31.885 20:33:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:31.885 20:33:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:31.885 20:33:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:31.885 20:33:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:31.885 20:33:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:31.885 20:33:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:31.885 20:33:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:31.885 20:33:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:31.885 20:33:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:31.885 20:33:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:31.885 20:33:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:31.885 20:33:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:31.885 20:33:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:31.885 20:33:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:31.885 20:33:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:31.885 20:33:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:31.885 20:33:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:31.885 20:33:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:31.885 20:33:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:31.885 20:33:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:31.885 20:33:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:32.146 20:33:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:32.146 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:32.146 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.561 ms 00:16:32.146 00:16:32.146 --- 10.0.0.2 ping statistics --- 00:16:32.146 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:32.146 rtt min/avg/max/mdev = 0.561/0.561/0.561/0.000 ms 00:16:32.146 20:33:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:32.146 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:32.146 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.418 ms 00:16:32.146 00:16:32.146 --- 10.0.0.1 ping statistics --- 00:16:32.146 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:32.146 rtt min/avg/max/mdev = 0.418/0.418/0.418/0.000 ms 00:16:32.146 20:33:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:32.146 20:33:50 -- nvmf/common.sh@410 -- # return 0 00:16:32.146 20:33:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:32.146 20:33:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:32.146 20:33:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:32.146 20:33:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:32.146 20:33:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:32.146 20:33:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:32.146 20:33:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:32.146 20:33:50 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:16:32.146 20:33:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:32.146 20:33:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:32.146 20:33:50 -- common/autotest_common.sh@10 -- # set +x 00:16:32.146 20:33:50 -- nvmf/common.sh@469 -- # nvmfpid=4024146 00:16:32.146 20:33:50 -- nvmf/common.sh@470 -- # waitforlisten 4024146 00:16:32.146 20:33:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:32.146 20:33:50 -- common/autotest_common.sh@819 -- # '[' -z 4024146 ']' 00:16:32.146 20:33:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:32.146 20:33:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:32.146 20:33:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:32.146 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:32.146 20:33:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:32.146 20:33:50 -- common/autotest_common.sh@10 -- # set +x 00:16:32.146 [2024-04-26 20:33:50.351147] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:16:32.146 [2024-04-26 20:33:50.351240] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:32.146 EAL: No free 2048 kB hugepages reported on node 1 00:16:32.146 [2024-04-26 20:33:50.422649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:32.406 [2024-04-26 20:33:50.495069] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:32.406 [2024-04-26 20:33:50.495198] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:32.406 [2024-04-26 20:33:50.495206] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:32.406 [2024-04-26 20:33:50.495213] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:32.406 [2024-04-26 20:33:50.495231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:32.977 20:33:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:32.977 20:33:51 -- common/autotest_common.sh@852 -- # return 0 00:16:32.977 20:33:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:32.977 20:33:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:32.977 20:33:51 -- common/autotest_common.sh@10 -- # set +x 00:16:32.977 20:33:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:32.977 20:33:51 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:32.977 20:33:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:32.977 20:33:51 -- common/autotest_common.sh@10 -- # set +x 00:16:32.977 [2024-04-26 20:33:51.174155] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:32.977 20:33:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:32.977 20:33:51 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:32.977 20:33:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:32.977 20:33:51 -- common/autotest_common.sh@10 -- # set +x 00:16:32.977 Malloc0 00:16:32.977 20:33:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:32.977 20:33:51 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:32.977 20:33:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:32.977 20:33:51 -- common/autotest_common.sh@10 -- # set +x 00:16:32.977 20:33:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:32.977 20:33:51 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:32.977 20:33:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:32.977 20:33:51 -- common/autotest_common.sh@10 -- # set +x 00:16:32.977 20:33:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:32.977 20:33:51 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:32.977 20:33:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:32.977 20:33:51 -- common/autotest_common.sh@10 -- # set +x 00:16:32.977 [2024-04-26 20:33:51.250264] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:32.977 20:33:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:32.977 20:33:51 -- target/queue_depth.sh@30 -- # bdevperf_pid=4024204 00:16:32.977 20:33:51 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:32.977 20:33:51 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:16:32.977 20:33:51 -- target/queue_depth.sh@33 -- # waitforlisten 4024204 /var/tmp/bdevperf.sock 00:16:32.977 20:33:51 -- common/autotest_common.sh@819 -- # '[' -z 4024204 ']' 00:16:32.977 20:33:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:32.977 20:33:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:32.977 20:33:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:32.977 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:32.977 20:33:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:32.977 20:33:51 -- common/autotest_common.sh@10 -- # set +x 00:16:32.977 [2024-04-26 20:33:51.297199] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:16:32.977 [2024-04-26 20:33:51.297245] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4024204 ] 00:16:33.237 EAL: No free 2048 kB hugepages reported on node 1 00:16:33.237 [2024-04-26 20:33:51.355177] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:33.237 [2024-04-26 20:33:51.418221] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:33.808 20:33:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:33.808 20:33:52 -- common/autotest_common.sh@852 -- # return 0 00:16:33.808 20:33:52 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:16:33.808 20:33:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:33.808 20:33:52 -- common/autotest_common.sh@10 -- # set +x 00:16:34.068 NVMe0n1 00:16:34.068 20:33:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:34.068 20:33:52 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:16:34.069 Running I/O for 10 seconds... 00:16:46.303 00:16:46.303 Latency(us) 00:16:46.303 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:46.303 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:16:46.303 Verification LBA range: start 0x0 length 0x4000 00:16:46.303 NVMe0n1 : 10.06 14337.03 56.00 0.00 0.00 71167.56 15291.73 55050.24 00:16:46.303 =================================================================================================================== 00:16:46.303 Total : 14337.03 56.00 0.00 0.00 71167.56 15291.73 55050.24 00:16:46.303 0 00:16:46.303 20:34:02 -- target/queue_depth.sh@39 -- # killprocess 4024204 00:16:46.303 20:34:02 -- common/autotest_common.sh@926 -- # '[' -z 4024204 ']' 00:16:46.303 20:34:02 -- common/autotest_common.sh@930 -- # kill -0 4024204 00:16:46.303 20:34:02 -- common/autotest_common.sh@931 -- # uname 00:16:46.303 20:34:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:46.303 20:34:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4024204 00:16:46.303 20:34:02 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:46.303 20:34:02 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:46.303 20:34:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4024204' 00:16:46.303 killing process with pid 4024204 00:16:46.303 20:34:02 -- common/autotest_common.sh@945 -- # kill 4024204 00:16:46.303 Received shutdown signal, test time was about 10.000000 seconds 00:16:46.303 00:16:46.303 Latency(us) 00:16:46.303 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:46.303 =================================================================================================================== 00:16:46.303 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:46.303 20:34:02 -- common/autotest_common.sh@950 -- # wait 4024204 00:16:46.303 20:34:02 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:16:46.303 20:34:02 -- target/queue_depth.sh@43 -- # nvmftestfini 00:16:46.303 20:34:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:46.303 20:34:02 -- nvmf/common.sh@116 -- # sync 00:16:46.303 20:34:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:46.303 20:34:02 -- nvmf/common.sh@119 -- # set +e 00:16:46.303 20:34:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:46.303 20:34:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:46.303 rmmod nvme_tcp 00:16:46.303 rmmod nvme_fabrics 00:16:46.303 rmmod nvme_keyring 00:16:46.303 20:34:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:46.303 20:34:02 -- nvmf/common.sh@123 -- # set -e 00:16:46.303 20:34:02 -- nvmf/common.sh@124 -- # return 0 00:16:46.303 20:34:02 -- nvmf/common.sh@477 -- # '[' -n 4024146 ']' 00:16:46.303 20:34:02 -- nvmf/common.sh@478 -- # killprocess 4024146 00:16:46.303 20:34:02 -- common/autotest_common.sh@926 -- # '[' -z 4024146 ']' 00:16:46.303 20:34:02 -- common/autotest_common.sh@930 -- # kill -0 4024146 00:16:46.303 20:34:02 -- common/autotest_common.sh@931 -- # uname 00:16:46.303 20:34:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:46.303 20:34:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4024146 00:16:46.303 20:34:02 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:16:46.303 20:34:02 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:16:46.303 20:34:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4024146' 00:16:46.303 killing process with pid 4024146 00:16:46.303 20:34:02 -- common/autotest_common.sh@945 -- # kill 4024146 00:16:46.303 20:34:02 -- common/autotest_common.sh@950 -- # wait 4024146 00:16:46.303 20:34:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:46.303 20:34:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:46.303 20:34:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:46.303 20:34:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:46.303 20:34:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:46.303 20:34:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:46.303 20:34:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:46.303 20:34:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:46.874 20:34:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:46.874 00:16:46.874 real 0m21.946s 00:16:46.874 user 0m25.768s 00:16:46.874 sys 0m6.284s 00:16:46.874 20:34:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:46.874 20:34:04 -- common/autotest_common.sh@10 -- # set +x 00:16:46.874 ************************************ 00:16:46.874 END TEST nvmf_queue_depth 00:16:46.874 ************************************ 00:16:46.874 20:34:05 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:16:46.874 20:34:05 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:46.874 20:34:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:46.874 20:34:05 -- common/autotest_common.sh@10 -- # set +x 00:16:46.874 ************************************ 00:16:46.874 START TEST nvmf_multipath 00:16:46.874 ************************************ 00:16:46.874 20:34:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:16:46.874 * Looking for test storage... 00:16:46.874 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:46.874 20:34:05 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:46.874 20:34:05 -- nvmf/common.sh@7 -- # uname -s 00:16:46.874 20:34:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:46.874 20:34:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:46.874 20:34:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:46.874 20:34:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:46.874 20:34:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:46.874 20:34:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:46.874 20:34:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:46.874 20:34:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:46.874 20:34:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:46.874 20:34:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:46.874 20:34:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:46.874 20:34:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:46.874 20:34:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:46.874 20:34:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:46.874 20:34:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:46.874 20:34:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:46.874 20:34:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:46.874 20:34:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:46.874 20:34:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:46.874 20:34:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:46.874 20:34:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:46.874 20:34:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:46.874 20:34:05 -- paths/export.sh@5 -- # export PATH 00:16:46.874 20:34:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:46.874 20:34:05 -- nvmf/common.sh@46 -- # : 0 00:16:46.874 20:34:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:46.874 20:34:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:46.874 20:34:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:46.874 20:34:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:46.874 20:34:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:46.874 20:34:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:46.874 20:34:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:46.874 20:34:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:46.874 20:34:05 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:46.874 20:34:05 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:46.874 20:34:05 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:16:46.874 20:34:05 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:46.874 20:34:05 -- target/multipath.sh@43 -- # nvmftestinit 00:16:46.874 20:34:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:46.874 20:34:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:46.874 20:34:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:46.874 20:34:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:46.874 20:34:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:46.874 20:34:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:46.874 20:34:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:46.874 20:34:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:46.874 20:34:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:46.874 20:34:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:46.874 20:34:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:46.874 20:34:05 -- common/autotest_common.sh@10 -- # set +x 00:16:53.460 20:34:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:53.460 20:34:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:53.460 20:34:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:53.460 20:34:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:53.460 20:34:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:53.460 20:34:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:53.460 20:34:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:53.460 20:34:11 -- nvmf/common.sh@294 -- # net_devs=() 00:16:53.460 20:34:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:53.460 20:34:11 -- nvmf/common.sh@295 -- # e810=() 00:16:53.460 20:34:11 -- nvmf/common.sh@295 -- # local -ga e810 00:16:53.460 20:34:11 -- nvmf/common.sh@296 -- # x722=() 00:16:53.460 20:34:11 -- nvmf/common.sh@296 -- # local -ga x722 00:16:53.460 20:34:11 -- nvmf/common.sh@297 -- # mlx=() 00:16:53.460 20:34:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:53.460 20:34:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:53.460 20:34:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:53.460 20:34:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:53.460 20:34:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:53.460 20:34:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:53.460 20:34:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:53.460 20:34:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:53.460 20:34:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:53.460 20:34:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:53.460 20:34:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:53.460 20:34:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:53.460 20:34:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:53.460 20:34:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:53.460 20:34:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:53.460 20:34:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:53.460 20:34:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:16:53.460 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:16:53.460 20:34:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:53.460 20:34:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:16:53.460 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:16:53.460 20:34:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:53.460 20:34:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:53.460 20:34:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:53.460 20:34:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:53.460 20:34:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:53.460 20:34:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:16:53.460 Found net devices under 0000:4b:00.0: cvl_0_0 00:16:53.460 20:34:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:53.460 20:34:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:53.460 20:34:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:53.460 20:34:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:53.460 20:34:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:53.460 20:34:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:16:53.460 Found net devices under 0000:4b:00.1: cvl_0_1 00:16:53.460 20:34:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:53.460 20:34:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:53.460 20:34:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:53.460 20:34:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:53.460 20:34:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:53.460 20:34:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:53.460 20:34:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:53.460 20:34:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:53.460 20:34:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:53.460 20:34:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:53.460 20:34:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:53.460 20:34:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:53.460 20:34:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:53.460 20:34:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:53.460 20:34:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:53.460 20:34:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:53.460 20:34:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:53.460 20:34:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:53.460 20:34:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:53.460 20:34:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:53.460 20:34:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:53.460 20:34:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:53.460 20:34:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:53.460 20:34:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:53.460 20:34:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:53.460 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:53.460 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.451 ms 00:16:53.460 00:16:53.460 --- 10.0.0.2 ping statistics --- 00:16:53.460 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:53.460 rtt min/avg/max/mdev = 0.451/0.451/0.451/0.000 ms 00:16:53.460 20:34:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:53.721 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:53.721 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.392 ms 00:16:53.721 00:16:53.721 --- 10.0.0.1 ping statistics --- 00:16:53.721 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:53.721 rtt min/avg/max/mdev = 0.392/0.392/0.392/0.000 ms 00:16:53.721 20:34:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:53.721 20:34:11 -- nvmf/common.sh@410 -- # return 0 00:16:53.721 20:34:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:53.721 20:34:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:53.721 20:34:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:53.721 20:34:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:53.721 20:34:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:53.721 20:34:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:53.722 20:34:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:53.722 20:34:11 -- target/multipath.sh@45 -- # '[' -z ']' 00:16:53.722 20:34:11 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:16:53.722 only one NIC for nvmf test 00:16:53.722 20:34:11 -- target/multipath.sh@47 -- # nvmftestfini 00:16:53.722 20:34:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:53.722 20:34:11 -- nvmf/common.sh@116 -- # sync 00:16:53.722 20:34:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:53.722 20:34:11 -- nvmf/common.sh@119 -- # set +e 00:16:53.722 20:34:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:53.722 20:34:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:53.722 rmmod nvme_tcp 00:16:53.722 rmmod nvme_fabrics 00:16:53.722 rmmod nvme_keyring 00:16:53.722 20:34:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:53.722 20:34:11 -- nvmf/common.sh@123 -- # set -e 00:16:53.722 20:34:11 -- nvmf/common.sh@124 -- # return 0 00:16:53.722 20:34:11 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:16:53.722 20:34:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:53.722 20:34:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:53.722 20:34:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:53.722 20:34:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:53.722 20:34:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:53.722 20:34:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:53.722 20:34:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:53.722 20:34:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:55.653 20:34:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:55.653 20:34:13 -- target/multipath.sh@48 -- # exit 0 00:16:55.653 20:34:13 -- target/multipath.sh@1 -- # nvmftestfini 00:16:55.653 20:34:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:55.653 20:34:13 -- nvmf/common.sh@116 -- # sync 00:16:55.653 20:34:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:55.653 20:34:13 -- nvmf/common.sh@119 -- # set +e 00:16:55.653 20:34:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:55.653 20:34:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:55.653 20:34:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:55.653 20:34:13 -- nvmf/common.sh@123 -- # set -e 00:16:55.653 20:34:13 -- nvmf/common.sh@124 -- # return 0 00:16:55.653 20:34:13 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:16:55.915 20:34:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:55.915 20:34:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:55.915 20:34:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:55.915 20:34:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:55.915 20:34:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:55.915 20:34:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:55.915 20:34:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:55.915 20:34:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:55.915 20:34:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:55.915 00:16:55.915 real 0m8.972s 00:16:55.915 user 0m1.881s 00:16:55.915 sys 0m4.967s 00:16:55.915 20:34:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:55.915 20:34:14 -- common/autotest_common.sh@10 -- # set +x 00:16:55.915 ************************************ 00:16:55.915 END TEST nvmf_multipath 00:16:55.915 ************************************ 00:16:55.915 20:34:14 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:55.915 20:34:14 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:55.915 20:34:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:55.915 20:34:14 -- common/autotest_common.sh@10 -- # set +x 00:16:55.915 ************************************ 00:16:55.915 START TEST nvmf_zcopy 00:16:55.915 ************************************ 00:16:55.915 20:34:14 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:55.915 * Looking for test storage... 00:16:55.915 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:55.915 20:34:14 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:55.915 20:34:14 -- nvmf/common.sh@7 -- # uname -s 00:16:55.915 20:34:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:55.915 20:34:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:55.915 20:34:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:55.915 20:34:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:55.915 20:34:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:55.915 20:34:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:55.915 20:34:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:55.915 20:34:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:55.915 20:34:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:55.915 20:34:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:55.915 20:34:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:55.915 20:34:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:55.915 20:34:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:55.915 20:34:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:55.915 20:34:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:55.915 20:34:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:55.915 20:34:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:55.915 20:34:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:55.915 20:34:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:55.915 20:34:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:55.915 20:34:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:55.916 20:34:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:55.916 20:34:14 -- paths/export.sh@5 -- # export PATH 00:16:55.916 20:34:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:55.916 20:34:14 -- nvmf/common.sh@46 -- # : 0 00:16:55.916 20:34:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:55.916 20:34:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:55.916 20:34:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:55.916 20:34:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:55.916 20:34:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:55.916 20:34:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:55.916 20:34:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:55.916 20:34:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:55.916 20:34:14 -- target/zcopy.sh@12 -- # nvmftestinit 00:16:55.916 20:34:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:55.916 20:34:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:55.916 20:34:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:55.916 20:34:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:55.916 20:34:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:55.916 20:34:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:55.916 20:34:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:55.916 20:34:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:55.916 20:34:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:55.916 20:34:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:55.916 20:34:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:55.916 20:34:14 -- common/autotest_common.sh@10 -- # set +x 00:17:04.062 20:34:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:04.062 20:34:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:04.062 20:34:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:04.062 20:34:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:04.062 20:34:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:04.062 20:34:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:04.062 20:34:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:04.062 20:34:20 -- nvmf/common.sh@294 -- # net_devs=() 00:17:04.062 20:34:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:04.062 20:34:20 -- nvmf/common.sh@295 -- # e810=() 00:17:04.062 20:34:20 -- nvmf/common.sh@295 -- # local -ga e810 00:17:04.062 20:34:20 -- nvmf/common.sh@296 -- # x722=() 00:17:04.062 20:34:20 -- nvmf/common.sh@296 -- # local -ga x722 00:17:04.062 20:34:20 -- nvmf/common.sh@297 -- # mlx=() 00:17:04.062 20:34:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:04.062 20:34:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:04.062 20:34:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:04.062 20:34:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:04.062 20:34:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:04.062 20:34:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:04.062 20:34:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:04.062 20:34:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:04.062 20:34:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:04.062 20:34:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:04.062 20:34:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:04.062 20:34:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:04.062 20:34:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:04.062 20:34:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:04.062 20:34:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:04.062 20:34:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:04.062 20:34:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:17:04.062 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:17:04.062 20:34:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:04.062 20:34:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:17:04.062 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:17:04.062 20:34:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:04.062 20:34:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:04.062 20:34:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:04.062 20:34:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:04.062 20:34:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:04.062 20:34:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:17:04.062 Found net devices under 0000:4b:00.0: cvl_0_0 00:17:04.062 20:34:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:04.062 20:34:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:04.062 20:34:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:04.062 20:34:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:04.062 20:34:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:04.062 20:34:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:17:04.062 Found net devices under 0000:4b:00.1: cvl_0_1 00:17:04.062 20:34:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:04.062 20:34:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:04.062 20:34:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:04.062 20:34:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:04.062 20:34:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:04.062 20:34:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:04.062 20:34:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:04.062 20:34:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:04.062 20:34:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:04.062 20:34:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:04.062 20:34:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:04.062 20:34:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:04.062 20:34:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:04.062 20:34:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:04.062 20:34:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:04.062 20:34:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:04.062 20:34:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:04.062 20:34:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:04.062 20:34:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:04.062 20:34:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:04.062 20:34:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:04.062 20:34:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:04.062 20:34:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:04.062 20:34:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:04.062 20:34:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:04.062 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:04.062 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.535 ms 00:17:04.062 00:17:04.062 --- 10.0.0.2 ping statistics --- 00:17:04.062 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:04.062 rtt min/avg/max/mdev = 0.535/0.535/0.535/0.000 ms 00:17:04.062 20:34:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:04.062 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:04.062 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.388 ms 00:17:04.062 00:17:04.062 --- 10.0.0.1 ping statistics --- 00:17:04.062 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:04.062 rtt min/avg/max/mdev = 0.388/0.388/0.388/0.000 ms 00:17:04.062 20:34:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:04.062 20:34:21 -- nvmf/common.sh@410 -- # return 0 00:17:04.062 20:34:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:04.062 20:34:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:04.062 20:34:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:04.062 20:34:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:04.062 20:34:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:04.062 20:34:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:04.062 20:34:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:04.062 20:34:21 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:17:04.062 20:34:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:04.062 20:34:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:04.062 20:34:21 -- common/autotest_common.sh@10 -- # set +x 00:17:04.062 20:34:21 -- nvmf/common.sh@469 -- # nvmfpid=4034777 00:17:04.062 20:34:21 -- nvmf/common.sh@470 -- # waitforlisten 4034777 00:17:04.062 20:34:21 -- common/autotest_common.sh@819 -- # '[' -z 4034777 ']' 00:17:04.062 20:34:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:04.062 20:34:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:04.062 20:34:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:04.062 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:04.062 20:34:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:04.062 20:34:21 -- common/autotest_common.sh@10 -- # set +x 00:17:04.062 20:34:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:04.062 [2024-04-26 20:34:21.279549] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:17:04.062 [2024-04-26 20:34:21.279610] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:04.062 EAL: No free 2048 kB hugepages reported on node 1 00:17:04.062 [2024-04-26 20:34:21.351939] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:04.062 [2024-04-26 20:34:21.423154] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:04.062 [2024-04-26 20:34:21.423273] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:04.062 [2024-04-26 20:34:21.423290] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:04.062 [2024-04-26 20:34:21.423297] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:04.062 [2024-04-26 20:34:21.423320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:04.062 20:34:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:04.062 20:34:22 -- common/autotest_common.sh@852 -- # return 0 00:17:04.062 20:34:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:04.062 20:34:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:04.062 20:34:22 -- common/autotest_common.sh@10 -- # set +x 00:17:04.062 20:34:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:04.062 20:34:22 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:17:04.062 20:34:22 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:17:04.062 20:34:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:04.062 20:34:22 -- common/autotest_common.sh@10 -- # set +x 00:17:04.062 [2024-04-26 20:34:22.086059] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:04.062 20:34:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:04.062 20:34:22 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:17:04.062 20:34:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:04.062 20:34:22 -- common/autotest_common.sh@10 -- # set +x 00:17:04.062 20:34:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:04.062 20:34:22 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:04.062 20:34:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:04.062 20:34:22 -- common/autotest_common.sh@10 -- # set +x 00:17:04.062 [2024-04-26 20:34:22.102175] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:04.062 20:34:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:04.062 20:34:22 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:04.062 20:34:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:04.062 20:34:22 -- common/autotest_common.sh@10 -- # set +x 00:17:04.062 20:34:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:04.062 20:34:22 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:17:04.062 20:34:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:04.062 20:34:22 -- common/autotest_common.sh@10 -- # set +x 00:17:04.062 malloc0 00:17:04.062 20:34:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:04.062 20:34:22 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:04.062 20:34:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:04.062 20:34:22 -- common/autotest_common.sh@10 -- # set +x 00:17:04.062 20:34:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:04.062 20:34:22 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:17:04.062 20:34:22 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:17:04.062 20:34:22 -- nvmf/common.sh@520 -- # config=() 00:17:04.062 20:34:22 -- nvmf/common.sh@520 -- # local subsystem config 00:17:04.062 20:34:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:04.062 20:34:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:04.062 { 00:17:04.062 "params": { 00:17:04.062 "name": "Nvme$subsystem", 00:17:04.062 "trtype": "$TEST_TRANSPORT", 00:17:04.062 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.062 "adrfam": "ipv4", 00:17:04.062 "trsvcid": "$NVMF_PORT", 00:17:04.062 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.062 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.062 "hdgst": ${hdgst:-false}, 00:17:04.062 "ddgst": ${ddgst:-false} 00:17:04.062 }, 00:17:04.062 "method": "bdev_nvme_attach_controller" 00:17:04.062 } 00:17:04.062 EOF 00:17:04.062 )") 00:17:04.062 20:34:22 -- nvmf/common.sh@542 -- # cat 00:17:04.062 20:34:22 -- nvmf/common.sh@544 -- # jq . 00:17:04.062 20:34:22 -- nvmf/common.sh@545 -- # IFS=, 00:17:04.062 20:34:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:04.063 "params": { 00:17:04.063 "name": "Nvme1", 00:17:04.063 "trtype": "tcp", 00:17:04.063 "traddr": "10.0.0.2", 00:17:04.063 "adrfam": "ipv4", 00:17:04.063 "trsvcid": "4420", 00:17:04.063 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:04.063 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:04.063 "hdgst": false, 00:17:04.063 "ddgst": false 00:17:04.063 }, 00:17:04.063 "method": "bdev_nvme_attach_controller" 00:17:04.063 }' 00:17:04.063 [2024-04-26 20:34:22.175309] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:17:04.063 [2024-04-26 20:34:22.175357] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4034905 ] 00:17:04.063 EAL: No free 2048 kB hugepages reported on node 1 00:17:04.063 [2024-04-26 20:34:22.232919] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:04.063 [2024-04-26 20:34:22.295321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:04.323 Running I/O for 10 seconds... 00:17:14.322 00:17:14.322 Latency(us) 00:17:14.322 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:14.322 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:17:14.322 Verification LBA range: start 0x0 length 0x1000 00:17:14.322 Nvme1n1 : 10.01 10161.38 79.39 0.00 0.00 12565.35 1938.77 26651.31 00:17:14.322 =================================================================================================================== 00:17:14.322 Total : 10161.38 79.39 0.00 0.00 12565.35 1938.77 26651.31 00:17:14.322 20:34:32 -- target/zcopy.sh@39 -- # perfpid=4036931 00:17:14.322 20:34:32 -- target/zcopy.sh@41 -- # xtrace_disable 00:17:14.322 20:34:32 -- common/autotest_common.sh@10 -- # set +x 00:17:14.322 20:34:32 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:17:14.322 20:34:32 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:17:14.322 20:34:32 -- nvmf/common.sh@520 -- # config=() 00:17:14.322 20:34:32 -- nvmf/common.sh@520 -- # local subsystem config 00:17:14.322 20:34:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:14.322 20:34:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:14.322 { 00:17:14.322 "params": { 00:17:14.322 "name": "Nvme$subsystem", 00:17:14.322 "trtype": "$TEST_TRANSPORT", 00:17:14.322 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:14.322 "adrfam": "ipv4", 00:17:14.322 "trsvcid": "$NVMF_PORT", 00:17:14.322 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:14.322 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:14.322 "hdgst": ${hdgst:-false}, 00:17:14.322 "ddgst": ${ddgst:-false} 00:17:14.322 }, 00:17:14.322 "method": "bdev_nvme_attach_controller" 00:17:14.322 } 00:17:14.322 EOF 00:17:14.322 )") 00:17:14.322 [2024-04-26 20:34:32.654326] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.323 [2024-04-26 20:34:32.654358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.323 20:34:32 -- nvmf/common.sh@542 -- # cat 00:17:14.323 20:34:32 -- nvmf/common.sh@544 -- # jq . 00:17:14.323 [2024-04-26 20:34:32.662325] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.323 [2024-04-26 20:34:32.662336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.323 20:34:32 -- nvmf/common.sh@545 -- # IFS=, 00:17:14.323 20:34:32 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:14.323 "params": { 00:17:14.323 "name": "Nvme1", 00:17:14.323 "trtype": "tcp", 00:17:14.323 "traddr": "10.0.0.2", 00:17:14.323 "adrfam": "ipv4", 00:17:14.323 "trsvcid": "4420", 00:17:14.323 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:14.323 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:14.323 "hdgst": false, 00:17:14.323 "ddgst": false 00:17:14.323 }, 00:17:14.323 "method": "bdev_nvme_attach_controller" 00:17:14.323 }' 00:17:14.584 [2024-04-26 20:34:32.670343] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.670353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.678363] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.678373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.686385] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.686395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.693776] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:17:14.584 [2024-04-26 20:34:32.693825] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4036931 ] 00:17:14.584 [2024-04-26 20:34:32.694406] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.694415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.702425] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.702437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.710446] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.710456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.718468] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.718478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 EAL: No free 2048 kB hugepages reported on node 1 00:17:14.584 [2024-04-26 20:34:32.726488] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.726499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.734510] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.734520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.742530] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.742540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.750552] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.750562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.751722] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:14.584 [2024-04-26 20:34:32.758573] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.758584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.766593] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.766604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.774617] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.774628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.782638] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.782650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.790660] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.790673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.798683] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.798693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.806703] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.806715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.814156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:14.584 [2024-04-26 20:34:32.814724] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.814734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.822746] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.822757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.830775] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.830788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.838791] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.838803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.846813] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.846826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.854833] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.854844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.584 [2024-04-26 20:34:32.862857] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.584 [2024-04-26 20:34:32.862867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.585 [2024-04-26 20:34:32.870877] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.585 [2024-04-26 20:34:32.870888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.585 [2024-04-26 20:34:32.878896] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.585 [2024-04-26 20:34:32.878906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.585 [2024-04-26 20:34:32.886923] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.585 [2024-04-26 20:34:32.886937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.585 [2024-04-26 20:34:32.894949] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.585 [2024-04-26 20:34:32.894963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.585 [2024-04-26 20:34:32.906978] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.585 [2024-04-26 20:34:32.906990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.585 [2024-04-26 20:34:32.914998] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.585 [2024-04-26 20:34:32.915011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.585 [2024-04-26 20:34:32.923019] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.585 [2024-04-26 20:34:32.923031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:32.931040] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:32.931052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:32.939061] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:32.939071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:32.947081] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:32.947091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:32.955101] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:32.955111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:32.963123] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:32.963133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:32.971149] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:32.971162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:32.979170] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:32.979180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:32.987190] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:32.987201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:32.995210] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:32.995220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:33.003229] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:33.003240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:33.011254] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:33.011264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:33.019281] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:33.019294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:33.027305] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:33.027316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:33.035328] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:33.035339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:33.043344] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:33.043355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:33.051368] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:33.051378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:33.059389] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:33.059400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:33.110912] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:33.110929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:33.115552] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:33.115565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:33.123576] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:33.123588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 Running I/O for 5 seconds... 00:17:14.846 [2024-04-26 20:34:33.139454] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:33.139475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.846 [2024-04-26 20:34:33.148515] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.846 [2024-04-26 20:34:33.148536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.847 [2024-04-26 20:34:33.159265] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.847 [2024-04-26 20:34:33.159291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.847 [2024-04-26 20:34:33.170664] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.847 [2024-04-26 20:34:33.170685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.847 [2024-04-26 20:34:33.179186] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.847 [2024-04-26 20:34:33.179208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.190643] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.190668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.199704] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.199725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.211012] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.211033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.221400] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.221419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.229289] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.229309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.240900] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.240921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.249885] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.249908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.261269] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.261299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.271788] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.271808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.279597] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.279620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.291646] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.291668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.302934] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.302955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.311421] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.311441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.322726] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.322746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.333218] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.333238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.341256] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.341281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.352470] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.352494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.362878] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.362898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.370734] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.370754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.382295] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.382316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.391214] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.391234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.400536] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.400559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.410060] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.410080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.419472] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.419491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.428714] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.428738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.437818] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.437838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.107 [2024-04-26 20:34:33.446965] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.107 [2024-04-26 20:34:33.446984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.456314] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.456334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.465785] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.465805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.475308] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.475327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.484944] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.484963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.494235] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.494255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.503372] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.503394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.512670] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.512689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.522009] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.522029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.531444] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.531465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.540725] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.540745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.549929] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.549948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.559379] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.559398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.569042] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.569062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.578533] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.578553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.368 [2024-04-26 20:34:33.588035] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.368 [2024-04-26 20:34:33.588054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.369 [2024-04-26 20:34:33.597274] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.369 [2024-04-26 20:34:33.597303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.369 [2024-04-26 20:34:33.606499] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.369 [2024-04-26 20:34:33.606522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.369 [2024-04-26 20:34:33.615602] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.369 [2024-04-26 20:34:33.615623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.369 [2024-04-26 20:34:33.625013] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.369 [2024-04-26 20:34:33.625032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.369 [2024-04-26 20:34:33.634671] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.369 [2024-04-26 20:34:33.634690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.369 [2024-04-26 20:34:33.643904] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.369 [2024-04-26 20:34:33.643923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.369 [2024-04-26 20:34:33.653183] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.369 [2024-04-26 20:34:33.653202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.369 [2024-04-26 20:34:33.662853] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.369 [2024-04-26 20:34:33.662872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.369 [2024-04-26 20:34:33.672270] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.369 [2024-04-26 20:34:33.672297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.369 [2024-04-26 20:34:33.681757] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.369 [2024-04-26 20:34:33.681777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.369 [2024-04-26 20:34:33.690981] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.369 [2024-04-26 20:34:33.691001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.369 [2024-04-26 20:34:33.700364] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.369 [2024-04-26 20:34:33.700383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.369 [2024-04-26 20:34:33.709636] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.369 [2024-04-26 20:34:33.709657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.630 [2024-04-26 20:34:33.719169] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.630 [2024-04-26 20:34:33.719188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.630 [2024-04-26 20:34:33.728550] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.630 [2024-04-26 20:34:33.728571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.630 [2024-04-26 20:34:33.737896] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.630 [2024-04-26 20:34:33.737916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.630 [2024-04-26 20:34:33.747304] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.630 [2024-04-26 20:34:33.747323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.630 [2024-04-26 20:34:33.756540] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.630 [2024-04-26 20:34:33.756560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.765920] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.765940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.775119] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.775138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.784463] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.784487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.793781] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.793801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.803080] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.803102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.812328] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.812347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.821579] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.821599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.830805] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.830828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.839830] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.839849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.848921] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.848941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.858428] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.858447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.867707] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.867727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.876421] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.876441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.885852] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.885871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.895213] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.895232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.904536] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.904557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.913556] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.913576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.922774] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.922794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.932106] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.932125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.941589] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.941608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.950952] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.950972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.959956] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.959979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.631 [2024-04-26 20:34:33.969582] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.631 [2024-04-26 20:34:33.969601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.893 [2024-04-26 20:34:33.979004] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.893 [2024-04-26 20:34:33.979024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.893 [2024-04-26 20:34:33.988303] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.893 [2024-04-26 20:34:33.988323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.893 [2024-04-26 20:34:33.997632] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.893 [2024-04-26 20:34:33.997651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.893 [2024-04-26 20:34:34.006952] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.893 [2024-04-26 20:34:34.006971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.893 [2024-04-26 20:34:34.016239] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.893 [2024-04-26 20:34:34.016258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.893 [2024-04-26 20:34:34.025212] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.893 [2024-04-26 20:34:34.025232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.893 [2024-04-26 20:34:34.034623] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.893 [2024-04-26 20:34:34.034642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.893 [2024-04-26 20:34:34.043764] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.893 [2024-04-26 20:34:34.043783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.893 [2024-04-26 20:34:34.053168] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.893 [2024-04-26 20:34:34.053187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.893 [2024-04-26 20:34:34.062575] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.893 [2024-04-26 20:34:34.062598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.893 [2024-04-26 20:34:34.071711] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.893 [2024-04-26 20:34:34.071730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.893 [2024-04-26 20:34:34.081052] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.893 [2024-04-26 20:34:34.081072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.090380] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.090399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.099674] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.099694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.109172] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.109191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.118365] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.118384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.127810] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.127829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.137008] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.137030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.146569] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.146592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.155737] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.155757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.164966] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.164986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.174407] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.174428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.183712] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.183731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.192831] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.192850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.202089] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.202108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.211354] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.211373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.220724] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.220747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:15.894 [2024-04-26 20:34:34.230106] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:15.894 [2024-04-26 20:34:34.230125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.155 [2024-04-26 20:34:34.239433] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.155 [2024-04-26 20:34:34.239453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.155 [2024-04-26 20:34:34.248840] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.155 [2024-04-26 20:34:34.248860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.258048] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.258068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.267575] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.267595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.277139] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.277158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.286270] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.286296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.295627] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.295646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.304802] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.304820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.314335] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.314359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.323749] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.323771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.333044] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.333063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.342304] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.342324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.351630] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.351649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.360826] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.360844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.370261] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.370287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.379787] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.379807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.389449] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.389469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.398825] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.398845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.410192] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.410212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.418505] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.418523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.428418] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.428438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.437563] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.437582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.446907] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.446926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.456373] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.456393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.465743] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.465764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.475095] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.475116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.484576] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.484596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.156 [2024-04-26 20:34:34.494070] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.156 [2024-04-26 20:34:34.494095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.502827] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.502849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.512628] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.512650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.521843] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.521863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.533147] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.533171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.540995] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.541015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.552579] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.552600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.561694] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.561714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.572885] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.572905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.581202] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.581221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.592490] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.592513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.601549] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.601568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.610841] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.610864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.620116] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.620136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.629554] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.629578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.639146] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.639170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.648623] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.648643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.657964] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.657984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.672222] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.672243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.683317] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.683340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.699028] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.699048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.715710] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.715730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.731971] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.731992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.417 [2024-04-26 20:34:34.748522] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.417 [2024-04-26 20:34:34.748542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.765331] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.765351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.782266] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.782296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.798017] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.798040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.809891] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.809912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.826378] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.826398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.843391] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.843411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.860366] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.860386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.877404] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.877427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.894838] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.894858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.910828] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.910849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.928120] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.928141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.945400] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.945423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.962314] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.962337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.979263] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.979293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:34.996961] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:34.996982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.678 [2024-04-26 20:34:35.013874] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.678 [2024-04-26 20:34:35.013895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.030489] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.940 [2024-04-26 20:34:35.030509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.047363] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.940 [2024-04-26 20:34:35.047383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.064101] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.940 [2024-04-26 20:34:35.064120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.081232] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.940 [2024-04-26 20:34:35.081254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.096991] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.940 [2024-04-26 20:34:35.097011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.114275] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.940 [2024-04-26 20:34:35.114305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.130906] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.940 [2024-04-26 20:34:35.130930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.148115] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.940 [2024-04-26 20:34:35.148135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.165100] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.940 [2024-04-26 20:34:35.165124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.182073] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.940 [2024-04-26 20:34:35.182093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.198439] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.940 [2024-04-26 20:34:35.198459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.215514] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.940 [2024-04-26 20:34:35.215534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.232467] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.940 [2024-04-26 20:34:35.232487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.940 [2024-04-26 20:34:35.249489] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.941 [2024-04-26 20:34:35.249510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.941 [2024-04-26 20:34:35.266168] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.941 [2024-04-26 20:34:35.266188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:16.941 [2024-04-26 20:34:35.283026] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:16.941 [2024-04-26 20:34:35.283047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.300161] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.300186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.317108] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.317127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.333891] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.333914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.350625] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.350644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.367388] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.367407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.384231] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.384250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.400942] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.400966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.417713] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.417733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.434970] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.434993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.451799] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.451818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.468909] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.468929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.485127] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.485146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.502211] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.502231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.519028] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.519048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.202 [2024-04-26 20:34:35.535726] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.202 [2024-04-26 20:34:35.535746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.552762] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.552783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.569459] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.569478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.586343] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.586364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.603324] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.603344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.619910] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.619934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.636687] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.636706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.652770] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.652790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.669656] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.669675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.686175] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.686195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.703688] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.703708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.720495] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.720515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.737036] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.737054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.754571] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.754591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.771171] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.771191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.788079] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.788099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.463 [2024-04-26 20:34:35.804392] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.463 [2024-04-26 20:34:35.804411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:35.821120] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:35.821140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:35.838526] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:35.838547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:35.855194] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:35.855215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:35.872196] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:35.872219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:35.888493] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:35.888513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:35.905409] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:35.905428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:35.921936] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:35.921956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:35.939721] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:35.939745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:35.956314] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:35.956333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:35.972863] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:35.972884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:35.989851] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:35.989870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:36.006503] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:36.006523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:36.023193] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:36.023213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:36.040027] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:36.040047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.723 [2024-04-26 20:34:36.056664] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.723 [2024-04-26 20:34:36.056683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.074221] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.074243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.090281] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.090301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.107185] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.107205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.123832] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.123857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.140136] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.140158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.157398] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.157418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.174195] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.174215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.190752] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.190772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.207793] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.207813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.224943] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.224965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.241741] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.241761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.258133] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.258153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.274953] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.274976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.292063] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.292085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.308903] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.308923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:17.984 [2024-04-26 20:34:36.326394] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:17.984 [2024-04-26 20:34:36.326414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.342497] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.342517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.359253] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.359275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.375878] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.375899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.392969] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.392991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.409105] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.409129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.426508] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.426529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.443114] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.443136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.460122] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.460142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.477097] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.477117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.493567] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.493589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.510644] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.510665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.527261] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.527288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.543409] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.543429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.560511] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.560531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.246 [2024-04-26 20:34:36.576974] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.246 [2024-04-26 20:34:36.576997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.594050] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.594071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.610785] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.610805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.627644] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.627664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.644664] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.644684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.661270] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.661296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.678333] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.678356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.695208] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.695228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.711884] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.711906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.727841] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.727866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.739013] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.739033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.755316] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.755337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.772349] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.772369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.789723] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.789744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.805599] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.805619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.822251] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.822271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.507 [2024-04-26 20:34:36.839107] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.507 [2024-04-26 20:34:36.839129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.767 [2024-04-26 20:34:36.856326] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.767 [2024-04-26 20:34:36.856346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.767 [2024-04-26 20:34:36.873119] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:36.873140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:36.890078] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:36.890102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:36.906608] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:36.906628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:36.923371] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:36.923390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:36.939923] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:36.939946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:36.957222] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:36.957241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:36.974028] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:36.974049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:36.990736] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:36.990760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:37.007344] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:37.007363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:37.024673] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:37.024692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:37.041260] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:37.041287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:37.057848] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:37.057871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:37.074769] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:37.074788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:37.091840] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:37.091860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:18.768 [2024-04-26 20:34:37.108576] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:18.768 [2024-04-26 20:34:37.108597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.028 [2024-04-26 20:34:37.125362] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.028 [2024-04-26 20:34:37.125382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.028 [2024-04-26 20:34:37.142287] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.028 [2024-04-26 20:34:37.142307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.028 [2024-04-26 20:34:37.159235] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.028 [2024-04-26 20:34:37.159256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.028 [2024-04-26 20:34:37.175899] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.028 [2024-04-26 20:34:37.175919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.028 [2024-04-26 20:34:37.192310] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.028 [2024-04-26 20:34:37.192330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.028 [2024-04-26 20:34:37.209568] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.028 [2024-04-26 20:34:37.209591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.029 [2024-04-26 20:34:37.226231] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.029 [2024-04-26 20:34:37.226255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.029 [2024-04-26 20:34:37.242871] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.029 [2024-04-26 20:34:37.242891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.029 [2024-04-26 20:34:37.259931] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.029 [2024-04-26 20:34:37.259954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.029 [2024-04-26 20:34:37.276755] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.029 [2024-04-26 20:34:37.276776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.029 [2024-04-26 20:34:37.292314] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.029 [2024-04-26 20:34:37.292336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.029 [2024-04-26 20:34:37.303577] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.029 [2024-04-26 20:34:37.303597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.029 [2024-04-26 20:34:37.320408] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.029 [2024-04-26 20:34:37.320431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.029 [2024-04-26 20:34:37.337256] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.029 [2024-04-26 20:34:37.337283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.029 [2024-04-26 20:34:37.354256] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.029 [2024-04-26 20:34:37.354285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.029 [2024-04-26 20:34:37.371030] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.029 [2024-04-26 20:34:37.371053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.387984] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.388004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.404588] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.404607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.421642] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.421665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.438823] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.438843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.455490] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.455509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.472459] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.472480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.489533] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.489553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.505996] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.506021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.522678] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.522697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.539303] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.539326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.556036] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.556059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.572746] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.572766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.589628] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.589648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.606223] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.606243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.289 [2024-04-26 20:34:37.623583] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.289 [2024-04-26 20:34:37.623605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.640250] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.640270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.657202] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.657222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.673851] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.673871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.690965] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.690985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.707551] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.707570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.724401] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.724421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.741158] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.741177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.758248] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.758268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.774625] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.774644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.791911] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.791934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.808844] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.808865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.825877] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.825902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.843023] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.843047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.859398] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.859419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.876289] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.876310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.893089] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.893111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.909883] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.909908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.926914] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.926939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.943589] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.943610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.632 [2024-04-26 20:34:37.960436] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.632 [2024-04-26 20:34:37.960455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:37.977262] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:37.977292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:37.994030] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:37.994052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.011167] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.011188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.028214] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.028234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.044549] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.044571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.061056] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.061076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.078141] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.078161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.094736] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.094756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.111641] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.111661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.128564] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.128586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.143609] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.143635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 00:17:19.893 Latency(us) 00:17:19.893 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:19.893 Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:17:19.893 Nvme1n1 : 5.01 13710.04 107.11 0.00 0.00 9324.50 4369.07 20425.39 00:17:19.893 =================================================================================================================== 00:17:19.893 Total : 13710.04 107.11 0.00 0.00 9324.50 4369.07 20425.39 00:17:19.893 [2024-04-26 20:34:38.152706] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.152725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.164737] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.164753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.176769] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.176783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.188804] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.188819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.200833] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.200845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.212864] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.212876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.224895] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.224906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:19.893 [2024-04-26 20:34:38.236929] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:19.893 [2024-04-26 20:34:38.236942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:20.154 [2024-04-26 20:34:38.248963] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:20.154 [2024-04-26 20:34:38.248975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:20.154 [2024-04-26 20:34:38.260997] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:20.154 [2024-04-26 20:34:38.261011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:20.154 [2024-04-26 20:34:38.273028] subsystem.c:1753:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:20.154 [2024-04-26 20:34:38.273039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:20.154 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (4036931) - No such process 00:17:20.154 20:34:38 -- target/zcopy.sh@49 -- # wait 4036931 00:17:20.154 20:34:38 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:17:20.154 20:34:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:20.154 20:34:38 -- common/autotest_common.sh@10 -- # set +x 00:17:20.154 20:34:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:20.154 20:34:38 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:17:20.154 20:34:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:20.154 20:34:38 -- common/autotest_common.sh@10 -- # set +x 00:17:20.154 delay0 00:17:20.154 20:34:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:20.154 20:34:38 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:17:20.154 20:34:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:20.154 20:34:38 -- common/autotest_common.sh@10 -- # set +x 00:17:20.154 20:34:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:20.154 20:34:38 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:17:20.154 EAL: No free 2048 kB hugepages reported on node 1 00:17:20.154 [2024-04-26 20:34:38.410016] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:17:26.732 Initializing NVMe Controllers 00:17:26.732 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:26.732 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:26.732 Initialization complete. Launching workers. 00:17:26.732 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 185 00:17:26.732 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 464, failed to submit 41 00:17:26.732 success 277, unsuccess 187, failed 0 00:17:26.732 20:34:44 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:17:26.732 20:34:44 -- target/zcopy.sh@60 -- # nvmftestfini 00:17:26.732 20:34:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:26.732 20:34:44 -- nvmf/common.sh@116 -- # sync 00:17:26.732 20:34:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:26.732 20:34:44 -- nvmf/common.sh@119 -- # set +e 00:17:26.732 20:34:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:26.732 20:34:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:26.732 rmmod nvme_tcp 00:17:26.732 rmmod nvme_fabrics 00:17:26.732 rmmod nvme_keyring 00:17:26.732 20:34:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:26.732 20:34:44 -- nvmf/common.sh@123 -- # set -e 00:17:26.732 20:34:44 -- nvmf/common.sh@124 -- # return 0 00:17:26.732 20:34:44 -- nvmf/common.sh@477 -- # '[' -n 4034777 ']' 00:17:26.732 20:34:44 -- nvmf/common.sh@478 -- # killprocess 4034777 00:17:26.732 20:34:44 -- common/autotest_common.sh@926 -- # '[' -z 4034777 ']' 00:17:26.732 20:34:44 -- common/autotest_common.sh@930 -- # kill -0 4034777 00:17:26.732 20:34:44 -- common/autotest_common.sh@931 -- # uname 00:17:26.732 20:34:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:26.732 20:34:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4034777 00:17:26.732 20:34:44 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:26.732 20:34:44 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:26.732 20:34:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4034777' 00:17:26.732 killing process with pid 4034777 00:17:26.732 20:34:44 -- common/autotest_common.sh@945 -- # kill 4034777 00:17:26.732 20:34:44 -- common/autotest_common.sh@950 -- # wait 4034777 00:17:26.732 20:34:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:26.732 20:34:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:26.732 20:34:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:26.732 20:34:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:26.732 20:34:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:26.733 20:34:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:26.733 20:34:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:26.733 20:34:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:28.650 20:34:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:28.650 00:17:28.650 real 0m32.791s 00:17:28.650 user 0m44.294s 00:17:28.650 sys 0m9.679s 00:17:28.650 20:34:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:28.650 20:34:46 -- common/autotest_common.sh@10 -- # set +x 00:17:28.650 ************************************ 00:17:28.650 END TEST nvmf_zcopy 00:17:28.650 ************************************ 00:17:28.650 20:34:46 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:17:28.650 20:34:46 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:28.650 20:34:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:28.650 20:34:46 -- common/autotest_common.sh@10 -- # set +x 00:17:28.650 ************************************ 00:17:28.650 START TEST nvmf_nmic 00:17:28.650 ************************************ 00:17:28.650 20:34:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:17:28.650 * Looking for test storage... 00:17:28.650 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:28.650 20:34:46 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:28.650 20:34:46 -- nvmf/common.sh@7 -- # uname -s 00:17:28.650 20:34:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:28.650 20:34:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:28.650 20:34:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:28.650 20:34:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:28.650 20:34:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:28.911 20:34:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:28.911 20:34:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:28.911 20:34:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:28.911 20:34:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:28.911 20:34:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:28.911 20:34:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:17:28.911 20:34:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:17:28.911 20:34:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:28.911 20:34:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:28.911 20:34:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:28.911 20:34:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:28.911 20:34:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:28.911 20:34:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:28.911 20:34:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:28.911 20:34:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:28.911 20:34:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:28.911 20:34:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:28.911 20:34:47 -- paths/export.sh@5 -- # export PATH 00:17:28.911 20:34:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:28.911 20:34:47 -- nvmf/common.sh@46 -- # : 0 00:17:28.911 20:34:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:28.911 20:34:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:28.911 20:34:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:28.911 20:34:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:28.911 20:34:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:28.911 20:34:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:28.911 20:34:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:28.911 20:34:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:28.911 20:34:47 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:28.911 20:34:47 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:28.911 20:34:47 -- target/nmic.sh@14 -- # nvmftestinit 00:17:28.911 20:34:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:28.911 20:34:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:28.911 20:34:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:28.911 20:34:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:28.911 20:34:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:28.911 20:34:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:28.911 20:34:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:28.911 20:34:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:28.911 20:34:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:28.911 20:34:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:28.911 20:34:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:28.911 20:34:47 -- common/autotest_common.sh@10 -- # set +x 00:17:35.502 20:34:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:35.502 20:34:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:35.502 20:34:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:35.502 20:34:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:35.502 20:34:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:35.502 20:34:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:35.502 20:34:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:35.502 20:34:53 -- nvmf/common.sh@294 -- # net_devs=() 00:17:35.502 20:34:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:35.502 20:34:53 -- nvmf/common.sh@295 -- # e810=() 00:17:35.502 20:34:53 -- nvmf/common.sh@295 -- # local -ga e810 00:17:35.502 20:34:53 -- nvmf/common.sh@296 -- # x722=() 00:17:35.502 20:34:53 -- nvmf/common.sh@296 -- # local -ga x722 00:17:35.502 20:34:53 -- nvmf/common.sh@297 -- # mlx=() 00:17:35.502 20:34:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:35.502 20:34:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:35.502 20:34:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:35.502 20:34:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:35.502 20:34:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:35.502 20:34:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:35.502 20:34:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:35.502 20:34:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:35.502 20:34:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:35.502 20:34:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:35.502 20:34:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:35.502 20:34:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:35.502 20:34:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:35.502 20:34:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:35.502 20:34:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:35.502 20:34:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:35.502 20:34:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:17:35.502 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:17:35.502 20:34:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:35.502 20:34:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:17:35.502 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:17:35.502 20:34:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:35.502 20:34:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:35.502 20:34:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:35.502 20:34:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:35.502 20:34:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:35.502 20:34:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:17:35.502 Found net devices under 0000:4b:00.0: cvl_0_0 00:17:35.502 20:34:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:35.502 20:34:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:35.502 20:34:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:35.502 20:34:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:35.502 20:34:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:35.502 20:34:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:17:35.502 Found net devices under 0000:4b:00.1: cvl_0_1 00:17:35.502 20:34:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:35.502 20:34:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:35.502 20:34:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:35.502 20:34:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:35.502 20:34:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:35.502 20:34:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:35.502 20:34:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:35.502 20:34:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:35.502 20:34:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:35.502 20:34:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:35.502 20:34:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:35.502 20:34:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:35.502 20:34:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:35.502 20:34:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:35.502 20:34:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:35.502 20:34:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:35.502 20:34:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:35.502 20:34:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:35.502 20:34:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:35.502 20:34:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:35.502 20:34:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:35.502 20:34:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:35.502 20:34:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:35.502 20:34:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:35.502 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:35.502 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.518 ms 00:17:35.502 00:17:35.502 --- 10.0.0.2 ping statistics --- 00:17:35.502 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:35.502 rtt min/avg/max/mdev = 0.518/0.518/0.518/0.000 ms 00:17:35.502 20:34:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:35.502 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:35.502 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.304 ms 00:17:35.502 00:17:35.502 --- 10.0.0.1 ping statistics --- 00:17:35.502 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:35.502 rtt min/avg/max/mdev = 0.304/0.304/0.304/0.000 ms 00:17:35.502 20:34:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:35.502 20:34:53 -- nvmf/common.sh@410 -- # return 0 00:17:35.502 20:34:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:35.502 20:34:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:35.502 20:34:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:35.502 20:34:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:35.502 20:34:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:35.502 20:34:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:35.763 20:34:53 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:17:35.763 20:34:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:35.763 20:34:53 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:35.763 20:34:53 -- common/autotest_common.sh@10 -- # set +x 00:17:35.763 20:34:53 -- nvmf/common.sh@469 -- # nvmfpid=4043542 00:17:35.763 20:34:53 -- nvmf/common.sh@470 -- # waitforlisten 4043542 00:17:35.763 20:34:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:35.763 20:34:53 -- common/autotest_common.sh@819 -- # '[' -z 4043542 ']' 00:17:35.763 20:34:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:35.763 20:34:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:35.763 20:34:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:35.763 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:35.763 20:34:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:35.763 20:34:53 -- common/autotest_common.sh@10 -- # set +x 00:17:35.763 [2024-04-26 20:34:53.920667] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:17:35.763 [2024-04-26 20:34:53.920732] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:35.763 EAL: No free 2048 kB hugepages reported on node 1 00:17:35.763 [2024-04-26 20:34:53.991250] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:35.763 [2024-04-26 20:34:54.065686] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:35.763 [2024-04-26 20:34:54.065818] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:35.763 [2024-04-26 20:34:54.065828] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:35.763 [2024-04-26 20:34:54.065837] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:35.763 [2024-04-26 20:34:54.065951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:35.763 [2024-04-26 20:34:54.066071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:35.763 [2024-04-26 20:34:54.066198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:35.763 [2024-04-26 20:34:54.066200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:36.705 20:34:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:36.705 20:34:54 -- common/autotest_common.sh@852 -- # return 0 00:17:36.705 20:34:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:36.705 20:34:54 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:36.705 20:34:54 -- common/autotest_common.sh@10 -- # set +x 00:17:36.705 20:34:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:36.705 20:34:54 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:36.705 20:34:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:36.705 20:34:54 -- common/autotest_common.sh@10 -- # set +x 00:17:36.705 [2024-04-26 20:34:54.741444] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:36.705 20:34:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:36.705 20:34:54 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:36.705 20:34:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:36.705 20:34:54 -- common/autotest_common.sh@10 -- # set +x 00:17:36.705 Malloc0 00:17:36.705 20:34:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:36.705 20:34:54 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:17:36.705 20:34:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:36.705 20:34:54 -- common/autotest_common.sh@10 -- # set +x 00:17:36.705 20:34:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:36.705 20:34:54 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:36.705 20:34:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:36.705 20:34:54 -- common/autotest_common.sh@10 -- # set +x 00:17:36.705 20:34:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:36.705 20:34:54 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:36.705 20:34:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:36.705 20:34:54 -- common/autotest_common.sh@10 -- # set +x 00:17:36.705 [2024-04-26 20:34:54.800789] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:36.705 20:34:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:36.705 20:34:54 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:17:36.705 test case1: single bdev can't be used in multiple subsystems 00:17:36.705 20:34:54 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:17:36.705 20:34:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:36.705 20:34:54 -- common/autotest_common.sh@10 -- # set +x 00:17:36.705 20:34:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:36.705 20:34:54 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:17:36.706 20:34:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:36.706 20:34:54 -- common/autotest_common.sh@10 -- # set +x 00:17:36.706 20:34:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:36.706 20:34:54 -- target/nmic.sh@28 -- # nmic_status=0 00:17:36.706 20:34:54 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:17:36.706 20:34:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:36.706 20:34:54 -- common/autotest_common.sh@10 -- # set +x 00:17:36.706 [2024-04-26 20:34:54.836754] bdev.c:7935:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:17:36.706 [2024-04-26 20:34:54.836773] subsystem.c:1779:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:17:36.706 [2024-04-26 20:34:54.836780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:36.706 request: 00:17:36.706 { 00:17:36.706 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:17:36.706 "namespace": { 00:17:36.706 "bdev_name": "Malloc0" 00:17:36.706 }, 00:17:36.706 "method": "nvmf_subsystem_add_ns", 00:17:36.706 "req_id": 1 00:17:36.706 } 00:17:36.706 Got JSON-RPC error response 00:17:36.706 response: 00:17:36.706 { 00:17:36.706 "code": -32602, 00:17:36.706 "message": "Invalid parameters" 00:17:36.706 } 00:17:36.706 20:34:54 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:17:36.706 20:34:54 -- target/nmic.sh@29 -- # nmic_status=1 00:17:36.706 20:34:54 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:17:36.706 20:34:54 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:17:36.706 Adding namespace failed - expected result. 00:17:36.706 20:34:54 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:17:36.706 test case2: host connect to nvmf target in multiple paths 00:17:36.706 20:34:54 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:17:36.706 20:34:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:36.706 20:34:54 -- common/autotest_common.sh@10 -- # set +x 00:17:36.706 [2024-04-26 20:34:54.848884] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:17:36.706 20:34:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:36.706 20:34:54 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:17:38.195 20:34:56 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:17:39.581 20:34:57 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:17:39.581 20:34:57 -- common/autotest_common.sh@1177 -- # local i=0 00:17:39.581 20:34:57 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:17:39.581 20:34:57 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:17:39.581 20:34:57 -- common/autotest_common.sh@1184 -- # sleep 2 00:17:42.127 20:34:59 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:17:42.127 20:34:59 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:17:42.127 20:34:59 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:17:42.127 20:34:59 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:17:42.127 20:34:59 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:17:42.127 20:34:59 -- common/autotest_common.sh@1187 -- # return 0 00:17:42.127 20:34:59 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:17:42.127 [global] 00:17:42.127 thread=1 00:17:42.127 invalidate=1 00:17:42.127 rw=write 00:17:42.127 time_based=1 00:17:42.127 runtime=1 00:17:42.127 ioengine=libaio 00:17:42.127 direct=1 00:17:42.127 bs=4096 00:17:42.127 iodepth=1 00:17:42.127 norandommap=0 00:17:42.127 numjobs=1 00:17:42.127 00:17:42.127 verify_dump=1 00:17:42.127 verify_backlog=512 00:17:42.127 verify_state_save=0 00:17:42.127 do_verify=1 00:17:42.127 verify=crc32c-intel 00:17:42.127 [job0] 00:17:42.127 filename=/dev/nvme0n1 00:17:42.127 Could not set queue depth (nvme0n1) 00:17:42.127 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:42.127 fio-3.35 00:17:42.127 Starting 1 thread 00:17:43.511 00:17:43.511 job0: (groupid=0, jobs=1): err= 0: pid=4044876: Fri Apr 26 20:35:01 2024 00:17:43.511 read: IOPS=300, BW=1203KiB/s (1232kB/s)(1204KiB/1001msec) 00:17:43.511 slat (nsec): min=8485, max=70467, avg=26224.61, stdev=4804.84 00:17:43.511 clat (usec): min=1017, max=41879, avg=1545.42, stdev=3297.35 00:17:43.511 lat (usec): min=1026, max=41906, avg=1571.64, stdev=3297.41 00:17:43.511 clat percentiles (usec): 00:17:43.511 | 1.00th=[ 1090], 5.00th=[ 1172], 10.00th=[ 1205], 20.00th=[ 1237], 00:17:43.511 | 30.00th=[ 1254], 40.00th=[ 1270], 50.00th=[ 1287], 60.00th=[ 1287], 00:17:43.511 | 70.00th=[ 1303], 80.00th=[ 1319], 90.00th=[ 1336], 95.00th=[ 1352], 00:17:43.511 | 99.00th=[ 1418], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:17:43.511 | 99.99th=[41681] 00:17:43.511 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:17:43.511 slat (usec): min=9, max=28247, avg=88.74, stdev=1246.91 00:17:43.511 clat (usec): min=505, max=1201, avg=928.52, stdev=84.43 00:17:43.511 lat (usec): min=515, max=29122, avg=1017.26, stdev=1247.54 00:17:43.511 clat percentiles (usec): 00:17:43.511 | 1.00th=[ 619], 5.00th=[ 742], 10.00th=[ 824], 20.00th=[ 881], 00:17:43.511 | 30.00th=[ 922], 40.00th=[ 938], 50.00th=[ 955], 60.00th=[ 963], 00:17:43.511 | 70.00th=[ 971], 80.00th=[ 979], 90.00th=[ 1004], 95.00th=[ 1029], 00:17:43.511 | 99.00th=[ 1057], 99.50th=[ 1123], 99.90th=[ 1205], 99.95th=[ 1205], 00:17:43.511 | 99.99th=[ 1205] 00:17:43.511 bw ( KiB/s): min= 3904, max= 3904, per=100.00%, avg=3904.00, stdev= 0.00, samples=1 00:17:43.511 iops : min= 976, max= 976, avg=976.00, stdev= 0.00, samples=1 00:17:43.511 lat (usec) : 750=3.32%, 1000=52.77% 00:17:43.511 lat (msec) : 2=43.67%, 50=0.25% 00:17:43.511 cpu : usr=1.90%, sys=3.20%, ctx=818, majf=0, minf=1 00:17:43.511 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:43.511 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:43.511 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:43.511 issued rwts: total=301,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:43.511 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:43.511 00:17:43.511 Run status group 0 (all jobs): 00:17:43.511 READ: bw=1203KiB/s (1232kB/s), 1203KiB/s-1203KiB/s (1232kB/s-1232kB/s), io=1204KiB (1233kB), run=1001-1001msec 00:17:43.511 WRITE: bw=2046KiB/s (2095kB/s), 2046KiB/s-2046KiB/s (2095kB/s-2095kB/s), io=2048KiB (2097kB), run=1001-1001msec 00:17:43.511 00:17:43.511 Disk stats (read/write): 00:17:43.511 nvme0n1: ios=248/512, merge=0/0, ticks=1309/435, in_queue=1744, util=98.90% 00:17:43.511 20:35:01 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:43.511 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:17:43.511 20:35:01 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:17:43.511 20:35:01 -- common/autotest_common.sh@1198 -- # local i=0 00:17:43.511 20:35:01 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:17:43.511 20:35:01 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:43.512 20:35:01 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:17:43.512 20:35:01 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:43.512 20:35:01 -- common/autotest_common.sh@1210 -- # return 0 00:17:43.512 20:35:01 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:17:43.512 20:35:01 -- target/nmic.sh@53 -- # nvmftestfini 00:17:43.512 20:35:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:43.512 20:35:01 -- nvmf/common.sh@116 -- # sync 00:17:43.512 20:35:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:43.512 20:35:01 -- nvmf/common.sh@119 -- # set +e 00:17:43.512 20:35:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:43.512 20:35:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:43.512 rmmod nvme_tcp 00:17:43.512 rmmod nvme_fabrics 00:17:43.512 rmmod nvme_keyring 00:17:43.512 20:35:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:43.512 20:35:01 -- nvmf/common.sh@123 -- # set -e 00:17:43.512 20:35:01 -- nvmf/common.sh@124 -- # return 0 00:17:43.512 20:35:01 -- nvmf/common.sh@477 -- # '[' -n 4043542 ']' 00:17:43.512 20:35:01 -- nvmf/common.sh@478 -- # killprocess 4043542 00:17:43.512 20:35:01 -- common/autotest_common.sh@926 -- # '[' -z 4043542 ']' 00:17:43.512 20:35:01 -- common/autotest_common.sh@930 -- # kill -0 4043542 00:17:43.512 20:35:01 -- common/autotest_common.sh@931 -- # uname 00:17:43.512 20:35:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:43.512 20:35:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4043542 00:17:43.512 20:35:01 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:43.512 20:35:01 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:43.512 20:35:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4043542' 00:17:43.512 killing process with pid 4043542 00:17:43.512 20:35:01 -- common/autotest_common.sh@945 -- # kill 4043542 00:17:43.512 20:35:01 -- common/autotest_common.sh@950 -- # wait 4043542 00:17:43.773 20:35:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:43.773 20:35:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:43.773 20:35:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:43.773 20:35:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:43.773 20:35:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:43.773 20:35:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:43.773 20:35:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:43.773 20:35:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:45.686 20:35:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:45.686 00:17:45.686 real 0m17.044s 00:17:45.686 user 0m47.003s 00:17:45.686 sys 0m5.732s 00:17:45.686 20:35:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:45.686 20:35:03 -- common/autotest_common.sh@10 -- # set +x 00:17:45.686 ************************************ 00:17:45.686 END TEST nvmf_nmic 00:17:45.686 ************************************ 00:17:45.686 20:35:03 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:17:45.686 20:35:03 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:45.686 20:35:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:45.687 20:35:03 -- common/autotest_common.sh@10 -- # set +x 00:17:45.687 ************************************ 00:17:45.687 START TEST nvmf_fio_target 00:17:45.687 ************************************ 00:17:45.687 20:35:03 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:17:45.947 * Looking for test storage... 00:17:45.947 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:45.947 20:35:04 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:45.947 20:35:04 -- nvmf/common.sh@7 -- # uname -s 00:17:45.947 20:35:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:45.947 20:35:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:45.947 20:35:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:45.947 20:35:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:45.947 20:35:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:45.947 20:35:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:45.947 20:35:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:45.947 20:35:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:45.947 20:35:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:45.947 20:35:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:45.948 20:35:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:17:45.948 20:35:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:17:45.948 20:35:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:45.948 20:35:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:45.948 20:35:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:45.948 20:35:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:45.948 20:35:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:45.948 20:35:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:45.948 20:35:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:45.948 20:35:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.948 20:35:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.948 20:35:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.948 20:35:04 -- paths/export.sh@5 -- # export PATH 00:17:45.948 20:35:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:45.948 20:35:04 -- nvmf/common.sh@46 -- # : 0 00:17:45.948 20:35:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:45.948 20:35:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:45.948 20:35:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:45.948 20:35:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:45.948 20:35:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:45.948 20:35:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:45.948 20:35:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:45.948 20:35:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:45.948 20:35:04 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:45.948 20:35:04 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:45.948 20:35:04 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:45.948 20:35:04 -- target/fio.sh@16 -- # nvmftestinit 00:17:45.948 20:35:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:45.948 20:35:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:45.948 20:35:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:45.948 20:35:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:45.948 20:35:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:45.948 20:35:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:45.948 20:35:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:45.948 20:35:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:45.948 20:35:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:45.948 20:35:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:45.948 20:35:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:45.948 20:35:04 -- common/autotest_common.sh@10 -- # set +x 00:17:52.537 20:35:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:52.537 20:35:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:52.537 20:35:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:52.537 20:35:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:52.537 20:35:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:52.537 20:35:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:52.537 20:35:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:52.537 20:35:10 -- nvmf/common.sh@294 -- # net_devs=() 00:17:52.537 20:35:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:52.537 20:35:10 -- nvmf/common.sh@295 -- # e810=() 00:17:52.537 20:35:10 -- nvmf/common.sh@295 -- # local -ga e810 00:17:52.537 20:35:10 -- nvmf/common.sh@296 -- # x722=() 00:17:52.537 20:35:10 -- nvmf/common.sh@296 -- # local -ga x722 00:17:52.537 20:35:10 -- nvmf/common.sh@297 -- # mlx=() 00:17:52.537 20:35:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:52.537 20:35:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:52.537 20:35:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:52.537 20:35:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:52.537 20:35:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:52.537 20:35:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:52.537 20:35:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:52.537 20:35:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:52.537 20:35:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:52.537 20:35:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:52.537 20:35:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:52.537 20:35:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:52.537 20:35:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:52.537 20:35:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:52.537 20:35:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:52.537 20:35:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:52.537 20:35:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:17:52.537 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:17:52.537 20:35:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:52.537 20:35:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:17:52.537 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:17:52.537 20:35:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:52.537 20:35:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:52.537 20:35:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:52.537 20:35:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:52.537 20:35:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:52.537 20:35:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:17:52.537 Found net devices under 0000:4b:00.0: cvl_0_0 00:17:52.537 20:35:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:52.537 20:35:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:52.537 20:35:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:52.537 20:35:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:52.537 20:35:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:52.537 20:35:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:17:52.537 Found net devices under 0000:4b:00.1: cvl_0_1 00:17:52.537 20:35:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:52.537 20:35:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:52.537 20:35:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:52.537 20:35:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:52.537 20:35:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:52.537 20:35:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:52.537 20:35:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:52.537 20:35:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:52.537 20:35:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:52.537 20:35:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:52.537 20:35:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:52.537 20:35:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:52.537 20:35:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:52.537 20:35:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:52.537 20:35:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:52.537 20:35:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:52.537 20:35:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:52.537 20:35:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:52.537 20:35:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:52.537 20:35:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:52.537 20:35:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:52.538 20:35:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:52.538 20:35:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:52.538 20:35:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:52.538 20:35:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:52.538 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:52.538 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.502 ms 00:17:52.538 00:17:52.538 --- 10.0.0.2 ping statistics --- 00:17:52.538 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:52.538 rtt min/avg/max/mdev = 0.502/0.502/0.502/0.000 ms 00:17:52.538 20:35:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:52.538 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:52.538 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.414 ms 00:17:52.538 00:17:52.538 --- 10.0.0.1 ping statistics --- 00:17:52.538 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:52.538 rtt min/avg/max/mdev = 0.414/0.414/0.414/0.000 ms 00:17:52.538 20:35:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:52.538 20:35:10 -- nvmf/common.sh@410 -- # return 0 00:17:52.538 20:35:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:52.538 20:35:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:52.538 20:35:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:52.538 20:35:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:52.538 20:35:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:52.538 20:35:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:52.538 20:35:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:52.798 20:35:10 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:17:52.798 20:35:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:52.798 20:35:10 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:52.798 20:35:10 -- common/autotest_common.sh@10 -- # set +x 00:17:52.798 20:35:10 -- nvmf/common.sh@469 -- # nvmfpid=4049401 00:17:52.798 20:35:10 -- nvmf/common.sh@470 -- # waitforlisten 4049401 00:17:52.798 20:35:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:52.798 20:35:10 -- common/autotest_common.sh@819 -- # '[' -z 4049401 ']' 00:17:52.798 20:35:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:52.798 20:35:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:52.798 20:35:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:52.798 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:52.798 20:35:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:52.798 20:35:10 -- common/autotest_common.sh@10 -- # set +x 00:17:52.798 [2024-04-26 20:35:10.954801] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:17:52.798 [2024-04-26 20:35:10.954864] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:52.798 EAL: No free 2048 kB hugepages reported on node 1 00:17:52.798 [2024-04-26 20:35:11.027682] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:52.798 [2024-04-26 20:35:11.102241] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:52.798 [2024-04-26 20:35:11.102380] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:52.798 [2024-04-26 20:35:11.102389] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:52.798 [2024-04-26 20:35:11.102396] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:52.798 [2024-04-26 20:35:11.102504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:52.798 [2024-04-26 20:35:11.102622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:52.798 [2024-04-26 20:35:11.102754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:52.798 [2024-04-26 20:35:11.102757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:53.740 20:35:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:53.740 20:35:11 -- common/autotest_common.sh@852 -- # return 0 00:17:53.740 20:35:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:53.740 20:35:11 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:53.740 20:35:11 -- common/autotest_common.sh@10 -- # set +x 00:17:53.740 20:35:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:53.740 20:35:11 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:53.740 [2024-04-26 20:35:11.907857] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:53.740 20:35:11 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:54.000 20:35:12 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:17:54.000 20:35:12 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:54.000 20:35:12 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:17:54.000 20:35:12 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:54.261 20:35:12 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:17:54.261 20:35:12 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:54.522 20:35:12 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:17:54.522 20:35:12 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:17:54.522 20:35:12 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:54.782 20:35:12 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:17:54.782 20:35:12 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:55.045 20:35:13 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:17:55.045 20:35:13 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:55.045 20:35:13 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:17:55.045 20:35:13 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:17:55.307 20:35:13 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:17:55.567 20:35:13 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:17:55.567 20:35:13 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:55.567 20:35:13 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:17:55.567 20:35:13 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:17:55.828 20:35:13 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:55.828 [2024-04-26 20:35:14.133740] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:55.828 20:35:14 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:17:56.088 20:35:14 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:17:56.349 20:35:14 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:17:57.736 20:35:16 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:17:57.736 20:35:16 -- common/autotest_common.sh@1177 -- # local i=0 00:17:57.736 20:35:16 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:17:57.736 20:35:16 -- common/autotest_common.sh@1179 -- # [[ -n 4 ]] 00:17:57.736 20:35:16 -- common/autotest_common.sh@1180 -- # nvme_device_counter=4 00:17:57.736 20:35:16 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:00.282 20:35:18 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:00.282 20:35:18 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:00.282 20:35:18 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:18:00.282 20:35:18 -- common/autotest_common.sh@1186 -- # nvme_devices=4 00:18:00.282 20:35:18 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:00.282 20:35:18 -- common/autotest_common.sh@1187 -- # return 0 00:18:00.282 20:35:18 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:18:00.282 [global] 00:18:00.282 thread=1 00:18:00.282 invalidate=1 00:18:00.282 rw=write 00:18:00.282 time_based=1 00:18:00.282 runtime=1 00:18:00.282 ioengine=libaio 00:18:00.282 direct=1 00:18:00.282 bs=4096 00:18:00.282 iodepth=1 00:18:00.282 norandommap=0 00:18:00.282 numjobs=1 00:18:00.282 00:18:00.282 verify_dump=1 00:18:00.282 verify_backlog=512 00:18:00.282 verify_state_save=0 00:18:00.282 do_verify=1 00:18:00.282 verify=crc32c-intel 00:18:00.282 [job0] 00:18:00.282 filename=/dev/nvme0n1 00:18:00.283 [job1] 00:18:00.283 filename=/dev/nvme0n2 00:18:00.283 [job2] 00:18:00.283 filename=/dev/nvme0n3 00:18:00.283 [job3] 00:18:00.283 filename=/dev/nvme0n4 00:18:00.283 Could not set queue depth (nvme0n1) 00:18:00.283 Could not set queue depth (nvme0n2) 00:18:00.283 Could not set queue depth (nvme0n3) 00:18:00.283 Could not set queue depth (nvme0n4) 00:18:00.283 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:00.283 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:00.283 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:00.283 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:00.283 fio-3.35 00:18:00.283 Starting 4 threads 00:18:01.668 00:18:01.668 job0: (groupid=0, jobs=1): err= 0: pid=4051158: Fri Apr 26 20:35:19 2024 00:18:01.668 read: IOPS=14, BW=58.9KiB/s (60.3kB/s)(60.0KiB/1019msec) 00:18:01.668 slat (nsec): min=25025, max=26026, avg=25593.53, stdev=254.63 00:18:01.668 clat (usec): min=41471, max=42044, avg=41932.93, stdev=136.63 00:18:01.668 lat (usec): min=41497, max=42070, avg=41958.53, stdev=136.64 00:18:01.668 clat percentiles (usec): 00:18:01.668 | 1.00th=[41681], 5.00th=[41681], 10.00th=[41681], 20.00th=[41681], 00:18:01.668 | 30.00th=[41681], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:18:01.668 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:18:01.668 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:18:01.668 | 99.99th=[42206] 00:18:01.668 write: IOPS=502, BW=2010KiB/s (2058kB/s)(2048KiB/1019msec); 0 zone resets 00:18:01.668 slat (nsec): min=10364, max=71454, avg=30160.76, stdev=9240.85 00:18:01.668 clat (usec): min=476, max=987, avg=716.03, stdev=66.14 00:18:01.668 lat (usec): min=505, max=1021, avg=746.19, stdev=68.02 00:18:01.668 clat percentiles (usec): 00:18:01.668 | 1.00th=[ 506], 5.00th=[ 603], 10.00th=[ 627], 20.00th=[ 660], 00:18:01.668 | 30.00th=[ 693], 40.00th=[ 717], 50.00th=[ 725], 60.00th=[ 742], 00:18:01.668 | 70.00th=[ 750], 80.00th=[ 766], 90.00th=[ 783], 95.00th=[ 799], 00:18:01.668 | 99.00th=[ 857], 99.50th=[ 947], 99.90th=[ 988], 99.95th=[ 988], 00:18:01.668 | 99.99th=[ 988] 00:18:01.668 bw ( KiB/s): min= 4096, max= 4096, per=51.20%, avg=4096.00, stdev= 0.00, samples=1 00:18:01.668 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:01.668 lat (usec) : 500=0.57%, 750=66.79%, 1000=29.79% 00:18:01.668 lat (msec) : 50=2.85% 00:18:01.668 cpu : usr=1.38%, sys=0.88%, ctx=529, majf=0, minf=1 00:18:01.668 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:01.668 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.668 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.668 issued rwts: total=15,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:01.668 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:01.668 job1: (groupid=0, jobs=1): err= 0: pid=4051159: Fri Apr 26 20:35:19 2024 00:18:01.668 read: IOPS=14, BW=58.6KiB/s (60.0kB/s)(60.0KiB/1024msec) 00:18:01.669 slat (nsec): min=11173, max=26806, avg=25196.00, stdev=3889.89 00:18:01.669 clat (usec): min=41501, max=42048, avg=41916.71, stdev=126.94 00:18:01.669 lat (usec): min=41512, max=42075, avg=41941.90, stdev=130.45 00:18:01.669 clat percentiles (usec): 00:18:01.669 | 1.00th=[41681], 5.00th=[41681], 10.00th=[41681], 20.00th=[41681], 00:18:01.669 | 30.00th=[41681], 40.00th=[41681], 50.00th=[42206], 60.00th=[42206], 00:18:01.669 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:18:01.669 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:18:01.669 | 99.99th=[42206] 00:18:01.669 write: IOPS=500, BW=2000KiB/s (2048kB/s)(2048KiB/1024msec); 0 zone resets 00:18:01.669 slat (nsec): min=10024, max=53463, avg=30486.88, stdev=9527.71 00:18:01.669 clat (usec): min=492, max=1842, avg=725.04, stdev=80.41 00:18:01.669 lat (usec): min=520, max=1854, avg=755.53, stdev=82.13 00:18:01.669 clat percentiles (usec): 00:18:01.669 | 1.00th=[ 545], 5.00th=[ 611], 10.00th=[ 635], 20.00th=[ 660], 00:18:01.669 | 30.00th=[ 701], 40.00th=[ 725], 50.00th=[ 734], 60.00th=[ 750], 00:18:01.669 | 70.00th=[ 766], 80.00th=[ 775], 90.00th=[ 791], 95.00th=[ 807], 00:18:01.669 | 99.00th=[ 832], 99.50th=[ 848], 99.90th=[ 1844], 99.95th=[ 1844], 00:18:01.669 | 99.99th=[ 1844] 00:18:01.669 bw ( KiB/s): min= 4096, max= 4096, per=51.20%, avg=4096.00, stdev= 0.00, samples=1 00:18:01.669 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:01.669 lat (usec) : 500=0.38%, 750=57.12%, 1000=39.47% 00:18:01.669 lat (msec) : 2=0.19%, 50=2.85% 00:18:01.669 cpu : usr=0.88%, sys=1.37%, ctx=528, majf=0, minf=1 00:18:01.669 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:01.669 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.669 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.669 issued rwts: total=15,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:01.669 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:01.669 job2: (groupid=0, jobs=1): err= 0: pid=4051160: Fri Apr 26 20:35:19 2024 00:18:01.669 read: IOPS=78, BW=312KiB/s (320kB/s)(316KiB/1012msec) 00:18:01.669 slat (nsec): min=25163, max=60740, avg=26270.67, stdev=4265.37 00:18:01.669 clat (usec): min=1085, max=42322, avg=6478.82, stdev=13610.47 00:18:01.669 lat (usec): min=1110, max=42347, avg=6505.09, stdev=13610.20 00:18:01.669 clat percentiles (usec): 00:18:01.669 | 1.00th=[ 1090], 5.00th=[ 1172], 10.00th=[ 1221], 20.00th=[ 1270], 00:18:01.669 | 30.00th=[ 1303], 40.00th=[ 1319], 50.00th=[ 1336], 60.00th=[ 1369], 00:18:01.669 | 70.00th=[ 1418], 80.00th=[ 1467], 90.00th=[41681], 95.00th=[42206], 00:18:01.669 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:18:01.669 | 99.99th=[42206] 00:18:01.669 write: IOPS=505, BW=2024KiB/s (2072kB/s)(2048KiB/1012msec); 0 zone resets 00:18:01.669 slat (nsec): min=10640, max=67013, avg=33841.56, stdev=5525.32 00:18:01.669 clat (usec): min=644, max=2769, avg=921.74, stdev=160.82 00:18:01.669 lat (usec): min=678, max=2802, avg=955.58, stdev=161.11 00:18:01.669 clat percentiles (usec): 00:18:01.669 | 1.00th=[ 676], 5.00th=[ 750], 10.00th=[ 783], 20.00th=[ 832], 00:18:01.669 | 30.00th=[ 857], 40.00th=[ 889], 50.00th=[ 914], 60.00th=[ 938], 00:18:01.669 | 70.00th=[ 963], 80.00th=[ 996], 90.00th=[ 1029], 95.00th=[ 1057], 00:18:01.669 | 99.00th=[ 1205], 99.50th=[ 2147], 99.90th=[ 2769], 99.95th=[ 2769], 00:18:01.669 | 99.99th=[ 2769] 00:18:01.669 bw ( KiB/s): min= 4096, max= 4096, per=51.20%, avg=4096.00, stdev= 0.00, samples=1 00:18:01.669 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:01.669 lat (usec) : 750=4.06%, 1000=68.19% 00:18:01.669 lat (msec) : 2=25.55%, 4=0.51%, 50=1.69% 00:18:01.669 cpu : usr=0.99%, sys=1.78%, ctx=592, majf=0, minf=1 00:18:01.669 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:01.669 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.669 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.669 issued rwts: total=79,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:01.669 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:01.669 job3: (groupid=0, jobs=1): err= 0: pid=4051161: Fri Apr 26 20:35:19 2024 00:18:01.669 read: IOPS=433, BW=1734KiB/s (1776kB/s)(1736KiB/1001msec) 00:18:01.669 slat (nsec): min=8039, max=45758, avg=26399.51, stdev=3341.11 00:18:01.669 clat (usec): min=888, max=1392, avg=1250.26, stdev=60.46 00:18:01.669 lat (usec): min=915, max=1418, avg=1276.66, stdev=61.10 00:18:01.669 clat percentiles (usec): 00:18:01.669 | 1.00th=[ 1074], 5.00th=[ 1139], 10.00th=[ 1172], 20.00th=[ 1205], 00:18:01.669 | 30.00th=[ 1237], 40.00th=[ 1237], 50.00th=[ 1254], 60.00th=[ 1270], 00:18:01.669 | 70.00th=[ 1287], 80.00th=[ 1303], 90.00th=[ 1319], 95.00th=[ 1336], 00:18:01.669 | 99.00th=[ 1369], 99.50th=[ 1369], 99.90th=[ 1385], 99.95th=[ 1385], 00:18:01.669 | 99.99th=[ 1385] 00:18:01.669 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:18:01.669 slat (usec): min=10, max=45281, avg=120.54, stdev=1999.78 00:18:01.669 clat (usec): min=501, max=883, avg=728.17, stdev=67.48 00:18:01.669 lat (usec): min=526, max=45993, avg=848.71, stdev=2000.30 00:18:01.669 clat percentiles (usec): 00:18:01.669 | 1.00th=[ 562], 5.00th=[ 611], 10.00th=[ 627], 20.00th=[ 660], 00:18:01.669 | 30.00th=[ 701], 40.00th=[ 725], 50.00th=[ 742], 60.00th=[ 758], 00:18:01.669 | 70.00th=[ 766], 80.00th=[ 783], 90.00th=[ 807], 95.00th=[ 824], 00:18:01.669 | 99.00th=[ 857], 99.50th=[ 865], 99.90th=[ 881], 99.95th=[ 881], 00:18:01.669 | 99.99th=[ 881] 00:18:01.669 bw ( KiB/s): min= 4096, max= 4096, per=51.20%, avg=4096.00, stdev= 0.00, samples=1 00:18:01.669 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:01.669 lat (usec) : 750=30.76%, 1000=23.47% 00:18:01.669 lat (msec) : 2=45.77% 00:18:01.669 cpu : usr=1.20%, sys=3.10%, ctx=948, majf=0, minf=1 00:18:01.669 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:01.669 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.669 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.669 issued rwts: total=434,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:01.669 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:01.669 00:18:01.669 Run status group 0 (all jobs): 00:18:01.669 READ: bw=2121KiB/s (2172kB/s), 58.6KiB/s-1734KiB/s (60.0kB/s-1776kB/s), io=2172KiB (2224kB), run=1001-1024msec 00:18:01.669 WRITE: bw=8000KiB/s (8192kB/s), 2000KiB/s-2046KiB/s (2048kB/s-2095kB/s), io=8192KiB (8389kB), run=1001-1024msec 00:18:01.669 00:18:01.669 Disk stats (read/write): 00:18:01.669 nvme0n1: ios=34/512, merge=0/0, ticks=1262/359, in_queue=1621, util=83.87% 00:18:01.669 nvme0n2: ios=32/512, merge=0/0, ticks=1302/361, in_queue=1663, util=87.76% 00:18:01.669 nvme0n3: ios=97/512, merge=0/0, ticks=1184/448, in_queue=1632, util=91.87% 00:18:01.669 nvme0n4: ios=354/512, merge=0/0, ticks=886/370, in_queue=1256, util=97.01% 00:18:01.669 20:35:19 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:18:01.669 [global] 00:18:01.669 thread=1 00:18:01.669 invalidate=1 00:18:01.669 rw=randwrite 00:18:01.669 time_based=1 00:18:01.669 runtime=1 00:18:01.669 ioengine=libaio 00:18:01.669 direct=1 00:18:01.669 bs=4096 00:18:01.669 iodepth=1 00:18:01.669 norandommap=0 00:18:01.669 numjobs=1 00:18:01.669 00:18:01.669 verify_dump=1 00:18:01.669 verify_backlog=512 00:18:01.669 verify_state_save=0 00:18:01.669 do_verify=1 00:18:01.669 verify=crc32c-intel 00:18:01.669 [job0] 00:18:01.669 filename=/dev/nvme0n1 00:18:01.669 [job1] 00:18:01.669 filename=/dev/nvme0n2 00:18:01.669 [job2] 00:18:01.669 filename=/dev/nvme0n3 00:18:01.669 [job3] 00:18:01.669 filename=/dev/nvme0n4 00:18:01.669 Could not set queue depth (nvme0n1) 00:18:01.669 Could not set queue depth (nvme0n2) 00:18:01.669 Could not set queue depth (nvme0n3) 00:18:01.669 Could not set queue depth (nvme0n4) 00:18:01.930 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:01.930 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:01.930 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:01.930 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:01.930 fio-3.35 00:18:01.930 Starting 4 threads 00:18:03.316 00:18:03.316 job0: (groupid=0, jobs=1): err= 0: pid=4051692: Fri Apr 26 20:35:21 2024 00:18:03.316 read: IOPS=12, BW=50.3KiB/s (51.5kB/s)(52.0KiB/1034msec) 00:18:03.316 slat (nsec): min=24998, max=26125, avg=25381.92, stdev=297.28 00:18:03.316 clat (usec): min=41892, max=42461, avg=42003.50, stdev=143.69 00:18:03.316 lat (usec): min=41917, max=42486, avg=42028.88, stdev=143.71 00:18:03.316 clat percentiles (usec): 00:18:03.316 | 1.00th=[41681], 5.00th=[41681], 10.00th=[41681], 20.00th=[41681], 00:18:03.316 | 30.00th=[41681], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:18:03.316 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:18:03.316 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:18:03.316 | 99.99th=[42206] 00:18:03.316 write: IOPS=495, BW=1981KiB/s (2028kB/s)(2048KiB/1034msec); 0 zone resets 00:18:03.316 slat (nsec): min=10098, max=61750, avg=32372.84, stdev=5237.22 00:18:03.316 clat (usec): min=547, max=2526, avg=903.81, stdev=125.71 00:18:03.316 lat (usec): min=558, max=2557, avg=936.18, stdev=126.28 00:18:03.316 clat percentiles (usec): 00:18:03.316 | 1.00th=[ 652], 5.00th=[ 725], 10.00th=[ 766], 20.00th=[ 824], 00:18:03.316 | 30.00th=[ 857], 40.00th=[ 881], 50.00th=[ 906], 60.00th=[ 938], 00:18:03.316 | 70.00th=[ 955], 80.00th=[ 979], 90.00th=[ 1004], 95.00th=[ 1037], 00:18:03.316 | 99.00th=[ 1123], 99.50th=[ 1172], 99.90th=[ 2540], 99.95th=[ 2540], 00:18:03.316 | 99.99th=[ 2540] 00:18:03.316 bw ( KiB/s): min= 4096, max= 4096, per=51.70%, avg=4096.00, stdev= 0.00, samples=1 00:18:03.316 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:03.316 lat (usec) : 750=6.67%, 1000=78.86% 00:18:03.316 lat (msec) : 2=11.81%, 4=0.19%, 50=2.48% 00:18:03.316 cpu : usr=0.87%, sys=1.45%, ctx=528, majf=0, minf=1 00:18:03.316 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:03.316 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:03.316 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:03.316 issued rwts: total=13,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:03.316 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:03.316 job1: (groupid=0, jobs=1): err= 0: pid=4051693: Fri Apr 26 20:35:21 2024 00:18:03.316 read: IOPS=395, BW=1582KiB/s (1620kB/s)(1584KiB/1001msec) 00:18:03.316 slat (nsec): min=26410, max=63763, avg=27704.83, stdev=4206.27 00:18:03.316 clat (usec): min=1000, max=1497, avg=1293.31, stdev=65.74 00:18:03.316 lat (usec): min=1028, max=1524, avg=1321.02, stdev=65.88 00:18:03.316 clat percentiles (usec): 00:18:03.316 | 1.00th=[ 1123], 5.00th=[ 1156], 10.00th=[ 1205], 20.00th=[ 1254], 00:18:03.316 | 30.00th=[ 1270], 40.00th=[ 1287], 50.00th=[ 1303], 60.00th=[ 1319], 00:18:03.316 | 70.00th=[ 1319], 80.00th=[ 1336], 90.00th=[ 1369], 95.00th=[ 1385], 00:18:03.316 | 99.00th=[ 1418], 99.50th=[ 1434], 99.90th=[ 1500], 99.95th=[ 1500], 00:18:03.316 | 99.99th=[ 1500] 00:18:03.316 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:18:03.316 slat (nsec): min=9182, max=58753, avg=33383.82, stdev=6538.10 00:18:03.316 clat (usec): min=389, max=1169, avg=873.70, stdev=130.77 00:18:03.316 lat (usec): min=408, max=1203, avg=907.09, stdev=133.22 00:18:03.316 clat percentiles (usec): 00:18:03.316 | 1.00th=[ 420], 5.00th=[ 619], 10.00th=[ 693], 20.00th=[ 783], 00:18:03.316 | 30.00th=[ 832], 40.00th=[ 873], 50.00th=[ 906], 60.00th=[ 938], 00:18:03.316 | 70.00th=[ 955], 80.00th=[ 979], 90.00th=[ 1004], 95.00th=[ 1029], 00:18:03.316 | 99.00th=[ 1057], 99.50th=[ 1090], 99.90th=[ 1172], 99.95th=[ 1172], 00:18:03.316 | 99.99th=[ 1172] 00:18:03.316 bw ( KiB/s): min= 4096, max= 4096, per=51.70%, avg=4096.00, stdev= 0.00, samples=1 00:18:03.316 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:03.316 lat (usec) : 500=1.21%, 750=7.60%, 1000=41.30% 00:18:03.316 lat (msec) : 2=49.89% 00:18:03.316 cpu : usr=2.40%, sys=3.40%, ctx=910, majf=0, minf=1 00:18:03.316 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:03.316 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:03.316 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:03.316 issued rwts: total=396,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:03.316 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:03.316 job2: (groupid=0, jobs=1): err= 0: pid=4051694: Fri Apr 26 20:35:21 2024 00:18:03.316 read: IOPS=11, BW=47.6KiB/s (48.7kB/s)(48.0KiB/1009msec) 00:18:03.316 slat (nsec): min=26282, max=27193, avg=26743.42, stdev=299.88 00:18:03.316 clat (usec): min=41472, max=42086, avg=41927.00, stdev=154.19 00:18:03.316 lat (usec): min=41499, max=42113, avg=41953.75, stdev=154.23 00:18:03.316 clat percentiles (usec): 00:18:03.316 | 1.00th=[41681], 5.00th=[41681], 10.00th=[41681], 20.00th=[41681], 00:18:03.316 | 30.00th=[41681], 40.00th=[41681], 50.00th=[42206], 60.00th=[42206], 00:18:03.316 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:18:03.316 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:18:03.316 | 99.99th=[42206] 00:18:03.316 write: IOPS=507, BW=2030KiB/s (2078kB/s)(2048KiB/1009msec); 0 zone resets 00:18:03.316 slat (nsec): min=11612, max=52747, avg=33344.90, stdev=3817.05 00:18:03.316 clat (usec): min=620, max=1414, avg=937.09, stdev=88.92 00:18:03.316 lat (usec): min=653, max=1447, avg=970.43, stdev=89.48 00:18:03.316 clat percentiles (usec): 00:18:03.316 | 1.00th=[ 734], 5.00th=[ 783], 10.00th=[ 832], 20.00th=[ 873], 00:18:03.316 | 30.00th=[ 906], 40.00th=[ 922], 50.00th=[ 947], 60.00th=[ 963], 00:18:03.316 | 70.00th=[ 979], 80.00th=[ 996], 90.00th=[ 1029], 95.00th=[ 1057], 00:18:03.316 | 99.00th=[ 1156], 99.50th=[ 1303], 99.90th=[ 1418], 99.95th=[ 1418], 00:18:03.316 | 99.99th=[ 1418] 00:18:03.316 bw ( KiB/s): min= 40, max= 4056, per=25.85%, avg=2048.00, stdev=2839.74, samples=2 00:18:03.316 iops : min= 10, max= 1014, avg=512.00, stdev=709.94, samples=2 00:18:03.316 lat (usec) : 750=2.86%, 1000=76.53% 00:18:03.316 lat (msec) : 2=18.32%, 50=2.29% 00:18:03.316 cpu : usr=1.29%, sys=2.08%, ctx=526, majf=0, minf=1 00:18:03.316 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:03.316 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:03.316 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:03.316 issued rwts: total=12,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:03.316 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:03.316 job3: (groupid=0, jobs=1): err= 0: pid=4051695: Fri Apr 26 20:35:21 2024 00:18:03.316 read: IOPS=386, BW=1545KiB/s (1582kB/s)(1548KiB/1002msec) 00:18:03.316 slat (nsec): min=6659, max=45166, avg=24794.96, stdev=4554.95 00:18:03.316 clat (usec): min=985, max=1709, avg=1277.26, stdev=90.19 00:18:03.316 lat (usec): min=992, max=1735, avg=1302.06, stdev=91.06 00:18:03.316 clat percentiles (usec): 00:18:03.316 | 1.00th=[ 1029], 5.00th=[ 1106], 10.00th=[ 1156], 20.00th=[ 1221], 00:18:03.316 | 30.00th=[ 1254], 40.00th=[ 1270], 50.00th=[ 1303], 60.00th=[ 1303], 00:18:03.316 | 70.00th=[ 1319], 80.00th=[ 1352], 90.00th=[ 1369], 95.00th=[ 1385], 00:18:03.316 | 99.00th=[ 1450], 99.50th=[ 1483], 99.90th=[ 1713], 99.95th=[ 1713], 00:18:03.316 | 99.99th=[ 1713] 00:18:03.316 write: IOPS=510, BW=2044KiB/s (2093kB/s)(2048KiB/1002msec); 0 zone resets 00:18:03.316 slat (nsec): min=9711, max=50846, avg=29227.13, stdev=8289.83 00:18:03.316 clat (usec): min=590, max=1190, avg=919.05, stdev=88.13 00:18:03.316 lat (usec): min=623, max=1206, avg=948.28, stdev=90.72 00:18:03.316 clat percentiles (usec): 00:18:03.316 | 1.00th=[ 709], 5.00th=[ 758], 10.00th=[ 799], 20.00th=[ 840], 00:18:03.316 | 30.00th=[ 873], 40.00th=[ 906], 50.00th=[ 930], 60.00th=[ 955], 00:18:03.316 | 70.00th=[ 971], 80.00th=[ 988], 90.00th=[ 1012], 95.00th=[ 1045], 00:18:03.316 | 99.00th=[ 1090], 99.50th=[ 1156], 99.90th=[ 1188], 99.95th=[ 1188], 00:18:03.316 | 99.99th=[ 1188] 00:18:03.316 bw ( KiB/s): min= 4096, max= 4096, per=51.70%, avg=4096.00, stdev= 0.00, samples=1 00:18:03.316 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:03.316 lat (usec) : 750=2.56%, 1000=45.94% 00:18:03.316 lat (msec) : 2=51.50% 00:18:03.316 cpu : usr=1.60%, sys=2.40%, ctx=900, majf=0, minf=1 00:18:03.316 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:03.316 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:03.316 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:03.316 issued rwts: total=387,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:03.316 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:03.316 00:18:03.316 Run status group 0 (all jobs): 00:18:03.316 READ: bw=3126KiB/s (3201kB/s), 47.6KiB/s-1582KiB/s (48.7kB/s-1620kB/s), io=3232KiB (3310kB), run=1001-1034msec 00:18:03.316 WRITE: bw=7923KiB/s (8113kB/s), 1981KiB/s-2046KiB/s (2028kB/s-2095kB/s), io=8192KiB (8389kB), run=1001-1034msec 00:18:03.316 00:18:03.316 Disk stats (read/write): 00:18:03.316 nvme0n1: ios=51/512, merge=0/0, ticks=542/450, in_queue=992, util=87.37% 00:18:03.316 nvme0n2: ios=317/512, merge=0/0, ticks=743/366, in_queue=1109, util=91.23% 00:18:03.316 nvme0n3: ios=59/512, merge=0/0, ticks=699/399, in_queue=1098, util=95.36% 00:18:03.316 nvme0n4: ios=287/512, merge=0/0, ticks=1213/476, in_queue=1689, util=93.92% 00:18:03.316 20:35:21 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:18:03.316 [global] 00:18:03.316 thread=1 00:18:03.316 invalidate=1 00:18:03.316 rw=write 00:18:03.316 time_based=1 00:18:03.316 runtime=1 00:18:03.316 ioengine=libaio 00:18:03.316 direct=1 00:18:03.316 bs=4096 00:18:03.316 iodepth=128 00:18:03.316 norandommap=0 00:18:03.316 numjobs=1 00:18:03.316 00:18:03.317 verify_dump=1 00:18:03.317 verify_backlog=512 00:18:03.317 verify_state_save=0 00:18:03.317 do_verify=1 00:18:03.317 verify=crc32c-intel 00:18:03.317 [job0] 00:18:03.317 filename=/dev/nvme0n1 00:18:03.317 [job1] 00:18:03.317 filename=/dev/nvme0n2 00:18:03.317 [job2] 00:18:03.317 filename=/dev/nvme0n3 00:18:03.317 [job3] 00:18:03.317 filename=/dev/nvme0n4 00:18:03.317 Could not set queue depth (nvme0n1) 00:18:03.317 Could not set queue depth (nvme0n2) 00:18:03.317 Could not set queue depth (nvme0n3) 00:18:03.317 Could not set queue depth (nvme0n4) 00:18:03.577 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:03.577 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:03.577 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:03.577 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:03.577 fio-3.35 00:18:03.577 Starting 4 threads 00:18:04.963 00:18:04.963 job0: (groupid=0, jobs=1): err= 0: pid=4052213: Fri Apr 26 20:35:23 2024 00:18:04.963 read: IOPS=5084, BW=19.9MiB/s (20.8MB/s)(20.0MiB/1007msec) 00:18:04.963 slat (nsec): min=932, max=14359k, avg=90779.84, stdev=650349.02 00:18:04.963 clat (usec): min=4813, max=41970, avg=11307.45, stdev=6570.29 00:18:04.963 lat (usec): min=4815, max=41997, avg=11398.23, stdev=6630.92 00:18:04.963 clat percentiles (usec): 00:18:04.963 | 1.00th=[ 5145], 5.00th=[ 5800], 10.00th=[ 6259], 20.00th=[ 6849], 00:18:04.963 | 30.00th=[ 7373], 40.00th=[ 8160], 50.00th=[ 8848], 60.00th=[ 9634], 00:18:04.963 | 70.00th=[10814], 80.00th=[14615], 90.00th=[20317], 95.00th=[27395], 00:18:04.963 | 99.00th=[32637], 99.50th=[35914], 99.90th=[38536], 99.95th=[39060], 00:18:04.963 | 99.99th=[42206] 00:18:04.963 write: IOPS=5457, BW=21.3MiB/s (22.4MB/s)(21.5MiB/1007msec); 0 zone resets 00:18:04.963 slat (nsec): min=1543, max=9683.0k, avg=93291.97, stdev=451380.81 00:18:04.963 clat (usec): min=1163, max=48301, avg=12707.23, stdev=7983.81 00:18:04.963 lat (usec): min=1173, max=48309, avg=12800.52, stdev=8033.41 00:18:04.963 clat percentiles (usec): 00:18:04.963 | 1.00th=[ 3195], 5.00th=[ 4948], 10.00th=[ 6063], 20.00th=[ 7373], 00:18:04.963 | 30.00th=[ 8717], 40.00th=[10290], 50.00th=[11076], 60.00th=[11994], 00:18:04.963 | 70.00th=[12780], 80.00th=[13960], 90.00th=[20841], 95.00th=[34866], 00:18:04.964 | 99.00th=[41681], 99.50th=[44303], 99.90th=[48497], 99.95th=[48497], 00:18:04.964 | 99.99th=[48497] 00:18:04.964 bw ( KiB/s): min=16384, max=26560, per=27.11%, avg=21472.00, stdev=7195.52, samples=2 00:18:04.964 iops : min= 4096, max= 6640, avg=5368.00, stdev=1798.88, samples=2 00:18:04.964 lat (msec) : 2=0.02%, 4=0.89%, 10=49.07%, 20=39.43%, 50=10.60% 00:18:04.964 cpu : usr=3.08%, sys=3.78%, ctx=681, majf=0, minf=1 00:18:04.964 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:18:04.964 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:04.964 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:04.964 issued rwts: total=5120,5496,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:04.964 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:04.964 job1: (groupid=0, jobs=1): err= 0: pid=4052214: Fri Apr 26 20:35:23 2024 00:18:04.964 read: IOPS=6616, BW=25.8MiB/s (27.1MB/s)(26.0MiB/1006msec) 00:18:04.964 slat (nsec): min=883, max=10290k, avg=65597.59, stdev=399079.89 00:18:04.964 clat (usec): min=4119, max=23981, avg=8595.83, stdev=3425.43 00:18:04.964 lat (usec): min=4121, max=23992, avg=8661.43, stdev=3454.66 00:18:04.964 clat percentiles (usec): 00:18:04.964 | 1.00th=[ 4490], 5.00th=[ 5276], 10.00th=[ 5604], 20.00th=[ 6063], 00:18:04.964 | 30.00th=[ 6390], 40.00th=[ 6849], 50.00th=[ 7767], 60.00th=[ 8586], 00:18:04.964 | 70.00th=[ 9241], 80.00th=[10159], 90.00th=[13173], 95.00th=[15926], 00:18:04.964 | 99.00th=[21103], 99.50th=[22414], 99.90th=[23987], 99.95th=[23987], 00:18:04.964 | 99.99th=[23987] 00:18:04.964 write: IOPS=7052, BW=27.5MiB/s (28.9MB/s)(27.7MiB/1006msec); 0 zone resets 00:18:04.964 slat (nsec): min=1561, max=14452k, avg=71698.28, stdev=400649.98 00:18:04.964 clat (usec): min=1252, max=32330, avg=9895.22, stdev=5016.91 00:18:04.964 lat (usec): min=1262, max=32333, avg=9966.92, stdev=5041.52 00:18:04.964 clat percentiles (usec): 00:18:04.964 | 1.00th=[ 2802], 5.00th=[ 4424], 10.00th=[ 5080], 20.00th=[ 5669], 00:18:04.964 | 30.00th=[ 6521], 40.00th=[ 7504], 50.00th=[ 8586], 60.00th=[ 9896], 00:18:04.964 | 70.00th=[11207], 80.00th=[13566], 90.00th=[17171], 95.00th=[19792], 00:18:04.964 | 99.00th=[27657], 99.50th=[29230], 99.90th=[30540], 99.95th=[32375], 00:18:04.964 | 99.99th=[32375] 00:18:04.964 bw ( KiB/s): min=22968, max=32768, per=35.18%, avg=27868.00, stdev=6929.65, samples=2 00:18:04.964 iops : min= 5742, max= 8192, avg=6967.00, stdev=1732.41, samples=2 00:18:04.964 lat (msec) : 2=0.13%, 4=1.49%, 10=67.33%, 20=27.71%, 50=3.33% 00:18:04.964 cpu : usr=2.99%, sys=3.98%, ctx=970, majf=0, minf=1 00:18:04.964 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:18:04.964 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:04.964 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:04.964 issued rwts: total=6656,7095,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:04.964 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:04.964 job2: (groupid=0, jobs=1): err= 0: pid=4052215: Fri Apr 26 20:35:23 2024 00:18:04.964 read: IOPS=3562, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1006msec) 00:18:04.964 slat (nsec): min=997, max=10206k, avg=114851.41, stdev=726905.60 00:18:04.964 clat (usec): min=5672, max=47547, avg=15473.37, stdev=4943.53 00:18:04.964 lat (usec): min=5676, max=47550, avg=15588.22, stdev=5005.17 00:18:04.964 clat percentiles (usec): 00:18:04.964 | 1.00th=[ 6783], 5.00th=[ 9503], 10.00th=[10421], 20.00th=[11994], 00:18:04.964 | 30.00th=[12911], 40.00th=[13829], 50.00th=[14877], 60.00th=[15926], 00:18:04.964 | 70.00th=[16712], 80.00th=[18220], 90.00th=[20317], 95.00th=[22414], 00:18:04.964 | 99.00th=[38536], 99.50th=[40109], 99.90th=[47449], 99.95th=[47449], 00:18:04.964 | 99.99th=[47449] 00:18:04.964 write: IOPS=3744, BW=14.6MiB/s (15.3MB/s)(14.7MiB/1006msec); 0 zone resets 00:18:04.964 slat (nsec): min=1655, max=45188k, avg=132324.25, stdev=974181.26 00:18:04.964 clat (usec): min=1622, max=63682, avg=19134.66, stdev=12185.43 00:18:04.964 lat (usec): min=1625, max=63689, avg=19266.98, stdev=12253.83 00:18:04.964 clat percentiles (usec): 00:18:04.964 | 1.00th=[ 2245], 5.00th=[ 5604], 10.00th=[ 8586], 20.00th=[10945], 00:18:04.964 | 30.00th=[12125], 40.00th=[13173], 50.00th=[15008], 60.00th=[17171], 00:18:04.964 | 70.00th=[19530], 80.00th=[28967], 90.00th=[38011], 95.00th=[43779], 00:18:04.964 | 99.00th=[62129], 99.50th=[63701], 99.90th=[63701], 99.95th=[63701], 00:18:04.964 | 99.99th=[63701] 00:18:04.964 bw ( KiB/s): min=12736, max=16384, per=18.38%, avg=14560.00, stdev=2579.53, samples=2 00:18:04.964 iops : min= 3184, max= 4096, avg=3640.00, stdev=644.88, samples=2 00:18:04.964 lat (msec) : 2=0.33%, 4=1.40%, 10=8.77%, 20=69.12%, 50=19.40% 00:18:04.964 lat (msec) : 100=0.98% 00:18:04.964 cpu : usr=2.39%, sys=4.38%, ctx=416, majf=0, minf=1 00:18:04.964 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:18:04.964 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:04.964 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:04.964 issued rwts: total=3584,3767,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:04.964 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:04.964 job3: (groupid=0, jobs=1): err= 0: pid=4052216: Fri Apr 26 20:35:23 2024 00:18:04.964 read: IOPS=3242, BW=12.7MiB/s (13.3MB/s)(12.7MiB/1006msec) 00:18:04.964 slat (nsec): min=918, max=21811k, avg=154733.74, stdev=1048659.87 00:18:04.964 clat (usec): min=2645, max=54416, avg=19898.87, stdev=6350.26 00:18:04.964 lat (usec): min=8389, max=54430, avg=20053.60, stdev=6440.17 00:18:04.964 clat percentiles (usec): 00:18:04.964 | 1.00th=[ 8979], 5.00th=[12911], 10.00th=[13960], 20.00th=[15008], 00:18:04.964 | 30.00th=[16057], 40.00th=[16909], 50.00th=[17957], 60.00th=[19268], 00:18:04.964 | 70.00th=[21365], 80.00th=[25035], 90.00th=[29492], 95.00th=[32637], 00:18:04.964 | 99.00th=[38011], 99.50th=[39060], 99.90th=[47449], 99.95th=[47449], 00:18:04.964 | 99.99th=[54264] 00:18:04.964 write: IOPS=3562, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1006msec); 0 zone resets 00:18:04.964 slat (nsec): min=1595, max=12206k, avg=134142.28, stdev=714845.51 00:18:04.964 clat (usec): min=1178, max=39534, avg=17491.70, stdev=6568.33 00:18:04.964 lat (usec): min=1219, max=39538, avg=17625.85, stdev=6620.42 00:18:04.964 clat percentiles (usec): 00:18:04.964 | 1.00th=[ 7308], 5.00th=[10421], 10.00th=[11207], 20.00th=[12387], 00:18:04.964 | 30.00th=[13304], 40.00th=[14484], 50.00th=[15270], 60.00th=[17433], 00:18:04.964 | 70.00th=[18744], 80.00th=[21627], 90.00th=[27395], 95.00th=[32113], 00:18:04.964 | 99.00th=[36439], 99.50th=[36963], 99.90th=[39584], 99.95th=[39584], 00:18:04.964 | 99.99th=[39584] 00:18:04.964 bw ( KiB/s): min=12288, max=16384, per=18.10%, avg=14336.00, stdev=2896.31, samples=2 00:18:04.964 iops : min= 3072, max= 4096, avg=3584.00, stdev=724.08, samples=2 00:18:04.964 lat (msec) : 2=0.01%, 4=0.13%, 10=2.16%, 20=67.69%, 50=29.99% 00:18:04.964 lat (msec) : 100=0.01% 00:18:04.964 cpu : usr=2.29%, sys=3.58%, ctx=363, majf=0, minf=1 00:18:04.964 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:18:04.964 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:04.964 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:04.964 issued rwts: total=3262,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:04.964 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:04.964 00:18:04.964 Run status group 0 (all jobs): 00:18:04.964 READ: bw=72.2MiB/s (75.7MB/s), 12.7MiB/s-25.8MiB/s (13.3MB/s-27.1MB/s), io=72.7MiB (76.3MB), run=1006-1007msec 00:18:04.964 WRITE: bw=77.4MiB/s (81.1MB/s), 13.9MiB/s-27.5MiB/s (14.6MB/s-28.9MB/s), io=77.9MiB (81.7MB), run=1006-1007msec 00:18:04.964 00:18:04.964 Disk stats (read/write): 00:18:04.964 nvme0n1: ios=3988/4096, merge=0/0, ticks=41228/43094, in_queue=84322, util=88.78% 00:18:04.964 nvme0n2: ios=5687/6144, merge=0/0, ticks=26576/32379, in_queue=58955, util=97.25% 00:18:04.964 nvme0n3: ios=3101/3375, merge=0/0, ticks=36571/48107, in_queue=84678, util=96.72% 00:18:04.964 nvme0n4: ios=2604/2703, merge=0/0, ticks=28934/30154, in_queue=59088, util=92.93% 00:18:04.964 20:35:23 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:18:04.964 [global] 00:18:04.964 thread=1 00:18:04.964 invalidate=1 00:18:04.964 rw=randwrite 00:18:04.964 time_based=1 00:18:04.964 runtime=1 00:18:04.964 ioengine=libaio 00:18:04.964 direct=1 00:18:04.964 bs=4096 00:18:04.964 iodepth=128 00:18:04.964 norandommap=0 00:18:04.964 numjobs=1 00:18:04.964 00:18:04.964 verify_dump=1 00:18:04.964 verify_backlog=512 00:18:04.964 verify_state_save=0 00:18:04.964 do_verify=1 00:18:04.964 verify=crc32c-intel 00:18:04.964 [job0] 00:18:04.964 filename=/dev/nvme0n1 00:18:04.964 [job1] 00:18:04.964 filename=/dev/nvme0n2 00:18:04.964 [job2] 00:18:04.964 filename=/dev/nvme0n3 00:18:04.964 [job3] 00:18:04.964 filename=/dev/nvme0n4 00:18:04.964 Could not set queue depth (nvme0n1) 00:18:04.964 Could not set queue depth (nvme0n2) 00:18:04.964 Could not set queue depth (nvme0n3) 00:18:04.964 Could not set queue depth (nvme0n4) 00:18:05.224 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:05.224 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:05.224 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:05.224 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:18:05.224 fio-3.35 00:18:05.224 Starting 4 threads 00:18:06.611 00:18:06.611 job0: (groupid=0, jobs=1): err= 0: pid=4052744: Fri Apr 26 20:35:24 2024 00:18:06.611 read: IOPS=5079, BW=19.8MiB/s (20.8MB/s)(20.0MiB/1008msec) 00:18:06.611 slat (nsec): min=921, max=29053k, avg=99492.72, stdev=768775.54 00:18:06.611 clat (usec): min=4152, max=41466, avg=12445.19, stdev=5478.33 00:18:06.611 lat (usec): min=4170, max=41493, avg=12544.68, stdev=5519.90 00:18:06.611 clat percentiles (usec): 00:18:06.611 | 1.00th=[ 5997], 5.00th=[ 6587], 10.00th=[ 8455], 20.00th=[ 9503], 00:18:06.611 | 30.00th=[ 9896], 40.00th=[10290], 50.00th=[10683], 60.00th=[11076], 00:18:06.611 | 70.00th=[12518], 80.00th=[14746], 90.00th=[17433], 95.00th=[23200], 00:18:06.611 | 99.00th=[35914], 99.50th=[35914], 99.90th=[38536], 99.95th=[38536], 00:18:06.611 | 99.99th=[41681] 00:18:06.611 write: IOPS=5490, BW=21.4MiB/s (22.5MB/s)(21.6MiB/1008msec); 0 zone resets 00:18:06.611 slat (nsec): min=1576, max=9239.5k, avg=78017.63, stdev=480023.58 00:18:06.611 clat (usec): min=1187, max=38295, avg=11601.90, stdev=5124.80 00:18:06.611 lat (usec): min=1202, max=38303, avg=11679.92, stdev=5147.64 00:18:06.611 clat percentiles (usec): 00:18:06.611 | 1.00th=[ 2900], 5.00th=[ 4883], 10.00th=[ 6390], 20.00th=[ 8225], 00:18:06.611 | 30.00th=[ 9503], 40.00th=[10159], 50.00th=[10421], 60.00th=[10945], 00:18:06.611 | 70.00th=[12125], 80.00th=[14746], 90.00th=[18220], 95.00th=[21890], 00:18:06.611 | 99.00th=[28967], 99.50th=[31065], 99.90th=[34866], 99.95th=[34866], 00:18:06.611 | 99.99th=[38536] 00:18:06.611 bw ( KiB/s): min=20160, max=23096, per=23.14%, avg=21628.00, stdev=2076.07, samples=2 00:18:06.611 iops : min= 5040, max= 5774, avg=5407.00, stdev=519.02, samples=2 00:18:06.611 lat (msec) : 2=0.27%, 4=0.94%, 10=34.49%, 20=57.23%, 50=7.07% 00:18:06.611 cpu : usr=3.57%, sys=4.77%, ctx=616, majf=0, minf=1 00:18:06.611 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:18:06.611 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:06.611 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:06.611 issued rwts: total=5120,5534,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:06.611 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:06.611 job1: (groupid=0, jobs=1): err= 0: pid=4052745: Fri Apr 26 20:35:24 2024 00:18:06.611 read: IOPS=8627, BW=33.7MiB/s (35.3MB/s)(33.9MiB/1005msec) 00:18:06.611 slat (nsec): min=927, max=6091.4k, avg=57112.27, stdev=355682.40 00:18:06.611 clat (usec): min=3269, max=18729, avg=7383.74, stdev=1790.33 00:18:06.611 lat (usec): min=3606, max=18731, avg=7440.85, stdev=1807.36 00:18:06.611 clat percentiles (usec): 00:18:06.611 | 1.00th=[ 4883], 5.00th=[ 5407], 10.00th=[ 5735], 20.00th=[ 6063], 00:18:06.611 | 30.00th=[ 6325], 40.00th=[ 6587], 50.00th=[ 6849], 60.00th=[ 7242], 00:18:06.611 | 70.00th=[ 7832], 80.00th=[ 8586], 90.00th=[ 9634], 95.00th=[10945], 00:18:06.611 | 99.00th=[13042], 99.50th=[14746], 99.90th=[17695], 99.95th=[18744], 00:18:06.611 | 99.99th=[18744] 00:18:06.611 write: IOPS=8660, BW=33.8MiB/s (35.5MB/s)(34.0MiB/1005msec); 0 zone resets 00:18:06.611 slat (nsec): min=1539, max=30680k, avg=54639.62, stdev=444069.85 00:18:06.611 clat (usec): min=1177, max=42751, avg=7288.91, stdev=4099.94 00:18:06.611 lat (usec): min=1188, max=42756, avg=7343.55, stdev=4116.26 00:18:06.611 clat percentiles (usec): 00:18:06.611 | 1.00th=[ 2900], 5.00th=[ 3621], 10.00th=[ 4293], 20.00th=[ 5276], 00:18:06.611 | 30.00th=[ 6063], 40.00th=[ 6521], 50.00th=[ 6783], 60.00th=[ 7111], 00:18:06.611 | 70.00th=[ 7373], 80.00th=[ 8094], 90.00th=[ 9896], 95.00th=[11600], 00:18:06.611 | 99.00th=[34341], 99.50th=[37487], 99.90th=[42206], 99.95th=[42206], 00:18:06.611 | 99.99th=[42730] 00:18:06.611 bw ( KiB/s): min=33384, max=36248, per=37.26%, avg=34816.00, stdev=2025.15, samples=2 00:18:06.611 iops : min= 8346, max= 9062, avg=8704.00, stdev=506.29, samples=2 00:18:06.611 lat (msec) : 2=0.01%, 4=4.14%, 10=87.14%, 20=7.98%, 50=0.73% 00:18:06.611 cpu : usr=4.48%, sys=6.27%, ctx=831, majf=0, minf=1 00:18:06.611 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:18:06.611 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:06.611 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:06.611 issued rwts: total=8671,8704,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:06.611 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:06.611 job2: (groupid=0, jobs=1): err= 0: pid=4052747: Fri Apr 26 20:35:24 2024 00:18:06.611 read: IOPS=4557, BW=17.8MiB/s (18.7MB/s)(18.0MiB/1011msec) 00:18:06.611 slat (nsec): min=932, max=9240.4k, avg=104963.51, stdev=708007.06 00:18:06.611 clat (usec): min=5347, max=27212, avg=13650.93, stdev=2525.61 00:18:06.611 lat (usec): min=5354, max=27220, avg=13755.89, stdev=2599.06 00:18:06.611 clat percentiles (usec): 00:18:06.611 | 1.00th=[ 8029], 5.00th=[ 9241], 10.00th=[10421], 20.00th=[12125], 00:18:06.611 | 30.00th=[12911], 40.00th=[13435], 50.00th=[13698], 60.00th=[13960], 00:18:06.611 | 70.00th=[14091], 80.00th=[15270], 90.00th=[16712], 95.00th=[18482], 00:18:06.611 | 99.00th=[20841], 99.50th=[20841], 99.90th=[24773], 99.95th=[26608], 00:18:06.611 | 99.99th=[27132] 00:18:06.611 write: IOPS=4722, BW=18.4MiB/s (19.3MB/s)(18.6MiB/1011msec); 0 zone resets 00:18:06.611 slat (nsec): min=1564, max=16289k, avg=101457.44, stdev=637159.71 00:18:06.611 clat (usec): min=1260, max=28806, avg=13694.72, stdev=3739.17 00:18:06.611 lat (usec): min=1302, max=28819, avg=13796.18, stdev=3773.74 00:18:06.611 clat percentiles (usec): 00:18:06.611 | 1.00th=[ 3851], 5.00th=[ 9110], 10.00th=[10159], 20.00th=[11338], 00:18:06.611 | 30.00th=[11994], 40.00th=[12518], 50.00th=[13042], 60.00th=[13829], 00:18:06.611 | 70.00th=[14746], 80.00th=[15664], 90.00th=[17695], 95.00th=[19530], 00:18:06.611 | 99.00th=[26870], 99.50th=[27395], 99.90th=[27657], 99.95th=[28181], 00:18:06.611 | 99.99th=[28705] 00:18:06.611 bw ( KiB/s): min=17248, max=19928, per=19.89%, avg=18588.00, stdev=1895.05, samples=2 00:18:06.611 iops : min= 4312, max= 4982, avg=4647.00, stdev=473.76, samples=2 00:18:06.611 lat (msec) : 2=0.01%, 4=0.54%, 10=7.65%, 20=88.44%, 50=3.36% 00:18:06.611 cpu : usr=2.48%, sys=4.95%, ctx=522, majf=0, minf=1 00:18:06.611 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:18:06.611 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:06.611 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:06.611 issued rwts: total=4608,4774,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:06.611 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:06.611 job3: (groupid=0, jobs=1): err= 0: pid=4052748: Fri Apr 26 20:35:24 2024 00:18:06.611 read: IOPS=4464, BW=17.4MiB/s (18.3MB/s)(17.5MiB/1006msec) 00:18:06.611 slat (nsec): min=942, max=53393k, avg=109610.43, stdev=1011347.23 00:18:06.611 clat (usec): min=4909, max=69182, avg=13509.08, stdev=6383.91 00:18:06.611 lat (usec): min=4920, max=69191, avg=13618.69, stdev=6458.50 00:18:06.611 clat percentiles (usec): 00:18:06.611 | 1.00th=[ 5669], 5.00th=[ 9503], 10.00th=[10552], 20.00th=[11469], 00:18:06.611 | 30.00th=[11994], 40.00th=[12387], 50.00th=[12780], 60.00th=[13304], 00:18:06.611 | 70.00th=[13566], 80.00th=[13960], 90.00th=[15401], 95.00th=[17171], 00:18:06.611 | 99.00th=[62653], 99.50th=[65799], 99.90th=[68682], 99.95th=[68682], 00:18:06.611 | 99.99th=[68682] 00:18:06.611 write: IOPS=4580, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1006msec); 0 zone resets 00:18:06.611 slat (nsec): min=1588, max=17659k, avg=105464.19, stdev=728161.77 00:18:06.611 clat (usec): min=5191, max=69180, avg=14350.64, stdev=6599.08 00:18:06.611 lat (usec): min=5200, max=69188, avg=14456.11, stdev=6630.86 00:18:06.611 clat percentiles (usec): 00:18:06.611 | 1.00th=[ 8848], 5.00th=[10159], 10.00th=[10945], 20.00th=[11600], 00:18:06.611 | 30.00th=[12125], 40.00th=[12649], 50.00th=[12911], 60.00th=[13435], 00:18:06.611 | 70.00th=[14091], 80.00th=[14746], 90.00th=[16909], 95.00th=[26084], 00:18:06.611 | 99.00th=[61080], 99.50th=[61604], 99.90th=[67634], 99.95th=[67634], 00:18:06.611 | 99.99th=[68682] 00:18:06.611 bw ( KiB/s): min=17400, max=19464, per=19.72%, avg=18432.00, stdev=1459.47, samples=2 00:18:06.611 iops : min= 4350, max= 4866, avg=4608.00, stdev=364.87, samples=2 00:18:06.611 lat (msec) : 10=5.41%, 20=90.72%, 50=2.47%, 100=1.40% 00:18:06.611 cpu : usr=3.78%, sys=3.98%, ctx=384, majf=0, minf=2 00:18:06.611 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:18:06.611 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:06.611 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:06.611 issued rwts: total=4491,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:06.611 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:06.611 00:18:06.611 Run status group 0 (all jobs): 00:18:06.611 READ: bw=88.4MiB/s (92.7MB/s), 17.4MiB/s-33.7MiB/s (18.3MB/s-35.3MB/s), io=89.4MiB (93.8MB), run=1005-1011msec 00:18:06.611 WRITE: bw=91.3MiB/s (95.7MB/s), 17.9MiB/s-33.8MiB/s (18.8MB/s-35.5MB/s), io=92.3MiB (96.7MB), run=1005-1011msec 00:18:06.611 00:18:06.611 Disk stats (read/write): 00:18:06.612 nvme0n1: ios=4117/4521, merge=0/0, ticks=44243/40021, in_queue=84264, util=84.47% 00:18:06.612 nvme0n2: ios=7208/7199, merge=0/0, ticks=52065/48289, in_queue=100354, util=91.34% 00:18:06.612 nvme0n3: ios=3794/4096, merge=0/0, ticks=27685/30883, in_queue=58568, util=92.20% 00:18:06.612 nvme0n4: ios=3634/3909, merge=0/0, ticks=25905/25526, in_queue=51431, util=97.23% 00:18:06.612 20:35:24 -- target/fio.sh@55 -- # sync 00:18:06.612 20:35:24 -- target/fio.sh@59 -- # fio_pid=4052959 00:18:06.612 20:35:24 -- target/fio.sh@61 -- # sleep 3 00:18:06.612 20:35:24 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:18:06.612 [global] 00:18:06.612 thread=1 00:18:06.612 invalidate=1 00:18:06.612 rw=read 00:18:06.612 time_based=1 00:18:06.612 runtime=10 00:18:06.612 ioengine=libaio 00:18:06.612 direct=1 00:18:06.612 bs=4096 00:18:06.612 iodepth=1 00:18:06.612 norandommap=1 00:18:06.612 numjobs=1 00:18:06.612 00:18:06.612 [job0] 00:18:06.612 filename=/dev/nvme0n1 00:18:06.612 [job1] 00:18:06.612 filename=/dev/nvme0n2 00:18:06.612 [job2] 00:18:06.612 filename=/dev/nvme0n3 00:18:06.612 [job3] 00:18:06.612 filename=/dev/nvme0n4 00:18:06.612 Could not set queue depth (nvme0n1) 00:18:06.612 Could not set queue depth (nvme0n2) 00:18:06.612 Could not set queue depth (nvme0n3) 00:18:06.612 Could not set queue depth (nvme0n4) 00:18:06.870 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:06.870 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:06.870 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:06.870 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:06.870 fio-3.35 00:18:06.870 Starting 4 threads 00:18:10.187 20:35:27 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:18:10.187 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=6983680, buflen=4096 00:18:10.187 fio: pid=4053278, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:18:10.187 20:35:27 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:18:10.187 20:35:28 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:10.187 20:35:28 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:18:10.187 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=335872, buflen=4096 00:18:10.187 fio: pid=4053277, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:18:10.187 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=7368704, buflen=4096 00:18:10.187 fio: pid=4053275, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:18:10.187 20:35:28 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:10.187 20:35:28 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:18:10.187 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=11169792, buflen=4096 00:18:10.187 fio: pid=4053276, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:18:10.187 20:35:28 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:10.187 20:35:28 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:18:10.187 00:18:10.187 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=4053275: Fri Apr 26 20:35:28 2024 00:18:10.187 read: IOPS=621, BW=2483KiB/s (2543kB/s)(7196KiB/2898msec) 00:18:10.187 slat (usec): min=8, max=17420, avg=56.10, stdev=655.30 00:18:10.187 clat (usec): min=1133, max=2193, avg=1547.53, stdev=109.02 00:18:10.187 lat (usec): min=1160, max=19158, avg=1603.64, stdev=669.12 00:18:10.187 clat percentiles (usec): 00:18:10.187 | 1.00th=[ 1287], 5.00th=[ 1369], 10.00th=[ 1418], 20.00th=[ 1467], 00:18:10.187 | 30.00th=[ 1483], 40.00th=[ 1516], 50.00th=[ 1549], 60.00th=[ 1582], 00:18:10.187 | 70.00th=[ 1598], 80.00th=[ 1631], 90.00th=[ 1680], 95.00th=[ 1729], 00:18:10.187 | 99.00th=[ 1795], 99.50th=[ 1811], 99.90th=[ 2180], 99.95th=[ 2180], 00:18:10.187 | 99.99th=[ 2180] 00:18:10.187 bw ( KiB/s): min= 2512, max= 2552, per=30.78%, avg=2532.80, stdev=18.42, samples=5 00:18:10.187 iops : min= 628, max= 638, avg=633.20, stdev= 4.60, samples=5 00:18:10.187 lat (msec) : 2=99.83%, 4=0.11% 00:18:10.187 cpu : usr=1.00%, sys=2.62%, ctx=1805, majf=0, minf=1 00:18:10.187 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:10.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:10.187 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:10.187 issued rwts: total=1800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:10.187 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:10.187 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=4053276: Fri Apr 26 20:35:28 2024 00:18:10.187 read: IOPS=888, BW=3553KiB/s (3638kB/s)(10.7MiB/3070msec) 00:18:10.187 slat (usec): min=5, max=20593, avg=53.93, stdev=664.27 00:18:10.187 clat (usec): min=249, max=43112, avg=1064.16, stdev=1187.22 00:18:10.187 lat (usec): min=256, max=43137, avg=1118.10, stdev=1355.58 00:18:10.187 clat percentiles (usec): 00:18:10.187 | 1.00th=[ 400], 5.00th=[ 545], 10.00th=[ 627], 20.00th=[ 709], 00:18:10.187 | 30.00th=[ 766], 40.00th=[ 824], 50.00th=[ 873], 60.00th=[ 1287], 00:18:10.187 | 70.00th=[ 1401], 80.00th=[ 1450], 90.00th=[ 1500], 95.00th=[ 1532], 00:18:10.187 | 99.00th=[ 1582], 99.50th=[ 1598], 99.90th=[ 2278], 99.95th=[42730], 00:18:10.187 | 99.99th=[43254] 00:18:10.187 bw ( KiB/s): min= 2704, max= 5040, per=40.41%, avg=3324.80, stdev=1010.42, samples=5 00:18:10.187 iops : min= 676, max= 1260, avg=831.20, stdev=252.60, samples=5 00:18:10.187 lat (usec) : 250=0.04%, 500=2.97%, 750=24.67%, 1000=29.88% 00:18:10.187 lat (msec) : 2=42.30%, 4=0.04%, 50=0.07% 00:18:10.187 cpu : usr=1.11%, sys=3.00%, ctx=2736, majf=0, minf=1 00:18:10.187 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:10.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:10.187 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:10.187 issued rwts: total=2728,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:10.187 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:10.187 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=4053277: Fri Apr 26 20:35:28 2024 00:18:10.187 read: IOPS=29, BW=119KiB/s (121kB/s)(328KiB/2767msec) 00:18:10.187 slat (usec): min=6, max=15450, avg=209.12, stdev=1693.32 00:18:10.187 clat (usec): min=566, max=42885, avg=33489.38, stdev=16671.33 00:18:10.187 lat (usec): min=573, max=56933, avg=33700.73, stdev=16853.77 00:18:10.187 clat percentiles (usec): 00:18:10.187 | 1.00th=[ 570], 5.00th=[ 742], 10.00th=[ 824], 20.00th=[ 4817], 00:18:10.187 | 30.00th=[41681], 40.00th=[41681], 50.00th=[42206], 60.00th=[42206], 00:18:10.187 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:18:10.187 | 99.00th=[42730], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:18:10.187 | 99.99th=[42730] 00:18:10.187 bw ( KiB/s): min= 96, max= 216, per=1.47%, avg=121.60, stdev=52.88, samples=5 00:18:10.187 iops : min= 24, max= 54, avg=30.40, stdev=13.22, samples=5 00:18:10.187 lat (usec) : 750=6.02%, 1000=9.64% 00:18:10.187 lat (msec) : 2=3.61%, 10=1.20%, 50=78.31% 00:18:10.187 cpu : usr=0.14%, sys=0.00%, ctx=84, majf=0, minf=1 00:18:10.187 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:10.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:10.187 complete : 0=1.2%, 4=98.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:10.187 issued rwts: total=83,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:10.187 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:10.187 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=4053278: Fri Apr 26 20:35:28 2024 00:18:10.187 read: IOPS=665, BW=2659KiB/s (2723kB/s)(6820KiB/2565msec) 00:18:10.187 slat (nsec): min=26146, max=67025, avg=27803.97, stdev=3747.69 00:18:10.187 clat (usec): min=1120, max=1740, avg=1467.45, stdev=65.51 00:18:10.187 lat (usec): min=1147, max=1767, avg=1495.25, stdev=65.64 00:18:10.187 clat percentiles (usec): 00:18:10.187 | 1.00th=[ 1287], 5.00th=[ 1352], 10.00th=[ 1385], 20.00th=[ 1418], 00:18:10.187 | 30.00th=[ 1450], 40.00th=[ 1450], 50.00th=[ 1467], 60.00th=[ 1483], 00:18:10.187 | 70.00th=[ 1500], 80.00th=[ 1516], 90.00th=[ 1549], 95.00th=[ 1565], 00:18:10.187 | 99.00th=[ 1614], 99.50th=[ 1631], 99.90th=[ 1713], 99.95th=[ 1745], 00:18:10.187 | 99.99th=[ 1745] 00:18:10.187 bw ( KiB/s): min= 2640, max= 2688, per=32.36%, avg=2662.40, stdev=20.71, samples=5 00:18:10.187 iops : min= 660, max= 672, avg=665.60, stdev= 5.18, samples=5 00:18:10.187 lat (msec) : 2=99.94% 00:18:10.187 cpu : usr=0.98%, sys=2.96%, ctx=1707, majf=0, minf=2 00:18:10.187 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:10.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:10.187 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:10.187 issued rwts: total=1706,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:10.187 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:10.187 00:18:10.187 Run status group 0 (all jobs): 00:18:10.187 READ: bw=8225KiB/s (8423kB/s), 119KiB/s-3553KiB/s (121kB/s-3638kB/s), io=24.7MiB (25.9MB), run=2565-3070msec 00:18:10.187 00:18:10.187 Disk stats (read/write): 00:18:10.187 nvme0n1: ios=1762/0, merge=0/0, ticks=2528/0, in_queue=2528, util=93.06% 00:18:10.187 nvme0n2: ios=2475/0, merge=0/0, ticks=3489/0, in_queue=3489, util=97.89% 00:18:10.187 nvme0n3: ios=78/0, merge=0/0, ticks=2581/0, in_queue=2581, util=96.03% 00:18:10.187 nvme0n4: ios=1596/0, merge=0/0, ticks=3036/0, in_queue=3036, util=99.63% 00:18:10.448 20:35:28 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:10.448 20:35:28 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:18:10.709 20:35:28 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:10.709 20:35:28 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:18:10.709 20:35:28 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:10.709 20:35:28 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:18:10.970 20:35:29 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:10.970 20:35:29 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:18:10.970 20:35:29 -- target/fio.sh@69 -- # fio_status=0 00:18:10.970 20:35:29 -- target/fio.sh@70 -- # wait 4052959 00:18:10.970 20:35:29 -- target/fio.sh@70 -- # fio_status=4 00:18:10.970 20:35:29 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:18:11.230 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:18:11.230 20:35:29 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:18:11.230 20:35:29 -- common/autotest_common.sh@1198 -- # local i=0 00:18:11.230 20:35:29 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:18:11.230 20:35:29 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:11.230 20:35:29 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:18:11.230 20:35:29 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:11.230 20:35:29 -- common/autotest_common.sh@1210 -- # return 0 00:18:11.230 20:35:29 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:18:11.230 20:35:29 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:18:11.230 nvmf hotplug test: fio failed as expected 00:18:11.230 20:35:29 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:11.491 20:35:29 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:18:11.491 20:35:29 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:18:11.491 20:35:29 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:18:11.491 20:35:29 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:18:11.491 20:35:29 -- target/fio.sh@91 -- # nvmftestfini 00:18:11.491 20:35:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:11.491 20:35:29 -- nvmf/common.sh@116 -- # sync 00:18:11.491 20:35:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:11.491 20:35:29 -- nvmf/common.sh@119 -- # set +e 00:18:11.491 20:35:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:11.491 20:35:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:11.491 rmmod nvme_tcp 00:18:11.491 rmmod nvme_fabrics 00:18:11.491 rmmod nvme_keyring 00:18:11.491 20:35:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:11.491 20:35:29 -- nvmf/common.sh@123 -- # set -e 00:18:11.491 20:35:29 -- nvmf/common.sh@124 -- # return 0 00:18:11.491 20:35:29 -- nvmf/common.sh@477 -- # '[' -n 4049401 ']' 00:18:11.491 20:35:29 -- nvmf/common.sh@478 -- # killprocess 4049401 00:18:11.491 20:35:29 -- common/autotest_common.sh@926 -- # '[' -z 4049401 ']' 00:18:11.491 20:35:29 -- common/autotest_common.sh@930 -- # kill -0 4049401 00:18:11.491 20:35:29 -- common/autotest_common.sh@931 -- # uname 00:18:11.491 20:35:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:11.491 20:35:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4049401 00:18:11.491 20:35:29 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:18:11.491 20:35:29 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:18:11.491 20:35:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4049401' 00:18:11.491 killing process with pid 4049401 00:18:11.491 20:35:29 -- common/autotest_common.sh@945 -- # kill 4049401 00:18:11.491 20:35:29 -- common/autotest_common.sh@950 -- # wait 4049401 00:18:11.753 20:35:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:11.753 20:35:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:11.753 20:35:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:11.753 20:35:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:11.753 20:35:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:11.753 20:35:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:11.753 20:35:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:11.753 20:35:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:13.668 20:35:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:13.668 00:18:13.668 real 0m27.937s 00:18:13.668 user 2m37.975s 00:18:13.668 sys 0m8.562s 00:18:13.668 20:35:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:13.668 20:35:31 -- common/autotest_common.sh@10 -- # set +x 00:18:13.668 ************************************ 00:18:13.668 END TEST nvmf_fio_target 00:18:13.668 ************************************ 00:18:13.668 20:35:31 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:18:13.668 20:35:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:13.668 20:35:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:13.668 20:35:31 -- common/autotest_common.sh@10 -- # set +x 00:18:13.668 ************************************ 00:18:13.668 START TEST nvmf_bdevio 00:18:13.668 ************************************ 00:18:13.668 20:35:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:18:13.929 * Looking for test storage... 00:18:13.929 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:13.929 20:35:32 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:13.929 20:35:32 -- nvmf/common.sh@7 -- # uname -s 00:18:13.929 20:35:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:13.929 20:35:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:13.929 20:35:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:13.929 20:35:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:13.929 20:35:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:13.929 20:35:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:13.929 20:35:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:13.929 20:35:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:13.929 20:35:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:13.929 20:35:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:13.929 20:35:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:18:13.929 20:35:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:18:13.929 20:35:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:13.929 20:35:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:13.929 20:35:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:13.929 20:35:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:13.929 20:35:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:13.929 20:35:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:13.929 20:35:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:13.929 20:35:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.929 20:35:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.929 20:35:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.929 20:35:32 -- paths/export.sh@5 -- # export PATH 00:18:13.929 20:35:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.929 20:35:32 -- nvmf/common.sh@46 -- # : 0 00:18:13.929 20:35:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:13.929 20:35:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:13.929 20:35:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:13.929 20:35:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:13.929 20:35:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:13.929 20:35:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:13.929 20:35:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:13.929 20:35:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:13.929 20:35:32 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:13.929 20:35:32 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:13.929 20:35:32 -- target/bdevio.sh@14 -- # nvmftestinit 00:18:13.929 20:35:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:13.929 20:35:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:13.929 20:35:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:13.929 20:35:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:13.929 20:35:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:13.929 20:35:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:13.929 20:35:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:13.929 20:35:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:13.929 20:35:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:13.929 20:35:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:13.929 20:35:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:13.929 20:35:32 -- common/autotest_common.sh@10 -- # set +x 00:18:20.518 20:35:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:20.518 20:35:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:20.518 20:35:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:20.518 20:35:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:20.518 20:35:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:20.518 20:35:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:20.518 20:35:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:20.518 20:35:38 -- nvmf/common.sh@294 -- # net_devs=() 00:18:20.518 20:35:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:20.518 20:35:38 -- nvmf/common.sh@295 -- # e810=() 00:18:20.518 20:35:38 -- nvmf/common.sh@295 -- # local -ga e810 00:18:20.518 20:35:38 -- nvmf/common.sh@296 -- # x722=() 00:18:20.518 20:35:38 -- nvmf/common.sh@296 -- # local -ga x722 00:18:20.518 20:35:38 -- nvmf/common.sh@297 -- # mlx=() 00:18:20.518 20:35:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:20.518 20:35:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:20.518 20:35:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:20.518 20:35:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:20.518 20:35:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:20.518 20:35:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:20.518 20:35:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:20.518 20:35:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:20.518 20:35:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:20.518 20:35:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:20.518 20:35:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:20.518 20:35:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:20.518 20:35:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:20.518 20:35:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:20.518 20:35:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:20.518 20:35:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:20.518 20:35:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:18:20.518 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:18:20.518 20:35:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:20.518 20:35:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:18:20.518 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:18:20.518 20:35:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:20.518 20:35:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:20.518 20:35:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:20.518 20:35:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:20.518 20:35:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:20.518 20:35:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:18:20.518 Found net devices under 0000:4b:00.0: cvl_0_0 00:18:20.518 20:35:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:20.518 20:35:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:20.518 20:35:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:20.518 20:35:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:20.518 20:35:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:20.518 20:35:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:18:20.518 Found net devices under 0000:4b:00.1: cvl_0_1 00:18:20.518 20:35:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:20.518 20:35:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:20.518 20:35:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:20.518 20:35:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:20.518 20:35:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:20.518 20:35:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:20.518 20:35:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:20.518 20:35:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:20.518 20:35:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:20.518 20:35:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:20.518 20:35:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:20.518 20:35:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:20.518 20:35:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:20.518 20:35:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:20.518 20:35:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:20.518 20:35:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:20.518 20:35:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:20.518 20:35:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:20.518 20:35:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:20.519 20:35:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:20.519 20:35:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:20.519 20:35:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:20.519 20:35:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:20.519 20:35:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:20.519 20:35:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:20.519 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:20.519 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.508 ms 00:18:20.519 00:18:20.519 --- 10.0.0.2 ping statistics --- 00:18:20.519 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:20.519 rtt min/avg/max/mdev = 0.508/0.508/0.508/0.000 ms 00:18:20.519 20:35:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:20.519 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:20.519 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.391 ms 00:18:20.519 00:18:20.519 --- 10.0.0.1 ping statistics --- 00:18:20.519 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:20.519 rtt min/avg/max/mdev = 0.391/0.391/0.391/0.000 ms 00:18:20.519 20:35:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:20.519 20:35:38 -- nvmf/common.sh@410 -- # return 0 00:18:20.519 20:35:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:20.519 20:35:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:20.519 20:35:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:20.519 20:35:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:20.519 20:35:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:20.519 20:35:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:20.519 20:35:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:20.780 20:35:38 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:18:20.780 20:35:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:20.780 20:35:38 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:20.780 20:35:38 -- common/autotest_common.sh@10 -- # set +x 00:18:20.780 20:35:38 -- nvmf/common.sh@469 -- # nvmfpid=4058236 00:18:20.780 20:35:38 -- nvmf/common.sh@470 -- # waitforlisten 4058236 00:18:20.780 20:35:38 -- common/autotest_common.sh@819 -- # '[' -z 4058236 ']' 00:18:20.780 20:35:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:18:20.780 20:35:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:20.780 20:35:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:20.780 20:35:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:20.780 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:20.780 20:35:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:20.780 20:35:38 -- common/autotest_common.sh@10 -- # set +x 00:18:20.780 [2024-04-26 20:35:38.927017] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:18:20.780 [2024-04-26 20:35:38.927073] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:20.780 EAL: No free 2048 kB hugepages reported on node 1 00:18:20.780 [2024-04-26 20:35:38.994820] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:20.780 [2024-04-26 20:35:39.063782] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:20.780 [2024-04-26 20:35:39.063918] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:20.780 [2024-04-26 20:35:39.063928] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:20.780 [2024-04-26 20:35:39.063937] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:20.780 [2024-04-26 20:35:39.064110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:20.780 [2024-04-26 20:35:39.064260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:20.780 [2024-04-26 20:35:39.064413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:20.780 [2024-04-26 20:35:39.064413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:21.351 20:35:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:21.351 20:35:39 -- common/autotest_common.sh@852 -- # return 0 00:18:21.351 20:35:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:21.351 20:35:39 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:21.612 20:35:39 -- common/autotest_common.sh@10 -- # set +x 00:18:21.612 20:35:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:21.612 20:35:39 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:21.612 20:35:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:21.612 20:35:39 -- common/autotest_common.sh@10 -- # set +x 00:18:21.612 [2024-04-26 20:35:39.739511] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:21.612 20:35:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:21.612 20:35:39 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:21.612 20:35:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:21.612 20:35:39 -- common/autotest_common.sh@10 -- # set +x 00:18:21.612 Malloc0 00:18:21.612 20:35:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:21.612 20:35:39 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:21.612 20:35:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:21.612 20:35:39 -- common/autotest_common.sh@10 -- # set +x 00:18:21.612 20:35:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:21.612 20:35:39 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:21.612 20:35:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:21.612 20:35:39 -- common/autotest_common.sh@10 -- # set +x 00:18:21.612 20:35:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:21.612 20:35:39 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:21.612 20:35:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:21.612 20:35:39 -- common/autotest_common.sh@10 -- # set +x 00:18:21.612 [2024-04-26 20:35:39.798876] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:21.612 20:35:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:21.612 20:35:39 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:18:21.612 20:35:39 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:18:21.612 20:35:39 -- nvmf/common.sh@520 -- # config=() 00:18:21.612 20:35:39 -- nvmf/common.sh@520 -- # local subsystem config 00:18:21.612 20:35:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:21.612 20:35:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:21.612 { 00:18:21.612 "params": { 00:18:21.612 "name": "Nvme$subsystem", 00:18:21.612 "trtype": "$TEST_TRANSPORT", 00:18:21.612 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:21.612 "adrfam": "ipv4", 00:18:21.612 "trsvcid": "$NVMF_PORT", 00:18:21.612 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:21.612 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:21.612 "hdgst": ${hdgst:-false}, 00:18:21.612 "ddgst": ${ddgst:-false} 00:18:21.612 }, 00:18:21.612 "method": "bdev_nvme_attach_controller" 00:18:21.612 } 00:18:21.612 EOF 00:18:21.612 )") 00:18:21.612 20:35:39 -- nvmf/common.sh@542 -- # cat 00:18:21.612 20:35:39 -- nvmf/common.sh@544 -- # jq . 00:18:21.612 20:35:39 -- nvmf/common.sh@545 -- # IFS=, 00:18:21.612 20:35:39 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:21.612 "params": { 00:18:21.612 "name": "Nvme1", 00:18:21.612 "trtype": "tcp", 00:18:21.612 "traddr": "10.0.0.2", 00:18:21.612 "adrfam": "ipv4", 00:18:21.612 "trsvcid": "4420", 00:18:21.612 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.612 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:21.612 "hdgst": false, 00:18:21.612 "ddgst": false 00:18:21.612 }, 00:18:21.612 "method": "bdev_nvme_attach_controller" 00:18:21.612 }' 00:18:21.612 [2024-04-26 20:35:39.846681] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:18:21.612 [2024-04-26 20:35:39.846732] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4058349 ] 00:18:21.612 EAL: No free 2048 kB hugepages reported on node 1 00:18:21.612 [2024-04-26 20:35:39.905535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:18:21.873 [2024-04-26 20:35:39.969272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:21.873 [2024-04-26 20:35:39.969389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:21.873 [2024-04-26 20:35:39.969392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:22.134 [2024-04-26 20:35:40.268993] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:18:22.134 [2024-04-26 20:35:40.269027] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:18:22.134 I/O targets: 00:18:22.134 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:18:22.134 00:18:22.134 00:18:22.134 CUnit - A unit testing framework for C - Version 2.1-3 00:18:22.134 http://cunit.sourceforge.net/ 00:18:22.134 00:18:22.134 00:18:22.134 Suite: bdevio tests on: Nvme1n1 00:18:22.134 Test: blockdev write read block ...passed 00:18:22.134 Test: blockdev write zeroes read block ...passed 00:18:22.134 Test: blockdev write zeroes read no split ...passed 00:18:22.134 Test: blockdev write zeroes read split ...passed 00:18:22.134 Test: blockdev write zeroes read split partial ...passed 00:18:22.134 Test: blockdev reset ...[2024-04-26 20:35:40.457270] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:22.134 [2024-04-26 20:35:40.457326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x201e4e0 (9): Bad file descriptor 00:18:22.396 [2024-04-26 20:35:40.479485] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:22.396 passed 00:18:22.396 Test: blockdev write read 8 blocks ...passed 00:18:22.396 Test: blockdev write read size > 128k ...passed 00:18:22.396 Test: blockdev write read invalid size ...passed 00:18:22.396 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:18:22.396 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:18:22.396 Test: blockdev write read max offset ...passed 00:18:22.396 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:18:22.396 Test: blockdev writev readv 8 blocks ...passed 00:18:22.396 Test: blockdev writev readv 30 x 1block ...passed 00:18:22.657 Test: blockdev writev readv block ...passed 00:18:22.657 Test: blockdev writev readv size > 128k ...passed 00:18:22.657 Test: blockdev writev readv size > 128k in two iovs ...passed 00:18:22.657 Test: blockdev comparev and writev ...[2024-04-26 20:35:40.794970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:22.657 [2024-04-26 20:35:40.794997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:18:22.657 [2024-04-26 20:35:40.795007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:22.657 [2024-04-26 20:35:40.795013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:18:22.657 [2024-04-26 20:35:40.795672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:22.657 [2024-04-26 20:35:40.795681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:18:22.657 [2024-04-26 20:35:40.795690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:22.657 [2024-04-26 20:35:40.795695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:18:22.657 [2024-04-26 20:35:40.796359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:22.657 [2024-04-26 20:35:40.796367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:18:22.657 [2024-04-26 20:35:40.796376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:22.657 [2024-04-26 20:35:40.796381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:18:22.657 [2024-04-26 20:35:40.797063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:22.657 [2024-04-26 20:35:40.797071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:18:22.657 [2024-04-26 20:35:40.797080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:22.657 [2024-04-26 20:35:40.797085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:18:22.657 passed 00:18:22.657 Test: blockdev nvme passthru rw ...passed 00:18:22.657 Test: blockdev nvme passthru vendor specific ...[2024-04-26 20:35:40.882303] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:22.657 [2024-04-26 20:35:40.882314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:18:22.657 [2024-04-26 20:35:40.882902] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:22.657 [2024-04-26 20:35:40.882911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:18:22.657 [2024-04-26 20:35:40.883495] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:22.657 [2024-04-26 20:35:40.883506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:18:22.657 [2024-04-26 20:35:40.884039] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:22.658 [2024-04-26 20:35:40.884048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:18:22.658 passed 00:18:22.658 Test: blockdev nvme admin passthru ...passed 00:18:22.658 Test: blockdev copy ...passed 00:18:22.658 00:18:22.658 Run Summary: Type Total Ran Passed Failed Inactive 00:18:22.658 suites 1 1 n/a 0 0 00:18:22.658 tests 23 23 23 0 0 00:18:22.658 asserts 152 152 152 0 n/a 00:18:22.658 00:18:22.658 Elapsed time = 1.343 seconds 00:18:22.919 20:35:41 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:22.919 20:35:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:22.919 20:35:41 -- common/autotest_common.sh@10 -- # set +x 00:18:22.919 20:35:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:22.919 20:35:41 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:18:22.919 20:35:41 -- target/bdevio.sh@30 -- # nvmftestfini 00:18:22.919 20:35:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:22.919 20:35:41 -- nvmf/common.sh@116 -- # sync 00:18:22.919 20:35:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:22.919 20:35:41 -- nvmf/common.sh@119 -- # set +e 00:18:22.919 20:35:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:22.919 20:35:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:22.919 rmmod nvme_tcp 00:18:22.919 rmmod nvme_fabrics 00:18:22.919 rmmod nvme_keyring 00:18:22.919 20:35:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:22.919 20:35:41 -- nvmf/common.sh@123 -- # set -e 00:18:22.919 20:35:41 -- nvmf/common.sh@124 -- # return 0 00:18:22.919 20:35:41 -- nvmf/common.sh@477 -- # '[' -n 4058236 ']' 00:18:22.919 20:35:41 -- nvmf/common.sh@478 -- # killprocess 4058236 00:18:22.919 20:35:41 -- common/autotest_common.sh@926 -- # '[' -z 4058236 ']' 00:18:22.919 20:35:41 -- common/autotest_common.sh@930 -- # kill -0 4058236 00:18:22.919 20:35:41 -- common/autotest_common.sh@931 -- # uname 00:18:22.919 20:35:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:22.919 20:35:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4058236 00:18:22.919 20:35:41 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:18:22.919 20:35:41 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:18:22.919 20:35:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4058236' 00:18:22.919 killing process with pid 4058236 00:18:22.919 20:35:41 -- common/autotest_common.sh@945 -- # kill 4058236 00:18:22.919 20:35:41 -- common/autotest_common.sh@950 -- # wait 4058236 00:18:23.181 20:35:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:23.181 20:35:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:23.181 20:35:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:23.181 20:35:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:23.181 20:35:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:23.181 20:35:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:23.181 20:35:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:23.181 20:35:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:25.098 20:35:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:25.098 00:18:25.098 real 0m11.430s 00:18:25.098 user 0m13.562s 00:18:25.098 sys 0m5.453s 00:18:25.098 20:35:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:25.098 20:35:43 -- common/autotest_common.sh@10 -- # set +x 00:18:25.098 ************************************ 00:18:25.098 END TEST nvmf_bdevio 00:18:25.098 ************************************ 00:18:25.098 20:35:43 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:18:25.098 20:35:43 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:18:25.098 20:35:43 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:18:25.098 20:35:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:25.098 20:35:43 -- common/autotest_common.sh@10 -- # set +x 00:18:25.359 ************************************ 00:18:25.359 START TEST nvmf_bdevio_no_huge 00:18:25.359 ************************************ 00:18:25.359 20:35:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:18:25.359 * Looking for test storage... 00:18:25.359 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:25.360 20:35:43 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:25.360 20:35:43 -- nvmf/common.sh@7 -- # uname -s 00:18:25.360 20:35:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:25.360 20:35:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:25.360 20:35:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:25.360 20:35:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:25.360 20:35:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:25.360 20:35:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:25.360 20:35:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:25.360 20:35:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:25.360 20:35:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:25.360 20:35:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:25.360 20:35:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:18:25.360 20:35:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:18:25.360 20:35:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:25.360 20:35:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:25.360 20:35:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:25.360 20:35:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:25.360 20:35:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:25.360 20:35:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:25.360 20:35:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:25.360 20:35:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:25.360 20:35:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:25.360 20:35:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:25.360 20:35:43 -- paths/export.sh@5 -- # export PATH 00:18:25.360 20:35:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:25.360 20:35:43 -- nvmf/common.sh@46 -- # : 0 00:18:25.360 20:35:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:25.360 20:35:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:25.360 20:35:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:25.360 20:35:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:25.360 20:35:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:25.360 20:35:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:25.360 20:35:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:25.360 20:35:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:25.360 20:35:43 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:25.360 20:35:43 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:25.360 20:35:43 -- target/bdevio.sh@14 -- # nvmftestinit 00:18:25.360 20:35:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:25.360 20:35:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:25.360 20:35:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:25.360 20:35:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:25.360 20:35:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:25.360 20:35:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:25.360 20:35:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:25.360 20:35:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:25.360 20:35:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:25.360 20:35:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:25.360 20:35:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:25.360 20:35:43 -- common/autotest_common.sh@10 -- # set +x 00:18:31.974 20:35:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:31.974 20:35:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:31.974 20:35:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:31.974 20:35:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:31.974 20:35:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:31.974 20:35:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:31.974 20:35:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:31.974 20:35:50 -- nvmf/common.sh@294 -- # net_devs=() 00:18:31.974 20:35:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:31.974 20:35:50 -- nvmf/common.sh@295 -- # e810=() 00:18:31.974 20:35:50 -- nvmf/common.sh@295 -- # local -ga e810 00:18:31.974 20:35:50 -- nvmf/common.sh@296 -- # x722=() 00:18:31.974 20:35:50 -- nvmf/common.sh@296 -- # local -ga x722 00:18:31.974 20:35:50 -- nvmf/common.sh@297 -- # mlx=() 00:18:31.974 20:35:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:31.974 20:35:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:31.974 20:35:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:31.974 20:35:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:31.974 20:35:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:31.974 20:35:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:31.974 20:35:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:31.974 20:35:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:31.974 20:35:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:31.974 20:35:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:31.974 20:35:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:31.974 20:35:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:31.974 20:35:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:31.974 20:35:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:31.974 20:35:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:31.974 20:35:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:31.974 20:35:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:18:31.974 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:18:31.974 20:35:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:31.974 20:35:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:18:31.974 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:18:31.974 20:35:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:31.974 20:35:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:31.974 20:35:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:31.974 20:35:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:31.974 20:35:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:31.974 20:35:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:18:31.974 Found net devices under 0000:4b:00.0: cvl_0_0 00:18:31.974 20:35:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:31.974 20:35:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:31.974 20:35:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:31.974 20:35:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:31.974 20:35:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:31.974 20:35:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:18:31.974 Found net devices under 0000:4b:00.1: cvl_0_1 00:18:31.974 20:35:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:31.974 20:35:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:31.974 20:35:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:31.974 20:35:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:31.974 20:35:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:31.974 20:35:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:31.974 20:35:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:31.974 20:35:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:31.974 20:35:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:31.974 20:35:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:31.974 20:35:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:31.974 20:35:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:31.974 20:35:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:31.974 20:35:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:31.974 20:35:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:31.974 20:35:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:31.975 20:35:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:31.975 20:35:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:31.975 20:35:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:31.975 20:35:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:31.975 20:35:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:31.975 20:35:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:32.236 20:35:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:32.236 20:35:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:32.236 20:35:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:32.236 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:32.236 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.435 ms 00:18:32.236 00:18:32.236 --- 10.0.0.2 ping statistics --- 00:18:32.236 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:32.236 rtt min/avg/max/mdev = 0.435/0.435/0.435/0.000 ms 00:18:32.236 20:35:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:32.236 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:32.236 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.423 ms 00:18:32.236 00:18:32.236 --- 10.0.0.1 ping statistics --- 00:18:32.236 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:32.236 rtt min/avg/max/mdev = 0.423/0.423/0.423/0.000 ms 00:18:32.236 20:35:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:32.236 20:35:50 -- nvmf/common.sh@410 -- # return 0 00:18:32.236 20:35:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:32.236 20:35:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:32.236 20:35:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:32.236 20:35:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:32.236 20:35:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:32.236 20:35:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:32.236 20:35:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:32.236 20:35:50 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:18:32.236 20:35:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:32.236 20:35:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:32.236 20:35:50 -- common/autotest_common.sh@10 -- # set +x 00:18:32.237 20:35:50 -- nvmf/common.sh@469 -- # nvmfpid=4062694 00:18:32.237 20:35:50 -- nvmf/common.sh@470 -- # waitforlisten 4062694 00:18:32.237 20:35:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:18:32.237 20:35:50 -- common/autotest_common.sh@819 -- # '[' -z 4062694 ']' 00:18:32.237 20:35:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:32.237 20:35:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:32.237 20:35:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:32.237 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:32.237 20:35:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:32.237 20:35:50 -- common/autotest_common.sh@10 -- # set +x 00:18:32.237 [2024-04-26 20:35:50.482501] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:18:32.237 [2024-04-26 20:35:50.482561] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:18:32.237 [2024-04-26 20:35:50.564304] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:32.499 [2024-04-26 20:35:50.662559] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:32.499 [2024-04-26 20:35:50.662712] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:32.499 [2024-04-26 20:35:50.662724] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:32.499 [2024-04-26 20:35:50.662733] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:32.499 [2024-04-26 20:35:50.662928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:32.499 [2024-04-26 20:35:50.662945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:32.499 [2024-04-26 20:35:50.663082] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:32.499 [2024-04-26 20:35:50.663084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:33.071 20:35:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:33.071 20:35:51 -- common/autotest_common.sh@852 -- # return 0 00:18:33.071 20:35:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:33.071 20:35:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:33.071 20:35:51 -- common/autotest_common.sh@10 -- # set +x 00:18:33.071 20:35:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:33.071 20:35:51 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:33.071 20:35:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:33.071 20:35:51 -- common/autotest_common.sh@10 -- # set +x 00:18:33.071 [2024-04-26 20:35:51.309999] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:33.071 20:35:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:33.071 20:35:51 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:33.071 20:35:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:33.071 20:35:51 -- common/autotest_common.sh@10 -- # set +x 00:18:33.071 Malloc0 00:18:33.071 20:35:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:33.072 20:35:51 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:33.072 20:35:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:33.072 20:35:51 -- common/autotest_common.sh@10 -- # set +x 00:18:33.072 20:35:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:33.072 20:35:51 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:33.072 20:35:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:33.072 20:35:51 -- common/autotest_common.sh@10 -- # set +x 00:18:33.072 20:35:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:33.072 20:35:51 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:33.072 20:35:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:33.072 20:35:51 -- common/autotest_common.sh@10 -- # set +x 00:18:33.072 [2024-04-26 20:35:51.362376] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:33.072 20:35:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:33.072 20:35:51 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:18:33.072 20:35:51 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:18:33.072 20:35:51 -- nvmf/common.sh@520 -- # config=() 00:18:33.072 20:35:51 -- nvmf/common.sh@520 -- # local subsystem config 00:18:33.072 20:35:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:33.072 20:35:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:33.072 { 00:18:33.072 "params": { 00:18:33.072 "name": "Nvme$subsystem", 00:18:33.072 "trtype": "$TEST_TRANSPORT", 00:18:33.072 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:33.072 "adrfam": "ipv4", 00:18:33.072 "trsvcid": "$NVMF_PORT", 00:18:33.072 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:33.072 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:33.072 "hdgst": ${hdgst:-false}, 00:18:33.072 "ddgst": ${ddgst:-false} 00:18:33.072 }, 00:18:33.072 "method": "bdev_nvme_attach_controller" 00:18:33.072 } 00:18:33.072 EOF 00:18:33.072 )") 00:18:33.072 20:35:51 -- nvmf/common.sh@542 -- # cat 00:18:33.072 20:35:51 -- nvmf/common.sh@544 -- # jq . 00:18:33.072 20:35:51 -- nvmf/common.sh@545 -- # IFS=, 00:18:33.072 20:35:51 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:33.072 "params": { 00:18:33.072 "name": "Nvme1", 00:18:33.072 "trtype": "tcp", 00:18:33.072 "traddr": "10.0.0.2", 00:18:33.072 "adrfam": "ipv4", 00:18:33.072 "trsvcid": "4420", 00:18:33.072 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:33.072 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:33.072 "hdgst": false, 00:18:33.072 "ddgst": false 00:18:33.072 }, 00:18:33.072 "method": "bdev_nvme_attach_controller" 00:18:33.072 }' 00:18:33.072 [2024-04-26 20:35:51.412713] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:18:33.072 [2024-04-26 20:35:51.412769] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid4063045 ] 00:18:33.346 [2024-04-26 20:35:51.473375] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:18:33.346 [2024-04-26 20:35:51.565033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:33.346 [2024-04-26 20:35:51.565189] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:33.346 [2024-04-26 20:35:51.565192] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:33.645 [2024-04-26 20:35:51.862541] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:18:33.645 [2024-04-26 20:35:51.862566] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:18:33.645 I/O targets: 00:18:33.645 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:18:33.645 00:18:33.645 00:18:33.645 CUnit - A unit testing framework for C - Version 2.1-3 00:18:33.645 http://cunit.sourceforge.net/ 00:18:33.645 00:18:33.645 00:18:33.645 Suite: bdevio tests on: Nvme1n1 00:18:33.645 Test: blockdev write read block ...passed 00:18:33.645 Test: blockdev write zeroes read block ...passed 00:18:33.645 Test: blockdev write zeroes read no split ...passed 00:18:33.930 Test: blockdev write zeroes read split ...passed 00:18:33.930 Test: blockdev write zeroes read split partial ...passed 00:18:33.930 Test: blockdev reset ...[2024-04-26 20:35:52.100724] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.930 [2024-04-26 20:35:52.100784] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xff5b60 (9): Bad file descriptor 00:18:33.930 [2024-04-26 20:35:52.153459] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:33.930 passed 00:18:33.930 Test: blockdev write read 8 blocks ...passed 00:18:33.930 Test: blockdev write read size > 128k ...passed 00:18:33.930 Test: blockdev write read invalid size ...passed 00:18:33.930 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:18:33.930 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:18:33.930 Test: blockdev write read max offset ...passed 00:18:34.213 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:18:34.213 Test: blockdev writev readv 8 blocks ...passed 00:18:34.213 Test: blockdev writev readv 30 x 1block ...passed 00:18:34.213 Test: blockdev writev readv block ...passed 00:18:34.213 Test: blockdev writev readv size > 128k ...passed 00:18:34.213 Test: blockdev writev readv size > 128k in two iovs ...passed 00:18:34.213 Test: blockdev comparev and writev ...[2024-04-26 20:35:52.386406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:34.213 [2024-04-26 20:35:52.386430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:18:34.213 [2024-04-26 20:35:52.386440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:34.213 [2024-04-26 20:35:52.386446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:18:34.213 [2024-04-26 20:35:52.387044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:34.213 [2024-04-26 20:35:52.387053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:18:34.213 [2024-04-26 20:35:52.387062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:34.213 [2024-04-26 20:35:52.387067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:18:34.213 [2024-04-26 20:35:52.387652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:34.213 [2024-04-26 20:35:52.387661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:18:34.213 [2024-04-26 20:35:52.387670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:34.213 [2024-04-26 20:35:52.387675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:18:34.213 [2024-04-26 20:35:52.388285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:34.213 [2024-04-26 20:35:52.388295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:18:34.213 [2024-04-26 20:35:52.388304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:34.213 [2024-04-26 20:35:52.388309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:18:34.213 passed 00:18:34.213 Test: blockdev nvme passthru rw ...passed 00:18:34.213 Test: blockdev nvme passthru vendor specific ...[2024-04-26 20:35:52.474269] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:34.213 [2024-04-26 20:35:52.474284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:18:34.213 [2024-04-26 20:35:52.474760] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:34.213 [2024-04-26 20:35:52.474768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:18:34.213 [2024-04-26 20:35:52.475269] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:34.213 [2024-04-26 20:35:52.475282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:18:34.213 [2024-04-26 20:35:52.475797] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:34.213 [2024-04-26 20:35:52.475805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:18:34.213 passed 00:18:34.213 Test: blockdev nvme admin passthru ...passed 00:18:34.213 Test: blockdev copy ...passed 00:18:34.213 00:18:34.213 Run Summary: Type Total Ran Passed Failed Inactive 00:18:34.213 suites 1 1 n/a 0 0 00:18:34.213 tests 23 23 23 0 0 00:18:34.213 asserts 152 152 152 0 n/a 00:18:34.213 00:18:34.213 Elapsed time = 1.342 seconds 00:18:34.473 20:35:52 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:34.473 20:35:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:34.473 20:35:52 -- common/autotest_common.sh@10 -- # set +x 00:18:34.473 20:35:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:34.473 20:35:52 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:18:34.473 20:35:52 -- target/bdevio.sh@30 -- # nvmftestfini 00:18:34.473 20:35:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:34.734 20:35:52 -- nvmf/common.sh@116 -- # sync 00:18:34.734 20:35:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:34.734 20:35:52 -- nvmf/common.sh@119 -- # set +e 00:18:34.734 20:35:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:34.734 20:35:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:34.734 rmmod nvme_tcp 00:18:34.734 rmmod nvme_fabrics 00:18:34.734 rmmod nvme_keyring 00:18:34.734 20:35:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:34.734 20:35:52 -- nvmf/common.sh@123 -- # set -e 00:18:34.734 20:35:52 -- nvmf/common.sh@124 -- # return 0 00:18:34.734 20:35:52 -- nvmf/common.sh@477 -- # '[' -n 4062694 ']' 00:18:34.734 20:35:52 -- nvmf/common.sh@478 -- # killprocess 4062694 00:18:34.734 20:35:52 -- common/autotest_common.sh@926 -- # '[' -z 4062694 ']' 00:18:34.734 20:35:52 -- common/autotest_common.sh@930 -- # kill -0 4062694 00:18:34.734 20:35:52 -- common/autotest_common.sh@931 -- # uname 00:18:34.734 20:35:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:34.734 20:35:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4062694 00:18:34.734 20:35:52 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:18:34.734 20:35:52 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:18:34.734 20:35:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4062694' 00:18:34.734 killing process with pid 4062694 00:18:34.734 20:35:52 -- common/autotest_common.sh@945 -- # kill 4062694 00:18:34.734 20:35:52 -- common/autotest_common.sh@950 -- # wait 4062694 00:18:34.995 20:35:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:34.995 20:35:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:34.995 20:35:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:34.995 20:35:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:34.995 20:35:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:34.995 20:35:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:34.995 20:35:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:34.995 20:35:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:36.968 20:35:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:36.968 00:18:36.968 real 0m11.865s 00:18:36.968 user 0m14.494s 00:18:36.968 sys 0m6.082s 00:18:36.968 20:35:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:36.968 20:35:55 -- common/autotest_common.sh@10 -- # set +x 00:18:36.968 ************************************ 00:18:36.968 END TEST nvmf_bdevio_no_huge 00:18:36.968 ************************************ 00:18:37.228 20:35:55 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:18:37.228 20:35:55 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:37.228 20:35:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:37.228 20:35:55 -- common/autotest_common.sh@10 -- # set +x 00:18:37.228 ************************************ 00:18:37.228 START TEST nvmf_tls 00:18:37.228 ************************************ 00:18:37.228 20:35:55 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:18:37.228 * Looking for test storage... 00:18:37.228 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:37.228 20:35:55 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:37.228 20:35:55 -- nvmf/common.sh@7 -- # uname -s 00:18:37.228 20:35:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:37.228 20:35:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:37.228 20:35:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:37.228 20:35:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:37.228 20:35:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:37.228 20:35:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:37.228 20:35:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:37.228 20:35:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:37.228 20:35:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:37.228 20:35:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:37.228 20:35:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:18:37.228 20:35:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:18:37.228 20:35:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:37.228 20:35:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:37.228 20:35:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:37.228 20:35:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:37.228 20:35:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:37.228 20:35:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:37.228 20:35:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:37.228 20:35:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.228 20:35:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.228 20:35:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.228 20:35:55 -- paths/export.sh@5 -- # export PATH 00:18:37.228 20:35:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.228 20:35:55 -- nvmf/common.sh@46 -- # : 0 00:18:37.228 20:35:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:37.228 20:35:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:37.228 20:35:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:37.228 20:35:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:37.228 20:35:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:37.228 20:35:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:37.228 20:35:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:37.228 20:35:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:37.228 20:35:55 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:37.228 20:35:55 -- target/tls.sh@71 -- # nvmftestinit 00:18:37.228 20:35:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:37.228 20:35:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:37.229 20:35:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:37.229 20:35:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:37.229 20:35:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:37.229 20:35:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:37.229 20:35:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:37.229 20:35:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:37.229 20:35:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:37.229 20:35:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:37.229 20:35:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:37.229 20:35:55 -- common/autotest_common.sh@10 -- # set +x 00:18:43.828 20:36:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:43.828 20:36:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:43.828 20:36:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:43.828 20:36:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:43.828 20:36:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:43.828 20:36:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:43.828 20:36:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:43.828 20:36:01 -- nvmf/common.sh@294 -- # net_devs=() 00:18:43.828 20:36:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:43.828 20:36:01 -- nvmf/common.sh@295 -- # e810=() 00:18:43.828 20:36:01 -- nvmf/common.sh@295 -- # local -ga e810 00:18:43.828 20:36:01 -- nvmf/common.sh@296 -- # x722=() 00:18:43.828 20:36:01 -- nvmf/common.sh@296 -- # local -ga x722 00:18:43.828 20:36:01 -- nvmf/common.sh@297 -- # mlx=() 00:18:43.828 20:36:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:43.828 20:36:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:43.828 20:36:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:43.828 20:36:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:43.828 20:36:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:43.828 20:36:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:43.828 20:36:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:43.828 20:36:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:43.828 20:36:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:43.828 20:36:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:43.828 20:36:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:43.828 20:36:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:43.828 20:36:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:43.828 20:36:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:43.828 20:36:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:43.828 20:36:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.828 20:36:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:18:43.828 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:18:43.828 20:36:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.828 20:36:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:18:43.828 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:18:43.828 20:36:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:43.828 20:36:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.828 20:36:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.828 20:36:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.828 20:36:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.828 20:36:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:18:43.828 Found net devices under 0000:4b:00.0: cvl_0_0 00:18:43.828 20:36:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.828 20:36:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.828 20:36:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.828 20:36:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.828 20:36:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.828 20:36:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:18:43.828 Found net devices under 0000:4b:00.1: cvl_0_1 00:18:43.828 20:36:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.828 20:36:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:43.828 20:36:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:43.828 20:36:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:43.828 20:36:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:43.828 20:36:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:43.828 20:36:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:43.828 20:36:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:43.828 20:36:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:43.828 20:36:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:43.828 20:36:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:43.829 20:36:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:43.829 20:36:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:43.829 20:36:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:43.829 20:36:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:43.829 20:36:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:43.829 20:36:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:43.829 20:36:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:43.829 20:36:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:43.829 20:36:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:43.829 20:36:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:43.829 20:36:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:44.102 20:36:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:44.102 20:36:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:44.102 20:36:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:44.102 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:44.102 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.715 ms 00:18:44.102 00:18:44.102 --- 10.0.0.2 ping statistics --- 00:18:44.102 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:44.102 rtt min/avg/max/mdev = 0.715/0.715/0.715/0.000 ms 00:18:44.102 20:36:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:44.102 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:44.102 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.444 ms 00:18:44.102 00:18:44.102 --- 10.0.0.1 ping statistics --- 00:18:44.102 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:44.102 rtt min/avg/max/mdev = 0.444/0.444/0.444/0.000 ms 00:18:44.102 20:36:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:44.102 20:36:02 -- nvmf/common.sh@410 -- # return 0 00:18:44.102 20:36:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:44.102 20:36:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:44.102 20:36:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:44.102 20:36:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:44.102 20:36:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:44.102 20:36:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:44.102 20:36:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:44.102 20:36:02 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:18:44.102 20:36:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:44.102 20:36:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:44.102 20:36:02 -- common/autotest_common.sh@10 -- # set +x 00:18:44.102 20:36:02 -- nvmf/common.sh@469 -- # nvmfpid=4067507 00:18:44.102 20:36:02 -- nvmf/common.sh@470 -- # waitforlisten 4067507 00:18:44.102 20:36:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:18:44.102 20:36:02 -- common/autotest_common.sh@819 -- # '[' -z 4067507 ']' 00:18:44.102 20:36:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:44.102 20:36:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:44.102 20:36:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:44.102 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:44.102 20:36:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:44.102 20:36:02 -- common/autotest_common.sh@10 -- # set +x 00:18:44.102 [2024-04-26 20:36:02.381859] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:18:44.102 [2024-04-26 20:36:02.381924] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:44.102 EAL: No free 2048 kB hugepages reported on node 1 00:18:44.363 [2024-04-26 20:36:02.453833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:44.363 [2024-04-26 20:36:02.527504] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:44.363 [2024-04-26 20:36:02.527625] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:44.363 [2024-04-26 20:36:02.527635] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:44.363 [2024-04-26 20:36:02.527642] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:44.363 [2024-04-26 20:36:02.527659] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:44.935 20:36:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:44.935 20:36:03 -- common/autotest_common.sh@852 -- # return 0 00:18:44.935 20:36:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:44.935 20:36:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:44.935 20:36:03 -- common/autotest_common.sh@10 -- # set +x 00:18:44.935 20:36:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:44.935 20:36:03 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:18:44.935 20:36:03 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:18:45.268 true 00:18:45.268 20:36:03 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:18:45.268 20:36:03 -- target/tls.sh@82 -- # jq -r .tls_version 00:18:45.268 20:36:03 -- target/tls.sh@82 -- # version=0 00:18:45.268 20:36:03 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:18:45.268 20:36:03 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:18:45.528 20:36:03 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:18:45.528 20:36:03 -- target/tls.sh@90 -- # jq -r .tls_version 00:18:45.528 20:36:03 -- target/tls.sh@90 -- # version=13 00:18:45.528 20:36:03 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:18:45.528 20:36:03 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:18:45.788 20:36:03 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:18:45.788 20:36:03 -- target/tls.sh@98 -- # jq -r .tls_version 00:18:45.788 20:36:04 -- target/tls.sh@98 -- # version=7 00:18:45.788 20:36:04 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:18:45.788 20:36:04 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:18:45.788 20:36:04 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:18:46.048 20:36:04 -- target/tls.sh@105 -- # ktls=false 00:18:46.048 20:36:04 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:18:46.048 20:36:04 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:18:46.048 20:36:04 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:18:46.048 20:36:04 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:18:46.308 20:36:04 -- target/tls.sh@113 -- # ktls=true 00:18:46.308 20:36:04 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:18:46.308 20:36:04 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:18:46.569 20:36:04 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:18:46.569 20:36:04 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:18:46.569 20:36:04 -- target/tls.sh@121 -- # ktls=false 00:18:46.569 20:36:04 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:18:46.569 20:36:04 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:18:46.569 20:36:04 -- target/tls.sh@49 -- # local key hash crc 00:18:46.569 20:36:04 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:18:46.569 20:36:04 -- target/tls.sh@51 -- # hash=01 00:18:46.569 20:36:04 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:18:46.569 20:36:04 -- target/tls.sh@52 -- # gzip -1 -c 00:18:46.569 20:36:04 -- target/tls.sh@52 -- # tail -c8 00:18:46.569 20:36:04 -- target/tls.sh@52 -- # head -c 4 00:18:46.569 20:36:04 -- target/tls.sh@52 -- # crc='p$H�' 00:18:46.569 20:36:04 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:18:46.569 20:36:04 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:18:46.569 20:36:04 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:18:46.569 20:36:04 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:18:46.569 20:36:04 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:18:46.569 20:36:04 -- target/tls.sh@49 -- # local key hash crc 00:18:46.569 20:36:04 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:18:46.569 20:36:04 -- target/tls.sh@51 -- # hash=01 00:18:46.569 20:36:04 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:18:46.569 20:36:04 -- target/tls.sh@52 -- # gzip -1 -c 00:18:46.569 20:36:04 -- target/tls.sh@52 -- # tail -c8 00:18:46.569 20:36:04 -- target/tls.sh@52 -- # head -c 4 00:18:46.569 20:36:04 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:18:46.569 20:36:04 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:18:46.569 20:36:04 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:18:46.569 20:36:04 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:18:46.569 20:36:04 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:18:46.569 20:36:04 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:46.569 20:36:04 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:18:46.569 20:36:04 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:18:46.569 20:36:04 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:18:46.569 20:36:04 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:46.569 20:36:04 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:18:46.569 20:36:04 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:18:46.830 20:36:05 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:18:47.090 20:36:05 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:47.090 20:36:05 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:47.090 20:36:05 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:47.090 [2024-04-26 20:36:05.395437] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:47.090 20:36:05 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:47.350 20:36:05 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:47.610 [2024-04-26 20:36:05.700201] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:47.610 [2024-04-26 20:36:05.700413] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:47.610 20:36:05 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:47.610 malloc0 00:18:47.610 20:36:05 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:47.871 20:36:06 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:47.871 20:36:06 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:47.871 EAL: No free 2048 kB hugepages reported on node 1 00:18:57.895 Initializing NVMe Controllers 00:18:57.895 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:57.895 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:57.895 Initialization complete. Launching workers. 00:18:57.895 ======================================================== 00:18:57.895 Latency(us) 00:18:57.895 Device Information : IOPS MiB/s Average min max 00:18:57.895 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 13948.97 54.49 4588.73 995.09 5241.49 00:18:57.895 ======================================================== 00:18:57.895 Total : 13948.97 54.49 4588.73 995.09 5241.49 00:18:57.895 00:18:57.895 20:36:16 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:57.895 20:36:16 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:57.895 20:36:16 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:57.895 20:36:16 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:57.895 20:36:16 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:18:57.895 20:36:16 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:57.895 20:36:16 -- target/tls.sh@28 -- # bdevperf_pid=4070746 00:18:57.895 20:36:16 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:57.895 20:36:16 -- target/tls.sh@31 -- # waitforlisten 4070746 /var/tmp/bdevperf.sock 00:18:57.895 20:36:16 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:57.895 20:36:16 -- common/autotest_common.sh@819 -- # '[' -z 4070746 ']' 00:18:57.895 20:36:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:57.895 20:36:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:57.895 20:36:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:57.895 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:57.895 20:36:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:57.895 20:36:16 -- common/autotest_common.sh@10 -- # set +x 00:18:58.156 [2024-04-26 20:36:16.271481] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:18:58.156 [2024-04-26 20:36:16.271535] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4070746 ] 00:18:58.156 EAL: No free 2048 kB hugepages reported on node 1 00:18:58.156 [2024-04-26 20:36:16.320317] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:58.156 [2024-04-26 20:36:16.371009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:58.727 20:36:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:58.727 20:36:17 -- common/autotest_common.sh@852 -- # return 0 00:18:58.727 20:36:17 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:58.988 [2024-04-26 20:36:17.171809] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:58.988 TLSTESTn1 00:18:58.988 20:36:17 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:59.248 Running I/O for 10 seconds... 00:19:09.247 00:19:09.247 Latency(us) 00:19:09.247 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:09.247 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:19:09.247 Verification LBA range: start 0x0 length 0x2000 00:19:09.247 TLSTESTn1 : 10.05 1627.13 6.36 0.00 0.00 78504.14 9448.11 92624.21 00:19:09.247 =================================================================================================================== 00:19:09.247 Total : 1627.13 6.36 0.00 0.00 78504.14 9448.11 92624.21 00:19:09.247 0 00:19:09.247 20:36:27 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:19:09.247 20:36:27 -- target/tls.sh@45 -- # killprocess 4070746 00:19:09.247 20:36:27 -- common/autotest_common.sh@926 -- # '[' -z 4070746 ']' 00:19:09.247 20:36:27 -- common/autotest_common.sh@930 -- # kill -0 4070746 00:19:09.247 20:36:27 -- common/autotest_common.sh@931 -- # uname 00:19:09.247 20:36:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:09.247 20:36:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4070746 00:19:09.247 20:36:27 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:19:09.247 20:36:27 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:19:09.247 20:36:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4070746' 00:19:09.247 killing process with pid 4070746 00:19:09.247 20:36:27 -- common/autotest_common.sh@945 -- # kill 4070746 00:19:09.247 Received shutdown signal, test time was about 10.000000 seconds 00:19:09.247 00:19:09.247 Latency(us) 00:19:09.247 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:09.247 =================================================================================================================== 00:19:09.247 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:09.247 20:36:27 -- common/autotest_common.sh@950 -- # wait 4070746 00:19:09.507 20:36:27 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:09.507 20:36:27 -- common/autotest_common.sh@640 -- # local es=0 00:19:09.507 20:36:27 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:09.507 20:36:27 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:19:09.507 20:36:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:09.507 20:36:27 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:19:09.507 20:36:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:09.507 20:36:27 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:09.507 20:36:27 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:09.507 20:36:27 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:09.507 20:36:27 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:09.507 20:36:27 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:19:09.507 20:36:27 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:09.507 20:36:27 -- target/tls.sh@28 -- # bdevperf_pid=4073108 00:19:09.507 20:36:27 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:09.507 20:36:27 -- target/tls.sh@31 -- # waitforlisten 4073108 /var/tmp/bdevperf.sock 00:19:09.507 20:36:27 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:09.507 20:36:27 -- common/autotest_common.sh@819 -- # '[' -z 4073108 ']' 00:19:09.507 20:36:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:09.507 20:36:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:09.507 20:36:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:09.507 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:09.507 20:36:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:09.507 20:36:27 -- common/autotest_common.sh@10 -- # set +x 00:19:09.507 [2024-04-26 20:36:27.669965] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:09.507 [2024-04-26 20:36:27.670018] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4073108 ] 00:19:09.507 EAL: No free 2048 kB hugepages reported on node 1 00:19:09.507 [2024-04-26 20:36:27.718688] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:09.507 [2024-04-26 20:36:27.768668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:10.449 20:36:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:10.449 20:36:28 -- common/autotest_common.sh@852 -- # return 0 00:19:10.449 20:36:28 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:10.449 [2024-04-26 20:36:28.581630] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:10.449 [2024-04-26 20:36:28.587143] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:19:10.449 [2024-04-26 20:36:28.587679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d14e10 (107): Transport endpoint is not connected 00:19:10.449 [2024-04-26 20:36:28.588675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d14e10 (9): Bad file descriptor 00:19:10.449 [2024-04-26 20:36:28.589677] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:19:10.449 [2024-04-26 20:36:28.589685] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:19:10.449 [2024-04-26 20:36:28.589692] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:19:10.449 request: 00:19:10.449 { 00:19:10.449 "name": "TLSTEST", 00:19:10.449 "trtype": "tcp", 00:19:10.449 "traddr": "10.0.0.2", 00:19:10.449 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:10.449 "adrfam": "ipv4", 00:19:10.449 "trsvcid": "4420", 00:19:10.449 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:10.449 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:19:10.449 "method": "bdev_nvme_attach_controller", 00:19:10.449 "req_id": 1 00:19:10.449 } 00:19:10.449 Got JSON-RPC error response 00:19:10.449 response: 00:19:10.449 { 00:19:10.449 "code": -32602, 00:19:10.449 "message": "Invalid parameters" 00:19:10.449 } 00:19:10.449 20:36:28 -- target/tls.sh@36 -- # killprocess 4073108 00:19:10.449 20:36:28 -- common/autotest_common.sh@926 -- # '[' -z 4073108 ']' 00:19:10.449 20:36:28 -- common/autotest_common.sh@930 -- # kill -0 4073108 00:19:10.449 20:36:28 -- common/autotest_common.sh@931 -- # uname 00:19:10.449 20:36:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:10.449 20:36:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4073108 00:19:10.449 20:36:28 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:19:10.449 20:36:28 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:19:10.449 20:36:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4073108' 00:19:10.449 killing process with pid 4073108 00:19:10.449 20:36:28 -- common/autotest_common.sh@945 -- # kill 4073108 00:19:10.449 Received shutdown signal, test time was about 10.000000 seconds 00:19:10.449 00:19:10.449 Latency(us) 00:19:10.449 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:10.449 =================================================================================================================== 00:19:10.449 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:10.449 20:36:28 -- common/autotest_common.sh@950 -- # wait 4073108 00:19:10.449 20:36:28 -- target/tls.sh@37 -- # return 1 00:19:10.449 20:36:28 -- common/autotest_common.sh@643 -- # es=1 00:19:10.449 20:36:28 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:19:10.449 20:36:28 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:19:10.449 20:36:28 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:19:10.449 20:36:28 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:10.449 20:36:28 -- common/autotest_common.sh@640 -- # local es=0 00:19:10.449 20:36:28 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:10.449 20:36:28 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:19:10.449 20:36:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:10.449 20:36:28 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:19:10.449 20:36:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:10.449 20:36:28 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:10.449 20:36:28 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:10.449 20:36:28 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:10.449 20:36:28 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:19:10.450 20:36:28 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:19:10.450 20:36:28 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:10.450 20:36:28 -- target/tls.sh@28 -- # bdevperf_pid=4073243 00:19:10.450 20:36:28 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:10.450 20:36:28 -- target/tls.sh@31 -- # waitforlisten 4073243 /var/tmp/bdevperf.sock 00:19:10.450 20:36:28 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:10.450 20:36:28 -- common/autotest_common.sh@819 -- # '[' -z 4073243 ']' 00:19:10.450 20:36:28 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:10.450 20:36:28 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:10.450 20:36:28 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:10.450 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:10.450 20:36:28 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:10.450 20:36:28 -- common/autotest_common.sh@10 -- # set +x 00:19:10.710 [2024-04-26 20:36:28.815616] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:10.710 [2024-04-26 20:36:28.815671] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4073243 ] 00:19:10.710 EAL: No free 2048 kB hugepages reported on node 1 00:19:10.710 [2024-04-26 20:36:28.864420] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:10.710 [2024-04-26 20:36:28.914235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:11.281 20:36:29 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:11.281 20:36:29 -- common/autotest_common.sh@852 -- # return 0 00:19:11.281 20:36:29 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:11.543 [2024-04-26 20:36:29.707173] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:11.543 [2024-04-26 20:36:29.711530] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:19:11.543 [2024-04-26 20:36:29.711553] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:19:11.543 [2024-04-26 20:36:29.711577] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:19:11.543 [2024-04-26 20:36:29.712243] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1483e10 (107): Transport endpoint is not connected 00:19:11.543 [2024-04-26 20:36:29.713238] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1483e10 (9): Bad file descriptor 00:19:11.543 [2024-04-26 20:36:29.714239] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:19:11.543 [2024-04-26 20:36:29.714247] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:19:11.543 [2024-04-26 20:36:29.714253] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:19:11.543 request: 00:19:11.543 { 00:19:11.543 "name": "TLSTEST", 00:19:11.543 "trtype": "tcp", 00:19:11.543 "traddr": "10.0.0.2", 00:19:11.543 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:19:11.543 "adrfam": "ipv4", 00:19:11.543 "trsvcid": "4420", 00:19:11.543 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:11.543 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:19:11.543 "method": "bdev_nvme_attach_controller", 00:19:11.543 "req_id": 1 00:19:11.543 } 00:19:11.543 Got JSON-RPC error response 00:19:11.543 response: 00:19:11.543 { 00:19:11.543 "code": -32602, 00:19:11.543 "message": "Invalid parameters" 00:19:11.543 } 00:19:11.543 20:36:29 -- target/tls.sh@36 -- # killprocess 4073243 00:19:11.543 20:36:29 -- common/autotest_common.sh@926 -- # '[' -z 4073243 ']' 00:19:11.543 20:36:29 -- common/autotest_common.sh@930 -- # kill -0 4073243 00:19:11.543 20:36:29 -- common/autotest_common.sh@931 -- # uname 00:19:11.543 20:36:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:11.543 20:36:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4073243 00:19:11.543 20:36:29 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:19:11.543 20:36:29 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:19:11.543 20:36:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4073243' 00:19:11.543 killing process with pid 4073243 00:19:11.543 20:36:29 -- common/autotest_common.sh@945 -- # kill 4073243 00:19:11.543 Received shutdown signal, test time was about 10.000000 seconds 00:19:11.543 00:19:11.543 Latency(us) 00:19:11.543 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:11.543 =================================================================================================================== 00:19:11.543 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:11.543 20:36:29 -- common/autotest_common.sh@950 -- # wait 4073243 00:19:11.543 20:36:29 -- target/tls.sh@37 -- # return 1 00:19:11.543 20:36:29 -- common/autotest_common.sh@643 -- # es=1 00:19:11.543 20:36:29 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:19:11.543 20:36:29 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:19:11.543 20:36:29 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:19:11.543 20:36:29 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:11.543 20:36:29 -- common/autotest_common.sh@640 -- # local es=0 00:19:11.543 20:36:29 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:11.803 20:36:29 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:19:11.803 20:36:29 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:11.803 20:36:29 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:19:11.803 20:36:29 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:11.803 20:36:29 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:11.803 20:36:29 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:11.803 20:36:29 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:19:11.803 20:36:29 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:11.803 20:36:29 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:19:11.803 20:36:29 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:11.803 20:36:29 -- target/tls.sh@28 -- # bdevperf_pid=4073473 00:19:11.803 20:36:29 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:11.803 20:36:29 -- target/tls.sh@31 -- # waitforlisten 4073473 /var/tmp/bdevperf.sock 00:19:11.803 20:36:29 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:11.803 20:36:29 -- common/autotest_common.sh@819 -- # '[' -z 4073473 ']' 00:19:11.803 20:36:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:11.804 20:36:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:11.804 20:36:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:11.804 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:11.804 20:36:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:11.804 20:36:29 -- common/autotest_common.sh@10 -- # set +x 00:19:11.804 [2024-04-26 20:36:29.936200] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:11.804 [2024-04-26 20:36:29.936254] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4073473 ] 00:19:11.804 EAL: No free 2048 kB hugepages reported on node 1 00:19:11.804 [2024-04-26 20:36:29.984767] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:11.804 [2024-04-26 20:36:30.037935] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:12.375 20:36:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:12.375 20:36:30 -- common/autotest_common.sh@852 -- # return 0 00:19:12.375 20:36:30 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:12.636 [2024-04-26 20:36:30.816611] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:12.636 [2024-04-26 20:36:30.822582] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:19:12.636 [2024-04-26 20:36:30.822605] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:19:12.636 [2024-04-26 20:36:30.822627] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:19:12.636 [2024-04-26 20:36:30.823799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x731e10 (107): Transport endpoint is not connected 00:19:12.636 [2024-04-26 20:36:30.824795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x731e10 (9): Bad file descriptor 00:19:12.636 [2024-04-26 20:36:30.825797] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:19:12.636 [2024-04-26 20:36:30.825805] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:19:12.636 [2024-04-26 20:36:30.825812] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:19:12.636 request: 00:19:12.636 { 00:19:12.636 "name": "TLSTEST", 00:19:12.636 "trtype": "tcp", 00:19:12.636 "traddr": "10.0.0.2", 00:19:12.636 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:12.636 "adrfam": "ipv4", 00:19:12.636 "trsvcid": "4420", 00:19:12.636 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:19:12.636 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:19:12.636 "method": "bdev_nvme_attach_controller", 00:19:12.636 "req_id": 1 00:19:12.636 } 00:19:12.636 Got JSON-RPC error response 00:19:12.636 response: 00:19:12.636 { 00:19:12.636 "code": -32602, 00:19:12.636 "message": "Invalid parameters" 00:19:12.636 } 00:19:12.636 20:36:30 -- target/tls.sh@36 -- # killprocess 4073473 00:19:12.636 20:36:30 -- common/autotest_common.sh@926 -- # '[' -z 4073473 ']' 00:19:12.636 20:36:30 -- common/autotest_common.sh@930 -- # kill -0 4073473 00:19:12.636 20:36:30 -- common/autotest_common.sh@931 -- # uname 00:19:12.636 20:36:30 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:12.636 20:36:30 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4073473 00:19:12.636 20:36:30 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:19:12.636 20:36:30 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:19:12.636 20:36:30 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4073473' 00:19:12.636 killing process with pid 4073473 00:19:12.636 20:36:30 -- common/autotest_common.sh@945 -- # kill 4073473 00:19:12.636 Received shutdown signal, test time was about 10.000000 seconds 00:19:12.636 00:19:12.636 Latency(us) 00:19:12.636 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:12.636 =================================================================================================================== 00:19:12.636 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:12.636 20:36:30 -- common/autotest_common.sh@950 -- # wait 4073473 00:19:12.896 20:36:30 -- target/tls.sh@37 -- # return 1 00:19:12.896 20:36:30 -- common/autotest_common.sh@643 -- # es=1 00:19:12.896 20:36:30 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:19:12.896 20:36:30 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:19:12.896 20:36:30 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:19:12.896 20:36:30 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:19:12.896 20:36:30 -- common/autotest_common.sh@640 -- # local es=0 00:19:12.896 20:36:30 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:19:12.896 20:36:30 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:19:12.896 20:36:30 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:12.896 20:36:31 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:19:12.896 20:36:30 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:12.896 20:36:31 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:19:12.897 20:36:31 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:12.897 20:36:31 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:12.897 20:36:31 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:12.897 20:36:31 -- target/tls.sh@23 -- # psk= 00:19:12.897 20:36:31 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:12.897 20:36:31 -- target/tls.sh@28 -- # bdevperf_pid=4073813 00:19:12.897 20:36:31 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:12.897 20:36:31 -- target/tls.sh@31 -- # waitforlisten 4073813 /var/tmp/bdevperf.sock 00:19:12.897 20:36:31 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:12.897 20:36:31 -- common/autotest_common.sh@819 -- # '[' -z 4073813 ']' 00:19:12.897 20:36:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:12.897 20:36:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:12.897 20:36:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:12.897 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:12.897 20:36:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:12.897 20:36:31 -- common/autotest_common.sh@10 -- # set +x 00:19:12.897 [2024-04-26 20:36:31.051145] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:12.897 [2024-04-26 20:36:31.051200] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4073813 ] 00:19:12.897 EAL: No free 2048 kB hugepages reported on node 1 00:19:12.897 [2024-04-26 20:36:31.101043] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:12.897 [2024-04-26 20:36:31.150693] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:13.869 20:36:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:13.869 20:36:31 -- common/autotest_common.sh@852 -- # return 0 00:19:13.869 20:36:31 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:19:13.869 [2024-04-26 20:36:31.966219] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:19:13.869 [2024-04-26 20:36:31.968048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d68890 (9): Bad file descriptor 00:19:13.869 [2024-04-26 20:36:31.969047] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:19:13.869 [2024-04-26 20:36:31.969056] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:19:13.869 [2024-04-26 20:36:31.969062] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:19:13.869 request: 00:19:13.869 { 00:19:13.869 "name": "TLSTEST", 00:19:13.869 "trtype": "tcp", 00:19:13.869 "traddr": "10.0.0.2", 00:19:13.869 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:13.869 "adrfam": "ipv4", 00:19:13.869 "trsvcid": "4420", 00:19:13.869 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:13.869 "method": "bdev_nvme_attach_controller", 00:19:13.869 "req_id": 1 00:19:13.869 } 00:19:13.869 Got JSON-RPC error response 00:19:13.869 response: 00:19:13.869 { 00:19:13.869 "code": -32602, 00:19:13.869 "message": "Invalid parameters" 00:19:13.869 } 00:19:13.869 20:36:31 -- target/tls.sh@36 -- # killprocess 4073813 00:19:13.869 20:36:31 -- common/autotest_common.sh@926 -- # '[' -z 4073813 ']' 00:19:13.869 20:36:31 -- common/autotest_common.sh@930 -- # kill -0 4073813 00:19:13.869 20:36:31 -- common/autotest_common.sh@931 -- # uname 00:19:13.869 20:36:31 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:13.869 20:36:31 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4073813 00:19:13.869 20:36:32 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:19:13.869 20:36:32 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:19:13.869 20:36:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4073813' 00:19:13.869 killing process with pid 4073813 00:19:13.869 20:36:32 -- common/autotest_common.sh@945 -- # kill 4073813 00:19:13.869 Received shutdown signal, test time was about 10.000000 seconds 00:19:13.869 00:19:13.869 Latency(us) 00:19:13.869 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:13.869 =================================================================================================================== 00:19:13.869 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:13.869 20:36:32 -- common/autotest_common.sh@950 -- # wait 4073813 00:19:13.869 20:36:32 -- target/tls.sh@37 -- # return 1 00:19:13.869 20:36:32 -- common/autotest_common.sh@643 -- # es=1 00:19:13.869 20:36:32 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:19:13.869 20:36:32 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:19:13.869 20:36:32 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:19:13.869 20:36:32 -- target/tls.sh@167 -- # killprocess 4067507 00:19:13.869 20:36:32 -- common/autotest_common.sh@926 -- # '[' -z 4067507 ']' 00:19:13.869 20:36:32 -- common/autotest_common.sh@930 -- # kill -0 4067507 00:19:13.869 20:36:32 -- common/autotest_common.sh@931 -- # uname 00:19:13.869 20:36:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:13.869 20:36:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4067507 00:19:14.137 20:36:32 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:19:14.137 20:36:32 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:19:14.137 20:36:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4067507' 00:19:14.137 killing process with pid 4067507 00:19:14.137 20:36:32 -- common/autotest_common.sh@945 -- # kill 4067507 00:19:14.137 20:36:32 -- common/autotest_common.sh@950 -- # wait 4067507 00:19:14.137 20:36:32 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:19:14.137 20:36:32 -- target/tls.sh@49 -- # local key hash crc 00:19:14.137 20:36:32 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:19:14.137 20:36:32 -- target/tls.sh@51 -- # hash=02 00:19:14.137 20:36:32 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:19:14.137 20:36:32 -- target/tls.sh@52 -- # gzip -1 -c 00:19:14.137 20:36:32 -- target/tls.sh@52 -- # tail -c8 00:19:14.137 20:36:32 -- target/tls.sh@52 -- # head -c 4 00:19:14.137 20:36:32 -- target/tls.sh@52 -- # crc='�e�'\''' 00:19:14.137 20:36:32 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:14.137 20:36:32 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:19:14.137 20:36:32 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:19:14.137 20:36:32 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:19:14.137 20:36:32 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:14.137 20:36:32 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:19:14.138 20:36:32 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:14.138 20:36:32 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:19:14.138 20:36:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:14.138 20:36:32 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:14.138 20:36:32 -- common/autotest_common.sh@10 -- # set +x 00:19:14.138 20:36:32 -- nvmf/common.sh@469 -- # nvmfpid=4074034 00:19:14.138 20:36:32 -- nvmf/common.sh@470 -- # waitforlisten 4074034 00:19:14.138 20:36:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:14.138 20:36:32 -- common/autotest_common.sh@819 -- # '[' -z 4074034 ']' 00:19:14.138 20:36:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:14.138 20:36:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:14.138 20:36:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:14.138 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:14.138 20:36:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:14.138 20:36:32 -- common/autotest_common.sh@10 -- # set +x 00:19:14.138 [2024-04-26 20:36:32.408325] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:14.138 [2024-04-26 20:36:32.408382] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:14.138 EAL: No free 2048 kB hugepages reported on node 1 00:19:14.138 [2024-04-26 20:36:32.472836] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:14.398 [2024-04-26 20:36:32.536675] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:14.398 [2024-04-26 20:36:32.536789] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:14.398 [2024-04-26 20:36:32.536798] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:14.398 [2024-04-26 20:36:32.536809] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:14.398 [2024-04-26 20:36:32.536826] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:14.970 20:36:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:14.970 20:36:33 -- common/autotest_common.sh@852 -- # return 0 00:19:14.970 20:36:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:14.970 20:36:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:14.970 20:36:33 -- common/autotest_common.sh@10 -- # set +x 00:19:14.970 20:36:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:14.970 20:36:33 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:14.970 20:36:33 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:14.970 20:36:33 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:15.231 [2024-04-26 20:36:33.347586] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:15.231 20:36:33 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:15.231 20:36:33 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:15.492 [2024-04-26 20:36:33.640325] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:15.492 [2024-04-26 20:36:33.640525] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:15.492 20:36:33 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:15.492 malloc0 00:19:15.492 20:36:33 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:15.753 20:36:33 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:15.753 20:36:34 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:15.753 20:36:34 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:15.753 20:36:34 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:15.753 20:36:34 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:15.753 20:36:34 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:19:15.753 20:36:34 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:15.753 20:36:34 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:15.753 20:36:34 -- target/tls.sh@28 -- # bdevperf_pid=4074416 00:19:15.753 20:36:34 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:15.753 20:36:34 -- target/tls.sh@31 -- # waitforlisten 4074416 /var/tmp/bdevperf.sock 00:19:15.753 20:36:34 -- common/autotest_common.sh@819 -- # '[' -z 4074416 ']' 00:19:15.753 20:36:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:15.753 20:36:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:15.753 20:36:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:15.753 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:15.753 20:36:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:15.753 20:36:34 -- common/autotest_common.sh@10 -- # set +x 00:19:16.014 [2024-04-26 20:36:34.129157] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:16.014 [2024-04-26 20:36:34.129211] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4074416 ] 00:19:16.014 EAL: No free 2048 kB hugepages reported on node 1 00:19:16.014 [2024-04-26 20:36:34.177716] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:16.014 [2024-04-26 20:36:34.228632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:16.585 20:36:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:16.585 20:36:34 -- common/autotest_common.sh@852 -- # return 0 00:19:16.585 20:36:34 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:16.854 [2024-04-26 20:36:35.001484] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:16.854 TLSTESTn1 00:19:16.854 20:36:35 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:19:16.854 Running I/O for 10 seconds... 00:19:29.087 00:19:29.087 Latency(us) 00:19:29.087 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:29.087 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:19:29.087 Verification LBA range: start 0x0 length 0x2000 00:19:29.087 TLSTESTn1 : 10.06 1601.36 6.26 0.00 0.00 79764.40 10158.08 81264.64 00:19:29.087 =================================================================================================================== 00:19:29.087 Total : 1601.36 6.26 0.00 0.00 79764.40 10158.08 81264.64 00:19:29.087 0 00:19:29.087 20:36:45 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:19:29.087 20:36:45 -- target/tls.sh@45 -- # killprocess 4074416 00:19:29.087 20:36:45 -- common/autotest_common.sh@926 -- # '[' -z 4074416 ']' 00:19:29.087 20:36:45 -- common/autotest_common.sh@930 -- # kill -0 4074416 00:19:29.087 20:36:45 -- common/autotest_common.sh@931 -- # uname 00:19:29.087 20:36:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:29.087 20:36:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4074416 00:19:29.087 20:36:45 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:19:29.087 20:36:45 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:19:29.087 20:36:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4074416' 00:19:29.087 killing process with pid 4074416 00:19:29.087 20:36:45 -- common/autotest_common.sh@945 -- # kill 4074416 00:19:29.087 Received shutdown signal, test time was about 10.000000 seconds 00:19:29.087 00:19:29.087 Latency(us) 00:19:29.087 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:29.087 =================================================================================================================== 00:19:29.087 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:29.087 20:36:45 -- common/autotest_common.sh@950 -- # wait 4074416 00:19:29.087 20:36:45 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:29.087 20:36:45 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:29.087 20:36:45 -- common/autotest_common.sh@640 -- # local es=0 00:19:29.087 20:36:45 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:29.087 20:36:45 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:19:29.087 20:36:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:29.087 20:36:45 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:19:29.087 20:36:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:29.087 20:36:45 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:29.087 20:36:45 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:29.087 20:36:45 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:29.087 20:36:45 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:29.087 20:36:45 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:19:29.087 20:36:45 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:29.087 20:36:45 -- target/tls.sh@28 -- # bdevperf_pid=4076584 00:19:29.087 20:36:45 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:29.087 20:36:45 -- target/tls.sh@31 -- # waitforlisten 4076584 /var/tmp/bdevperf.sock 00:19:29.087 20:36:45 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:29.087 20:36:45 -- common/autotest_common.sh@819 -- # '[' -z 4076584 ']' 00:19:29.087 20:36:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:29.087 20:36:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:29.087 20:36:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:29.087 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:29.087 20:36:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:29.087 20:36:45 -- common/autotest_common.sh@10 -- # set +x 00:19:29.087 [2024-04-26 20:36:45.485883] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:29.087 [2024-04-26 20:36:45.485936] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4076584 ] 00:19:29.087 EAL: No free 2048 kB hugepages reported on node 1 00:19:29.087 [2024-04-26 20:36:45.536032] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:29.087 [2024-04-26 20:36:45.584218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:29.087 20:36:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:29.087 20:36:46 -- common/autotest_common.sh@852 -- # return 0 00:19:29.087 20:36:46 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:29.087 [2024-04-26 20:36:46.385191] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:29.087 [2024-04-26 20:36:46.385226] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:19:29.087 request: 00:19:29.087 { 00:19:29.087 "name": "TLSTEST", 00:19:29.087 "trtype": "tcp", 00:19:29.087 "traddr": "10.0.0.2", 00:19:29.087 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:29.087 "adrfam": "ipv4", 00:19:29.087 "trsvcid": "4420", 00:19:29.087 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:29.088 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:19:29.088 "method": "bdev_nvme_attach_controller", 00:19:29.088 "req_id": 1 00:19:29.088 } 00:19:29.088 Got JSON-RPC error response 00:19:29.088 response: 00:19:29.088 { 00:19:29.088 "code": -22, 00:19:29.088 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:19:29.088 } 00:19:29.088 20:36:46 -- target/tls.sh@36 -- # killprocess 4076584 00:19:29.088 20:36:46 -- common/autotest_common.sh@926 -- # '[' -z 4076584 ']' 00:19:29.088 20:36:46 -- common/autotest_common.sh@930 -- # kill -0 4076584 00:19:29.088 20:36:46 -- common/autotest_common.sh@931 -- # uname 00:19:29.088 20:36:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:29.088 20:36:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4076584 00:19:29.088 20:36:46 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:19:29.088 20:36:46 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:19:29.088 20:36:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4076584' 00:19:29.088 killing process with pid 4076584 00:19:29.088 20:36:46 -- common/autotest_common.sh@945 -- # kill 4076584 00:19:29.088 Received shutdown signal, test time was about 10.000000 seconds 00:19:29.088 00:19:29.088 Latency(us) 00:19:29.088 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:29.088 =================================================================================================================== 00:19:29.088 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:29.088 20:36:46 -- common/autotest_common.sh@950 -- # wait 4076584 00:19:29.088 20:36:46 -- target/tls.sh@37 -- # return 1 00:19:29.088 20:36:46 -- common/autotest_common.sh@643 -- # es=1 00:19:29.088 20:36:46 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:19:29.088 20:36:46 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:19:29.088 20:36:46 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:19:29.088 20:36:46 -- target/tls.sh@183 -- # killprocess 4074034 00:19:29.088 20:36:46 -- common/autotest_common.sh@926 -- # '[' -z 4074034 ']' 00:19:29.088 20:36:46 -- common/autotest_common.sh@930 -- # kill -0 4074034 00:19:29.088 20:36:46 -- common/autotest_common.sh@931 -- # uname 00:19:29.088 20:36:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:29.088 20:36:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4074034 00:19:29.088 20:36:46 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:19:29.088 20:36:46 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:19:29.088 20:36:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4074034' 00:19:29.088 killing process with pid 4074034 00:19:29.088 20:36:46 -- common/autotest_common.sh@945 -- # kill 4074034 00:19:29.088 20:36:46 -- common/autotest_common.sh@950 -- # wait 4074034 00:19:29.088 20:36:46 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:19:29.088 20:36:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:29.088 20:36:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:29.088 20:36:46 -- common/autotest_common.sh@10 -- # set +x 00:19:29.088 20:36:46 -- nvmf/common.sh@469 -- # nvmfpid=4076935 00:19:29.088 20:36:46 -- nvmf/common.sh@470 -- # waitforlisten 4076935 00:19:29.088 20:36:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:29.088 20:36:46 -- common/autotest_common.sh@819 -- # '[' -z 4076935 ']' 00:19:29.088 20:36:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:29.088 20:36:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:29.088 20:36:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:29.088 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:29.088 20:36:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:29.088 20:36:46 -- common/autotest_common.sh@10 -- # set +x 00:19:29.088 [2024-04-26 20:36:46.815484] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:29.088 [2024-04-26 20:36:46.815551] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:29.088 EAL: No free 2048 kB hugepages reported on node 1 00:19:29.088 [2024-04-26 20:36:46.883084] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:29.088 [2024-04-26 20:36:46.945247] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:29.088 [2024-04-26 20:36:46.945376] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:29.088 [2024-04-26 20:36:46.945385] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:29.088 [2024-04-26 20:36:46.945393] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:29.088 [2024-04-26 20:36:46.945410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:29.350 20:36:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:29.350 20:36:47 -- common/autotest_common.sh@852 -- # return 0 00:19:29.350 20:36:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:29.350 20:36:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:29.350 20:36:47 -- common/autotest_common.sh@10 -- # set +x 00:19:29.350 20:36:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:29.350 20:36:47 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:29.350 20:36:47 -- common/autotest_common.sh@640 -- # local es=0 00:19:29.350 20:36:47 -- common/autotest_common.sh@642 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:29.350 20:36:47 -- common/autotest_common.sh@628 -- # local arg=setup_nvmf_tgt 00:19:29.350 20:36:47 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:29.350 20:36:47 -- common/autotest_common.sh@632 -- # type -t setup_nvmf_tgt 00:19:29.350 20:36:47 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:29.350 20:36:47 -- common/autotest_common.sh@643 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:29.350 20:36:47 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:29.350 20:36:47 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:29.612 [2024-04-26 20:36:47.751950] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:29.612 20:36:47 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:29.612 20:36:47 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:29.872 [2024-04-26 20:36:48.036656] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:29.872 [2024-04-26 20:36:48.036850] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:29.872 20:36:48 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:29.872 malloc0 00:19:29.872 20:36:48 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:30.133 20:36:48 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:30.395 [2024-04-26 20:36:48.480596] tcp.c:3549:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:19:30.395 [2024-04-26 20:36:48.480621] tcp.c:3618:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:19:30.395 [2024-04-26 20:36:48.480639] subsystem.c: 840:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:19:30.395 request: 00:19:30.395 { 00:19:30.395 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:30.395 "host": "nqn.2016-06.io.spdk:host1", 00:19:30.395 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:19:30.395 "method": "nvmf_subsystem_add_host", 00:19:30.395 "req_id": 1 00:19:30.395 } 00:19:30.395 Got JSON-RPC error response 00:19:30.395 response: 00:19:30.395 { 00:19:30.395 "code": -32603, 00:19:30.395 "message": "Internal error" 00:19:30.395 } 00:19:30.395 20:36:48 -- common/autotest_common.sh@643 -- # es=1 00:19:30.395 20:36:48 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:19:30.395 20:36:48 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:19:30.395 20:36:48 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:19:30.395 20:36:48 -- target/tls.sh@189 -- # killprocess 4076935 00:19:30.395 20:36:48 -- common/autotest_common.sh@926 -- # '[' -z 4076935 ']' 00:19:30.395 20:36:48 -- common/autotest_common.sh@930 -- # kill -0 4076935 00:19:30.395 20:36:48 -- common/autotest_common.sh@931 -- # uname 00:19:30.395 20:36:48 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:30.395 20:36:48 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4076935 00:19:30.395 20:36:48 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:19:30.395 20:36:48 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:19:30.395 20:36:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4076935' 00:19:30.395 killing process with pid 4076935 00:19:30.395 20:36:48 -- common/autotest_common.sh@945 -- # kill 4076935 00:19:30.395 20:36:48 -- common/autotest_common.sh@950 -- # wait 4076935 00:19:30.395 20:36:48 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:30.395 20:36:48 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:19:30.395 20:36:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:30.395 20:36:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:30.395 20:36:48 -- common/autotest_common.sh@10 -- # set +x 00:19:30.395 20:36:48 -- nvmf/common.sh@469 -- # nvmfpid=4077309 00:19:30.395 20:36:48 -- nvmf/common.sh@470 -- # waitforlisten 4077309 00:19:30.395 20:36:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:30.395 20:36:48 -- common/autotest_common.sh@819 -- # '[' -z 4077309 ']' 00:19:30.395 20:36:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:30.395 20:36:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:30.395 20:36:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:30.395 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:30.395 20:36:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:30.395 20:36:48 -- common/autotest_common.sh@10 -- # set +x 00:19:30.657 [2024-04-26 20:36:48.745773] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:30.657 [2024-04-26 20:36:48.745829] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:30.657 EAL: No free 2048 kB hugepages reported on node 1 00:19:30.657 [2024-04-26 20:36:48.809672] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:30.657 [2024-04-26 20:36:48.872564] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:30.657 [2024-04-26 20:36:48.872681] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:30.657 [2024-04-26 20:36:48.872689] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:30.657 [2024-04-26 20:36:48.872697] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:30.657 [2024-04-26 20:36:48.872713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:31.229 20:36:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:31.229 20:36:49 -- common/autotest_common.sh@852 -- # return 0 00:19:31.229 20:36:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:31.229 20:36:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:31.229 20:36:49 -- common/autotest_common.sh@10 -- # set +x 00:19:31.229 20:36:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:31.229 20:36:49 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:31.229 20:36:49 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:31.229 20:36:49 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:31.489 [2024-04-26 20:36:49.699246] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:31.490 20:36:49 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:31.750 20:36:49 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:31.750 [2024-04-26 20:36:49.987966] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:31.750 [2024-04-26 20:36:49.988173] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:31.750 20:36:50 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:32.011 malloc0 00:19:32.011 20:36:50 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:32.011 20:36:50 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:32.273 20:36:50 -- target/tls.sh@197 -- # bdevperf_pid=4077678 00:19:32.273 20:36:50 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:32.273 20:36:50 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:32.273 20:36:50 -- target/tls.sh@200 -- # waitforlisten 4077678 /var/tmp/bdevperf.sock 00:19:32.273 20:36:50 -- common/autotest_common.sh@819 -- # '[' -z 4077678 ']' 00:19:32.273 20:36:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:32.273 20:36:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:32.273 20:36:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:32.273 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:32.273 20:36:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:32.273 20:36:50 -- common/autotest_common.sh@10 -- # set +x 00:19:32.273 [2024-04-26 20:36:50.523241] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:32.273 [2024-04-26 20:36:50.523297] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4077678 ] 00:19:32.273 EAL: No free 2048 kB hugepages reported on node 1 00:19:32.273 [2024-04-26 20:36:50.572245] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:32.534 [2024-04-26 20:36:50.622813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:33.107 20:36:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:33.107 20:36:51 -- common/autotest_common.sh@852 -- # return 0 00:19:33.107 20:36:51 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:33.107 [2024-04-26 20:36:51.419878] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:33.368 TLSTESTn1 00:19:33.368 20:36:51 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:19:33.630 20:36:51 -- target/tls.sh@205 -- # tgtconf='{ 00:19:33.630 "subsystems": [ 00:19:33.630 { 00:19:33.630 "subsystem": "iobuf", 00:19:33.630 "config": [ 00:19:33.630 { 00:19:33.630 "method": "iobuf_set_options", 00:19:33.630 "params": { 00:19:33.630 "small_pool_count": 8192, 00:19:33.630 "large_pool_count": 1024, 00:19:33.630 "small_bufsize": 8192, 00:19:33.630 "large_bufsize": 135168 00:19:33.630 } 00:19:33.630 } 00:19:33.630 ] 00:19:33.630 }, 00:19:33.630 { 00:19:33.630 "subsystem": "sock", 00:19:33.630 "config": [ 00:19:33.630 { 00:19:33.630 "method": "sock_impl_set_options", 00:19:33.630 "params": { 00:19:33.630 "impl_name": "posix", 00:19:33.630 "recv_buf_size": 2097152, 00:19:33.630 "send_buf_size": 2097152, 00:19:33.630 "enable_recv_pipe": true, 00:19:33.630 "enable_quickack": false, 00:19:33.630 "enable_placement_id": 0, 00:19:33.630 "enable_zerocopy_send_server": true, 00:19:33.630 "enable_zerocopy_send_client": false, 00:19:33.630 "zerocopy_threshold": 0, 00:19:33.630 "tls_version": 0, 00:19:33.630 "enable_ktls": false 00:19:33.630 } 00:19:33.630 }, 00:19:33.630 { 00:19:33.630 "method": "sock_impl_set_options", 00:19:33.630 "params": { 00:19:33.630 "impl_name": "ssl", 00:19:33.630 "recv_buf_size": 4096, 00:19:33.630 "send_buf_size": 4096, 00:19:33.630 "enable_recv_pipe": true, 00:19:33.630 "enable_quickack": false, 00:19:33.630 "enable_placement_id": 0, 00:19:33.630 "enable_zerocopy_send_server": true, 00:19:33.630 "enable_zerocopy_send_client": false, 00:19:33.630 "zerocopy_threshold": 0, 00:19:33.630 "tls_version": 0, 00:19:33.630 "enable_ktls": false 00:19:33.630 } 00:19:33.630 } 00:19:33.630 ] 00:19:33.630 }, 00:19:33.630 { 00:19:33.630 "subsystem": "vmd", 00:19:33.631 "config": [] 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "subsystem": "accel", 00:19:33.631 "config": [ 00:19:33.631 { 00:19:33.631 "method": "accel_set_options", 00:19:33.631 "params": { 00:19:33.631 "small_cache_size": 128, 00:19:33.631 "large_cache_size": 16, 00:19:33.631 "task_count": 2048, 00:19:33.631 "sequence_count": 2048, 00:19:33.631 "buf_count": 2048 00:19:33.631 } 00:19:33.631 } 00:19:33.631 ] 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "subsystem": "bdev", 00:19:33.631 "config": [ 00:19:33.631 { 00:19:33.631 "method": "bdev_set_options", 00:19:33.631 "params": { 00:19:33.631 "bdev_io_pool_size": 65535, 00:19:33.631 "bdev_io_cache_size": 256, 00:19:33.631 "bdev_auto_examine": true, 00:19:33.631 "iobuf_small_cache_size": 128, 00:19:33.631 "iobuf_large_cache_size": 16 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "bdev_raid_set_options", 00:19:33.631 "params": { 00:19:33.631 "process_window_size_kb": 1024 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "bdev_iscsi_set_options", 00:19:33.631 "params": { 00:19:33.631 "timeout_sec": 30 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "bdev_nvme_set_options", 00:19:33.631 "params": { 00:19:33.631 "action_on_timeout": "none", 00:19:33.631 "timeout_us": 0, 00:19:33.631 "timeout_admin_us": 0, 00:19:33.631 "keep_alive_timeout_ms": 10000, 00:19:33.631 "transport_retry_count": 4, 00:19:33.631 "arbitration_burst": 0, 00:19:33.631 "low_priority_weight": 0, 00:19:33.631 "medium_priority_weight": 0, 00:19:33.631 "high_priority_weight": 0, 00:19:33.631 "nvme_adminq_poll_period_us": 10000, 00:19:33.631 "nvme_ioq_poll_period_us": 0, 00:19:33.631 "io_queue_requests": 0, 00:19:33.631 "delay_cmd_submit": true, 00:19:33.631 "bdev_retry_count": 3, 00:19:33.631 "transport_ack_timeout": 0, 00:19:33.631 "ctrlr_loss_timeout_sec": 0, 00:19:33.631 "reconnect_delay_sec": 0, 00:19:33.631 "fast_io_fail_timeout_sec": 0, 00:19:33.631 "generate_uuids": false, 00:19:33.631 "transport_tos": 0, 00:19:33.631 "io_path_stat": false, 00:19:33.631 "allow_accel_sequence": false 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "bdev_nvme_set_hotplug", 00:19:33.631 "params": { 00:19:33.631 "period_us": 100000, 00:19:33.631 "enable": false 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "bdev_malloc_create", 00:19:33.631 "params": { 00:19:33.631 "name": "malloc0", 00:19:33.631 "num_blocks": 8192, 00:19:33.631 "block_size": 4096, 00:19:33.631 "physical_block_size": 4096, 00:19:33.631 "uuid": "a929da65-ab39-49e2-b323-43677c54a38e", 00:19:33.631 "optimal_io_boundary": 0 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "bdev_wait_for_examine" 00:19:33.631 } 00:19:33.631 ] 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "subsystem": "nbd", 00:19:33.631 "config": [] 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "subsystem": "scheduler", 00:19:33.631 "config": [ 00:19:33.631 { 00:19:33.631 "method": "framework_set_scheduler", 00:19:33.631 "params": { 00:19:33.631 "name": "static" 00:19:33.631 } 00:19:33.631 } 00:19:33.631 ] 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "subsystem": "nvmf", 00:19:33.631 "config": [ 00:19:33.631 { 00:19:33.631 "method": "nvmf_set_config", 00:19:33.631 "params": { 00:19:33.631 "discovery_filter": "match_any", 00:19:33.631 "admin_cmd_passthru": { 00:19:33.631 "identify_ctrlr": false 00:19:33.631 } 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "nvmf_set_max_subsystems", 00:19:33.631 "params": { 00:19:33.631 "max_subsystems": 1024 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "nvmf_set_crdt", 00:19:33.631 "params": { 00:19:33.631 "crdt1": 0, 00:19:33.631 "crdt2": 0, 00:19:33.631 "crdt3": 0 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "nvmf_create_transport", 00:19:33.631 "params": { 00:19:33.631 "trtype": "TCP", 00:19:33.631 "max_queue_depth": 128, 00:19:33.631 "max_io_qpairs_per_ctrlr": 127, 00:19:33.631 "in_capsule_data_size": 4096, 00:19:33.631 "max_io_size": 131072, 00:19:33.631 "io_unit_size": 131072, 00:19:33.631 "max_aq_depth": 128, 00:19:33.631 "num_shared_buffers": 511, 00:19:33.631 "buf_cache_size": 4294967295, 00:19:33.631 "dif_insert_or_strip": false, 00:19:33.631 "zcopy": false, 00:19:33.631 "c2h_success": false, 00:19:33.631 "sock_priority": 0, 00:19:33.631 "abort_timeout_sec": 1 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "nvmf_create_subsystem", 00:19:33.631 "params": { 00:19:33.631 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:33.631 "allow_any_host": false, 00:19:33.631 "serial_number": "SPDK00000000000001", 00:19:33.631 "model_number": "SPDK bdev Controller", 00:19:33.631 "max_namespaces": 10, 00:19:33.631 "min_cntlid": 1, 00:19:33.631 "max_cntlid": 65519, 00:19:33.631 "ana_reporting": false 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "nvmf_subsystem_add_host", 00:19:33.631 "params": { 00:19:33.631 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:33.631 "host": "nqn.2016-06.io.spdk:host1", 00:19:33.631 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "nvmf_subsystem_add_ns", 00:19:33.631 "params": { 00:19:33.631 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:33.631 "namespace": { 00:19:33.631 "nsid": 1, 00:19:33.631 "bdev_name": "malloc0", 00:19:33.631 "nguid": "A929DA65AB3949E2B32343677C54A38E", 00:19:33.631 "uuid": "a929da65-ab39-49e2-b323-43677c54a38e" 00:19:33.631 } 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "nvmf_subsystem_add_listener", 00:19:33.631 "params": { 00:19:33.631 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:33.631 "listen_address": { 00:19:33.631 "trtype": "TCP", 00:19:33.631 "adrfam": "IPv4", 00:19:33.631 "traddr": "10.0.0.2", 00:19:33.631 "trsvcid": "4420" 00:19:33.631 }, 00:19:33.631 "secure_channel": true 00:19:33.631 } 00:19:33.631 } 00:19:33.631 ] 00:19:33.631 } 00:19:33.631 ] 00:19:33.631 }' 00:19:33.631 20:36:51 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:19:33.631 20:36:51 -- target/tls.sh@206 -- # bdevperfconf='{ 00:19:33.631 "subsystems": [ 00:19:33.631 { 00:19:33.631 "subsystem": "iobuf", 00:19:33.631 "config": [ 00:19:33.631 { 00:19:33.631 "method": "iobuf_set_options", 00:19:33.631 "params": { 00:19:33.631 "small_pool_count": 8192, 00:19:33.631 "large_pool_count": 1024, 00:19:33.631 "small_bufsize": 8192, 00:19:33.631 "large_bufsize": 135168 00:19:33.631 } 00:19:33.631 } 00:19:33.631 ] 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "subsystem": "sock", 00:19:33.631 "config": [ 00:19:33.631 { 00:19:33.631 "method": "sock_impl_set_options", 00:19:33.631 "params": { 00:19:33.631 "impl_name": "posix", 00:19:33.631 "recv_buf_size": 2097152, 00:19:33.631 "send_buf_size": 2097152, 00:19:33.631 "enable_recv_pipe": true, 00:19:33.631 "enable_quickack": false, 00:19:33.631 "enable_placement_id": 0, 00:19:33.631 "enable_zerocopy_send_server": true, 00:19:33.631 "enable_zerocopy_send_client": false, 00:19:33.631 "zerocopy_threshold": 0, 00:19:33.631 "tls_version": 0, 00:19:33.631 "enable_ktls": false 00:19:33.631 } 00:19:33.631 }, 00:19:33.631 { 00:19:33.631 "method": "sock_impl_set_options", 00:19:33.631 "params": { 00:19:33.631 "impl_name": "ssl", 00:19:33.631 "recv_buf_size": 4096, 00:19:33.632 "send_buf_size": 4096, 00:19:33.632 "enable_recv_pipe": true, 00:19:33.632 "enable_quickack": false, 00:19:33.632 "enable_placement_id": 0, 00:19:33.632 "enable_zerocopy_send_server": true, 00:19:33.632 "enable_zerocopy_send_client": false, 00:19:33.632 "zerocopy_threshold": 0, 00:19:33.632 "tls_version": 0, 00:19:33.632 "enable_ktls": false 00:19:33.632 } 00:19:33.632 } 00:19:33.632 ] 00:19:33.632 }, 00:19:33.632 { 00:19:33.632 "subsystem": "vmd", 00:19:33.632 "config": [] 00:19:33.632 }, 00:19:33.632 { 00:19:33.632 "subsystem": "accel", 00:19:33.632 "config": [ 00:19:33.632 { 00:19:33.632 "method": "accel_set_options", 00:19:33.632 "params": { 00:19:33.632 "small_cache_size": 128, 00:19:33.632 "large_cache_size": 16, 00:19:33.632 "task_count": 2048, 00:19:33.632 "sequence_count": 2048, 00:19:33.632 "buf_count": 2048 00:19:33.632 } 00:19:33.632 } 00:19:33.632 ] 00:19:33.632 }, 00:19:33.632 { 00:19:33.632 "subsystem": "bdev", 00:19:33.632 "config": [ 00:19:33.632 { 00:19:33.632 "method": "bdev_set_options", 00:19:33.632 "params": { 00:19:33.632 "bdev_io_pool_size": 65535, 00:19:33.632 "bdev_io_cache_size": 256, 00:19:33.632 "bdev_auto_examine": true, 00:19:33.632 "iobuf_small_cache_size": 128, 00:19:33.632 "iobuf_large_cache_size": 16 00:19:33.632 } 00:19:33.632 }, 00:19:33.632 { 00:19:33.632 "method": "bdev_raid_set_options", 00:19:33.632 "params": { 00:19:33.632 "process_window_size_kb": 1024 00:19:33.632 } 00:19:33.632 }, 00:19:33.632 { 00:19:33.632 "method": "bdev_iscsi_set_options", 00:19:33.632 "params": { 00:19:33.632 "timeout_sec": 30 00:19:33.632 } 00:19:33.632 }, 00:19:33.632 { 00:19:33.632 "method": "bdev_nvme_set_options", 00:19:33.632 "params": { 00:19:33.632 "action_on_timeout": "none", 00:19:33.632 "timeout_us": 0, 00:19:33.632 "timeout_admin_us": 0, 00:19:33.632 "keep_alive_timeout_ms": 10000, 00:19:33.632 "transport_retry_count": 4, 00:19:33.632 "arbitration_burst": 0, 00:19:33.632 "low_priority_weight": 0, 00:19:33.632 "medium_priority_weight": 0, 00:19:33.632 "high_priority_weight": 0, 00:19:33.632 "nvme_adminq_poll_period_us": 10000, 00:19:33.632 "nvme_ioq_poll_period_us": 0, 00:19:33.632 "io_queue_requests": 512, 00:19:33.632 "delay_cmd_submit": true, 00:19:33.632 "bdev_retry_count": 3, 00:19:33.632 "transport_ack_timeout": 0, 00:19:33.632 "ctrlr_loss_timeout_sec": 0, 00:19:33.632 "reconnect_delay_sec": 0, 00:19:33.632 "fast_io_fail_timeout_sec": 0, 00:19:33.632 "generate_uuids": false, 00:19:33.632 "transport_tos": 0, 00:19:33.632 "io_path_stat": false, 00:19:33.632 "allow_accel_sequence": false 00:19:33.632 } 00:19:33.632 }, 00:19:33.632 { 00:19:33.632 "method": "bdev_nvme_attach_controller", 00:19:33.632 "params": { 00:19:33.632 "name": "TLSTEST", 00:19:33.632 "trtype": "TCP", 00:19:33.632 "adrfam": "IPv4", 00:19:33.632 "traddr": "10.0.0.2", 00:19:33.632 "trsvcid": "4420", 00:19:33.632 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:33.632 "prchk_reftag": false, 00:19:33.632 "prchk_guard": false, 00:19:33.632 "ctrlr_loss_timeout_sec": 0, 00:19:33.632 "reconnect_delay_sec": 0, 00:19:33.632 "fast_io_fail_timeout_sec": 0, 00:19:33.632 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:19:33.632 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:33.632 "hdgst": false, 00:19:33.632 "ddgst": false 00:19:33.632 } 00:19:33.632 }, 00:19:33.632 { 00:19:33.632 "method": "bdev_nvme_set_hotplug", 00:19:33.632 "params": { 00:19:33.632 "period_us": 100000, 00:19:33.632 "enable": false 00:19:33.632 } 00:19:33.632 }, 00:19:33.632 { 00:19:33.632 "method": "bdev_wait_for_examine" 00:19:33.632 } 00:19:33.632 ] 00:19:33.632 }, 00:19:33.632 { 00:19:33.632 "subsystem": "nbd", 00:19:33.632 "config": [] 00:19:33.632 } 00:19:33.632 ] 00:19:33.632 }' 00:19:33.632 20:36:51 -- target/tls.sh@208 -- # killprocess 4077678 00:19:33.632 20:36:51 -- common/autotest_common.sh@926 -- # '[' -z 4077678 ']' 00:19:33.632 20:36:51 -- common/autotest_common.sh@930 -- # kill -0 4077678 00:19:33.632 20:36:51 -- common/autotest_common.sh@931 -- # uname 00:19:33.632 20:36:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:33.632 20:36:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4077678 00:19:33.894 20:36:52 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:19:33.894 20:36:52 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:19:33.894 20:36:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4077678' 00:19:33.894 killing process with pid 4077678 00:19:33.894 20:36:52 -- common/autotest_common.sh@945 -- # kill 4077678 00:19:33.894 Received shutdown signal, test time was about 10.000000 seconds 00:19:33.894 00:19:33.894 Latency(us) 00:19:33.894 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:33.894 =================================================================================================================== 00:19:33.894 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:33.894 20:36:52 -- common/autotest_common.sh@950 -- # wait 4077678 00:19:33.894 20:36:52 -- target/tls.sh@209 -- # killprocess 4077309 00:19:33.894 20:36:52 -- common/autotest_common.sh@926 -- # '[' -z 4077309 ']' 00:19:33.894 20:36:52 -- common/autotest_common.sh@930 -- # kill -0 4077309 00:19:33.894 20:36:52 -- common/autotest_common.sh@931 -- # uname 00:19:33.894 20:36:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:33.894 20:36:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4077309 00:19:33.894 20:36:52 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:19:33.894 20:36:52 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:19:33.894 20:36:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4077309' 00:19:33.894 killing process with pid 4077309 00:19:33.894 20:36:52 -- common/autotest_common.sh@945 -- # kill 4077309 00:19:33.894 20:36:52 -- common/autotest_common.sh@950 -- # wait 4077309 00:19:34.157 20:36:52 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:19:34.157 20:36:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:34.157 20:36:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:34.157 20:36:52 -- common/autotest_common.sh@10 -- # set +x 00:19:34.157 20:36:52 -- target/tls.sh@212 -- # echo '{ 00:19:34.157 "subsystems": [ 00:19:34.157 { 00:19:34.157 "subsystem": "iobuf", 00:19:34.157 "config": [ 00:19:34.157 { 00:19:34.157 "method": "iobuf_set_options", 00:19:34.157 "params": { 00:19:34.157 "small_pool_count": 8192, 00:19:34.157 "large_pool_count": 1024, 00:19:34.157 "small_bufsize": 8192, 00:19:34.157 "large_bufsize": 135168 00:19:34.157 } 00:19:34.157 } 00:19:34.157 ] 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "subsystem": "sock", 00:19:34.157 "config": [ 00:19:34.157 { 00:19:34.157 "method": "sock_impl_set_options", 00:19:34.157 "params": { 00:19:34.157 "impl_name": "posix", 00:19:34.157 "recv_buf_size": 2097152, 00:19:34.157 "send_buf_size": 2097152, 00:19:34.157 "enable_recv_pipe": true, 00:19:34.157 "enable_quickack": false, 00:19:34.157 "enable_placement_id": 0, 00:19:34.157 "enable_zerocopy_send_server": true, 00:19:34.157 "enable_zerocopy_send_client": false, 00:19:34.157 "zerocopy_threshold": 0, 00:19:34.157 "tls_version": 0, 00:19:34.157 "enable_ktls": false 00:19:34.157 } 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "method": "sock_impl_set_options", 00:19:34.157 "params": { 00:19:34.157 "impl_name": "ssl", 00:19:34.157 "recv_buf_size": 4096, 00:19:34.157 "send_buf_size": 4096, 00:19:34.157 "enable_recv_pipe": true, 00:19:34.157 "enable_quickack": false, 00:19:34.157 "enable_placement_id": 0, 00:19:34.157 "enable_zerocopy_send_server": true, 00:19:34.157 "enable_zerocopy_send_client": false, 00:19:34.157 "zerocopy_threshold": 0, 00:19:34.157 "tls_version": 0, 00:19:34.157 "enable_ktls": false 00:19:34.157 } 00:19:34.157 } 00:19:34.157 ] 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "subsystem": "vmd", 00:19:34.157 "config": [] 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "subsystem": "accel", 00:19:34.157 "config": [ 00:19:34.157 { 00:19:34.157 "method": "accel_set_options", 00:19:34.157 "params": { 00:19:34.157 "small_cache_size": 128, 00:19:34.157 "large_cache_size": 16, 00:19:34.157 "task_count": 2048, 00:19:34.157 "sequence_count": 2048, 00:19:34.157 "buf_count": 2048 00:19:34.157 } 00:19:34.157 } 00:19:34.157 ] 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "subsystem": "bdev", 00:19:34.157 "config": [ 00:19:34.157 { 00:19:34.157 "method": "bdev_set_options", 00:19:34.157 "params": { 00:19:34.157 "bdev_io_pool_size": 65535, 00:19:34.157 "bdev_io_cache_size": 256, 00:19:34.157 "bdev_auto_examine": true, 00:19:34.157 "iobuf_small_cache_size": 128, 00:19:34.157 "iobuf_large_cache_size": 16 00:19:34.157 } 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "method": "bdev_raid_set_options", 00:19:34.157 "params": { 00:19:34.157 "process_window_size_kb": 1024 00:19:34.157 } 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "method": "bdev_iscsi_set_options", 00:19:34.157 "params": { 00:19:34.157 "timeout_sec": 30 00:19:34.157 } 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "method": "bdev_nvme_set_options", 00:19:34.157 "params": { 00:19:34.157 "action_on_timeout": "none", 00:19:34.157 "timeout_us": 0, 00:19:34.157 "timeout_admin_us": 0, 00:19:34.157 "keep_alive_timeout_ms": 10000, 00:19:34.157 "transport_retry_count": 4, 00:19:34.157 "arbitration_burst": 0, 00:19:34.157 "low_priority_weight": 0, 00:19:34.157 "medium_priority_weight": 0, 00:19:34.157 "high_priority_weight": 0, 00:19:34.157 "nvme_adminq_poll_period_us": 10000, 00:19:34.157 "nvme_ioq_poll_period_us": 0, 00:19:34.157 "io_queue_requests": 0, 00:19:34.157 "delay_cmd_submit": true, 00:19:34.157 "bdev_retry_count": 3, 00:19:34.157 "transport_ack_timeout": 0, 00:19:34.157 "ctrlr_loss_timeout_sec": 0, 00:19:34.157 "reconnect_delay_sec": 0, 00:19:34.157 "fast_io_fail_timeout_sec": 0, 00:19:34.157 "generate_uuids": false, 00:19:34.157 "transport_tos": 0, 00:19:34.157 "io_path_stat": false, 00:19:34.157 "allow_accel_sequence": false 00:19:34.157 } 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "method": "bdev_nvme_set_hotplug", 00:19:34.157 "params": { 00:19:34.157 "period_us": 100000, 00:19:34.157 "enable": false 00:19:34.157 } 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "method": "bdev_malloc_create", 00:19:34.157 "params": { 00:19:34.157 "name": "malloc0", 00:19:34.157 "num_blocks": 8192, 00:19:34.157 "block_size": 4096, 00:19:34.157 "physical_block_size": 4096, 00:19:34.157 "uuid": "a929da65-ab39-49e2-b323-43677c54a38e", 00:19:34.157 "optimal_io_boundary": 0 00:19:34.157 } 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "method": "bdev_wait_for_examine" 00:19:34.157 } 00:19:34.157 ] 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "subsystem": "nbd", 00:19:34.157 "config": [] 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "subsystem": "scheduler", 00:19:34.157 "config": [ 00:19:34.157 { 00:19:34.157 "method": "framework_set_scheduler", 00:19:34.157 "params": { 00:19:34.157 "name": "static" 00:19:34.157 } 00:19:34.157 } 00:19:34.157 ] 00:19:34.157 }, 00:19:34.157 { 00:19:34.157 "subsystem": "nvmf", 00:19:34.157 "config": [ 00:19:34.157 { 00:19:34.157 "method": "nvmf_set_config", 00:19:34.157 "params": { 00:19:34.158 "discovery_filter": "match_any", 00:19:34.158 "admin_cmd_passthru": { 00:19:34.158 "identify_ctrlr": false 00:19:34.158 } 00:19:34.158 } 00:19:34.158 }, 00:19:34.158 { 00:19:34.158 "method": "nvmf_set_max_subsystems", 00:19:34.158 "params": { 00:19:34.158 "max_subsystems": 1024 00:19:34.158 } 00:19:34.158 }, 00:19:34.158 { 00:19:34.158 "method": "nvmf_set_crdt", 00:19:34.158 "params": { 00:19:34.158 "crdt1": 0, 00:19:34.158 "crdt2": 0, 00:19:34.158 "crdt3": 0 00:19:34.158 } 00:19:34.158 }, 00:19:34.158 { 00:19:34.158 "method": "nvmf_create_transport", 00:19:34.158 "params": { 00:19:34.158 "trtype": "TCP", 00:19:34.158 "max_queue_depth": 128, 00:19:34.158 "max_io_qpairs_per_ctrlr": 127, 00:19:34.158 "in_capsule_data_size": 4096, 00:19:34.158 "max_io_size": 131072, 00:19:34.158 "io_unit_size": 131072, 00:19:34.158 "max_aq_depth": 128, 00:19:34.158 "num_shared_buffers": 511, 00:19:34.158 "buf_cache_size": 4294967295, 00:19:34.158 "dif_insert_or_strip": false, 00:19:34.158 "zcopy": false, 00:19:34.158 "c2h_success": false, 00:19:34.158 "sock_priority": 0, 00:19:34.158 "abort_timeout_sec": 1 00:19:34.158 } 00:19:34.158 }, 00:19:34.158 { 00:19:34.158 "method": "nvmf_create_subsystem", 00:19:34.158 "params": { 00:19:34.158 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:34.158 "allow_any_host": false, 00:19:34.158 "serial_number": "SPDK00000000000001", 00:19:34.158 "model_number": "SPDK bdev Controller", 00:19:34.158 "max_namespaces": 10, 00:19:34.158 "min_cntlid": 1, 00:19:34.158 "max_cntlid": 65519, 00:19:34.158 "ana_reporting": false 00:19:34.158 } 00:19:34.158 }, 00:19:34.158 { 00:19:34.158 "method": "nvmf_subsystem_add_host", 00:19:34.158 "params": { 00:19:34.158 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:34.158 "host": "nqn.2016-06.io.spdk:host1", 00:19:34.158 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:19:34.158 } 00:19:34.158 }, 00:19:34.158 { 00:19:34.158 "method": "nvmf_subsystem_add_ns", 00:19:34.158 "params": { 00:19:34.158 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:34.158 "namespace": { 00:19:34.158 "nsid": 1, 00:19:34.158 "bdev_name": "malloc0", 00:19:34.158 "nguid": "A929DA65AB3949E2B32343677C54A38E", 00:19:34.158 "uuid": "a929da65-ab39-49e2-b323-43677c54a38e" 00:19:34.158 } 00:19:34.158 } 00:19:34.158 }, 00:19:34.158 { 00:19:34.158 "method": "nvmf_subsystem_add_listener", 00:19:34.158 "params": { 00:19:34.158 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:34.158 "listen_address": { 00:19:34.158 "trtype": "TCP", 00:19:34.158 "adrfam": "IPv4", 00:19:34.158 "traddr": "10.0.0.2", 00:19:34.158 "trsvcid": "4420" 00:19:34.158 }, 00:19:34.158 "secure_channel": true 00:19:34.158 } 00:19:34.158 } 00:19:34.158 ] 00:19:34.158 } 00:19:34.158 ] 00:19:34.158 }' 00:19:34.158 20:36:52 -- nvmf/common.sh@469 -- # nvmfpid=4078037 00:19:34.158 20:36:52 -- nvmf/common.sh@470 -- # waitforlisten 4078037 00:19:34.158 20:36:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:19:34.158 20:36:52 -- common/autotest_common.sh@819 -- # '[' -z 4078037 ']' 00:19:34.158 20:36:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:34.158 20:36:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:34.158 20:36:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:34.158 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:34.158 20:36:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:34.158 20:36:52 -- common/autotest_common.sh@10 -- # set +x 00:19:34.158 [2024-04-26 20:36:52.369318] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:34.158 [2024-04-26 20:36:52.369369] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:34.158 EAL: No free 2048 kB hugepages reported on node 1 00:19:34.158 [2024-04-26 20:36:52.433879] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:34.158 [2024-04-26 20:36:52.494316] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:34.158 [2024-04-26 20:36:52.494443] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:34.158 [2024-04-26 20:36:52.494453] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:34.158 [2024-04-26 20:36:52.494460] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:34.158 [2024-04-26 20:36:52.494485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:34.419 [2024-04-26 20:36:52.675807] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:34.419 [2024-04-26 20:36:52.707823] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:34.419 [2024-04-26 20:36:52.708042] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:34.992 20:36:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:34.992 20:36:53 -- common/autotest_common.sh@852 -- # return 0 00:19:34.992 20:36:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:34.992 20:36:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:34.992 20:36:53 -- common/autotest_common.sh@10 -- # set +x 00:19:34.992 20:36:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:34.992 20:36:53 -- target/tls.sh@216 -- # bdevperf_pid=4078383 00:19:34.992 20:36:53 -- target/tls.sh@217 -- # waitforlisten 4078383 /var/tmp/bdevperf.sock 00:19:34.992 20:36:53 -- common/autotest_common.sh@819 -- # '[' -z 4078383 ']' 00:19:34.992 20:36:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:34.992 20:36:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:34.992 20:36:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:34.992 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:34.992 20:36:53 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:19:34.992 20:36:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:34.992 20:36:53 -- common/autotest_common.sh@10 -- # set +x 00:19:34.992 20:36:53 -- target/tls.sh@213 -- # echo '{ 00:19:34.992 "subsystems": [ 00:19:34.992 { 00:19:34.992 "subsystem": "iobuf", 00:19:34.992 "config": [ 00:19:34.992 { 00:19:34.992 "method": "iobuf_set_options", 00:19:34.992 "params": { 00:19:34.992 "small_pool_count": 8192, 00:19:34.992 "large_pool_count": 1024, 00:19:34.992 "small_bufsize": 8192, 00:19:34.992 "large_bufsize": 135168 00:19:34.992 } 00:19:34.992 } 00:19:34.992 ] 00:19:34.992 }, 00:19:34.992 { 00:19:34.992 "subsystem": "sock", 00:19:34.992 "config": [ 00:19:34.992 { 00:19:34.992 "method": "sock_impl_set_options", 00:19:34.992 "params": { 00:19:34.992 "impl_name": "posix", 00:19:34.992 "recv_buf_size": 2097152, 00:19:34.992 "send_buf_size": 2097152, 00:19:34.993 "enable_recv_pipe": true, 00:19:34.993 "enable_quickack": false, 00:19:34.993 "enable_placement_id": 0, 00:19:34.993 "enable_zerocopy_send_server": true, 00:19:34.993 "enable_zerocopy_send_client": false, 00:19:34.993 "zerocopy_threshold": 0, 00:19:34.993 "tls_version": 0, 00:19:34.993 "enable_ktls": false 00:19:34.993 } 00:19:34.993 }, 00:19:34.993 { 00:19:34.993 "method": "sock_impl_set_options", 00:19:34.993 "params": { 00:19:34.993 "impl_name": "ssl", 00:19:34.993 "recv_buf_size": 4096, 00:19:34.993 "send_buf_size": 4096, 00:19:34.993 "enable_recv_pipe": true, 00:19:34.993 "enable_quickack": false, 00:19:34.993 "enable_placement_id": 0, 00:19:34.993 "enable_zerocopy_send_server": true, 00:19:34.993 "enable_zerocopy_send_client": false, 00:19:34.993 "zerocopy_threshold": 0, 00:19:34.993 "tls_version": 0, 00:19:34.993 "enable_ktls": false 00:19:34.993 } 00:19:34.993 } 00:19:34.993 ] 00:19:34.993 }, 00:19:34.993 { 00:19:34.993 "subsystem": "vmd", 00:19:34.993 "config": [] 00:19:34.993 }, 00:19:34.993 { 00:19:34.993 "subsystem": "accel", 00:19:34.993 "config": [ 00:19:34.993 { 00:19:34.993 "method": "accel_set_options", 00:19:34.993 "params": { 00:19:34.993 "small_cache_size": 128, 00:19:34.993 "large_cache_size": 16, 00:19:34.993 "task_count": 2048, 00:19:34.993 "sequence_count": 2048, 00:19:34.993 "buf_count": 2048 00:19:34.993 } 00:19:34.993 } 00:19:34.993 ] 00:19:34.993 }, 00:19:34.993 { 00:19:34.993 "subsystem": "bdev", 00:19:34.993 "config": [ 00:19:34.993 { 00:19:34.993 "method": "bdev_set_options", 00:19:34.993 "params": { 00:19:34.993 "bdev_io_pool_size": 65535, 00:19:34.993 "bdev_io_cache_size": 256, 00:19:34.993 "bdev_auto_examine": true, 00:19:34.993 "iobuf_small_cache_size": 128, 00:19:34.993 "iobuf_large_cache_size": 16 00:19:34.993 } 00:19:34.993 }, 00:19:34.993 { 00:19:34.993 "method": "bdev_raid_set_options", 00:19:34.993 "params": { 00:19:34.993 "process_window_size_kb": 1024 00:19:34.993 } 00:19:34.993 }, 00:19:34.993 { 00:19:34.993 "method": "bdev_iscsi_set_options", 00:19:34.993 "params": { 00:19:34.993 "timeout_sec": 30 00:19:34.993 } 00:19:34.993 }, 00:19:34.993 { 00:19:34.993 "method": "bdev_nvme_set_options", 00:19:34.993 "params": { 00:19:34.993 "action_on_timeout": "none", 00:19:34.993 "timeout_us": 0, 00:19:34.993 "timeout_admin_us": 0, 00:19:34.993 "keep_alive_timeout_ms": 10000, 00:19:34.993 "transport_retry_count": 4, 00:19:34.993 "arbitration_burst": 0, 00:19:34.993 "low_priority_weight": 0, 00:19:34.993 "medium_priority_weight": 0, 00:19:34.993 "high_priority_weight": 0, 00:19:34.993 "nvme_adminq_poll_period_us": 10000, 00:19:34.993 "nvme_ioq_poll_period_us": 0, 00:19:34.993 "io_queue_requests": 512, 00:19:34.993 "delay_cmd_submit": true, 00:19:34.993 "bdev_retry_count": 3, 00:19:34.993 "transport_ack_timeout": 0, 00:19:34.993 "ctrlr_loss_timeout_sec": 0, 00:19:34.993 "reconnect_delay_sec": 0, 00:19:34.993 "fast_io_fail_timeout_sec": 0, 00:19:34.993 "generate_uuids": false, 00:19:34.993 "transport_tos": 0, 00:19:34.993 "io_path_stat": false, 00:19:34.993 "allow_accel_sequence": false 00:19:34.993 } 00:19:34.993 }, 00:19:34.993 { 00:19:34.993 "method": "bdev_nvme_attach_controller", 00:19:34.993 "params": { 00:19:34.993 "name": "TLSTEST", 00:19:34.993 "trtype": "TCP", 00:19:34.993 "adrfam": "IPv4", 00:19:34.993 "traddr": "10.0.0.2", 00:19:34.993 "trsvcid": "4420", 00:19:34.993 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:34.993 "prchk_reftag": false, 00:19:34.993 "prchk_guard": false, 00:19:34.993 "ctrlr_loss_timeout_sec": 0, 00:19:34.993 "reconnect_delay_sec": 0, 00:19:34.993 "fast_io_fail_timeout_sec": 0, 00:19:34.993 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:19:34.993 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:34.993 "hdgst": false, 00:19:34.993 "ddgst": false 00:19:34.993 } 00:19:34.993 }, 00:19:34.993 { 00:19:34.993 "method": "bdev_nvme_set_hotplug", 00:19:34.993 "params": { 00:19:34.993 "period_us": 100000, 00:19:34.993 "enable": false 00:19:34.993 } 00:19:34.993 }, 00:19:34.993 { 00:19:34.993 "method": "bdev_wait_for_examine" 00:19:34.993 } 00:19:34.993 ] 00:19:34.993 }, 00:19:34.993 { 00:19:34.993 "subsystem": "nbd", 00:19:34.993 "config": [] 00:19:34.993 } 00:19:34.993 ] 00:19:34.993 }' 00:19:34.993 [2024-04-26 20:36:53.208301] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:34.993 [2024-04-26 20:36:53.208354] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4078383 ] 00:19:34.993 EAL: No free 2048 kB hugepages reported on node 1 00:19:34.993 [2024-04-26 20:36:53.260801] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:34.993 [2024-04-26 20:36:53.311070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:35.255 [2024-04-26 20:36:53.426839] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:35.827 20:36:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:35.827 20:36:53 -- common/autotest_common.sh@852 -- # return 0 00:19:35.827 20:36:53 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:19:35.827 Running I/O for 10 seconds... 00:19:45.831 00:19:45.831 Latency(us) 00:19:45.831 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:45.831 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:19:45.831 Verification LBA range: start 0x0 length 0x2000 00:19:45.831 TLSTESTn1 : 10.07 1583.58 6.19 0.00 0.00 80653.54 10048.85 88692.05 00:19:45.831 =================================================================================================================== 00:19:45.831 Total : 1583.58 6.19 0.00 0.00 80653.54 10048.85 88692.05 00:19:45.831 0 00:19:45.831 20:37:04 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:19:45.831 20:37:04 -- target/tls.sh@223 -- # killprocess 4078383 00:19:45.831 20:37:04 -- common/autotest_common.sh@926 -- # '[' -z 4078383 ']' 00:19:45.831 20:37:04 -- common/autotest_common.sh@930 -- # kill -0 4078383 00:19:45.831 20:37:04 -- common/autotest_common.sh@931 -- # uname 00:19:45.831 20:37:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:45.831 20:37:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4078383 00:19:46.093 20:37:04 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:19:46.093 20:37:04 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:19:46.093 20:37:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4078383' 00:19:46.093 killing process with pid 4078383 00:19:46.093 20:37:04 -- common/autotest_common.sh@945 -- # kill 4078383 00:19:46.093 Received shutdown signal, test time was about 10.000000 seconds 00:19:46.093 00:19:46.093 Latency(us) 00:19:46.093 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:46.093 =================================================================================================================== 00:19:46.093 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:46.093 20:37:04 -- common/autotest_common.sh@950 -- # wait 4078383 00:19:46.093 20:37:04 -- target/tls.sh@224 -- # killprocess 4078037 00:19:46.093 20:37:04 -- common/autotest_common.sh@926 -- # '[' -z 4078037 ']' 00:19:46.093 20:37:04 -- common/autotest_common.sh@930 -- # kill -0 4078037 00:19:46.093 20:37:04 -- common/autotest_common.sh@931 -- # uname 00:19:46.093 20:37:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:46.093 20:37:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4078037 00:19:46.093 20:37:04 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:19:46.093 20:37:04 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:19:46.093 20:37:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4078037' 00:19:46.093 killing process with pid 4078037 00:19:46.093 20:37:04 -- common/autotest_common.sh@945 -- # kill 4078037 00:19:46.093 20:37:04 -- common/autotest_common.sh@950 -- # wait 4078037 00:19:46.355 20:37:04 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:19:46.355 20:37:04 -- target/tls.sh@227 -- # cleanup 00:19:46.355 20:37:04 -- target/tls.sh@15 -- # process_shm --id 0 00:19:46.355 20:37:04 -- common/autotest_common.sh@796 -- # type=--id 00:19:46.355 20:37:04 -- common/autotest_common.sh@797 -- # id=0 00:19:46.355 20:37:04 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:19:46.355 20:37:04 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:19:46.355 20:37:04 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:19:46.355 20:37:04 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:19:46.355 20:37:04 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:19:46.355 20:37:04 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:19:46.355 nvmf_trace.0 00:19:46.355 20:37:04 -- common/autotest_common.sh@811 -- # return 0 00:19:46.355 20:37:04 -- target/tls.sh@16 -- # killprocess 4078383 00:19:46.355 20:37:04 -- common/autotest_common.sh@926 -- # '[' -z 4078383 ']' 00:19:46.355 20:37:04 -- common/autotest_common.sh@930 -- # kill -0 4078383 00:19:46.355 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (4078383) - No such process 00:19:46.355 20:37:04 -- common/autotest_common.sh@953 -- # echo 'Process with pid 4078383 is not found' 00:19:46.355 Process with pid 4078383 is not found 00:19:46.355 20:37:04 -- target/tls.sh@17 -- # nvmftestfini 00:19:46.355 20:37:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:46.355 20:37:04 -- nvmf/common.sh@116 -- # sync 00:19:46.355 20:37:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:46.355 20:37:04 -- nvmf/common.sh@119 -- # set +e 00:19:46.355 20:37:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:46.355 20:37:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:46.355 rmmod nvme_tcp 00:19:46.355 rmmod nvme_fabrics 00:19:46.355 rmmod nvme_keyring 00:19:46.355 20:37:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:46.355 20:37:04 -- nvmf/common.sh@123 -- # set -e 00:19:46.355 20:37:04 -- nvmf/common.sh@124 -- # return 0 00:19:46.355 20:37:04 -- nvmf/common.sh@477 -- # '[' -n 4078037 ']' 00:19:46.355 20:37:04 -- nvmf/common.sh@478 -- # killprocess 4078037 00:19:46.355 20:37:04 -- common/autotest_common.sh@926 -- # '[' -z 4078037 ']' 00:19:46.355 20:37:04 -- common/autotest_common.sh@930 -- # kill -0 4078037 00:19:46.355 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (4078037) - No such process 00:19:46.355 20:37:04 -- common/autotest_common.sh@953 -- # echo 'Process with pid 4078037 is not found' 00:19:46.355 Process with pid 4078037 is not found 00:19:46.355 20:37:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:46.355 20:37:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:46.355 20:37:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:46.355 20:37:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:46.355 20:37:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:46.355 20:37:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:46.355 20:37:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:46.355 20:37:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:48.900 20:37:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:48.900 20:37:06 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:48.900 00:19:48.900 real 1m11.380s 00:19:48.900 user 1m42.777s 00:19:48.900 sys 0m27.944s 00:19:48.900 20:37:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:48.900 20:37:06 -- common/autotest_common.sh@10 -- # set +x 00:19:48.900 ************************************ 00:19:48.900 END TEST nvmf_tls 00:19:48.900 ************************************ 00:19:48.900 20:37:06 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:19:48.900 20:37:06 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:48.900 20:37:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:48.900 20:37:06 -- common/autotest_common.sh@10 -- # set +x 00:19:48.900 ************************************ 00:19:48.900 START TEST nvmf_fips 00:19:48.900 ************************************ 00:19:48.900 20:37:06 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:19:48.900 * Looking for test storage... 00:19:48.900 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:19:48.900 20:37:06 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:48.900 20:37:06 -- nvmf/common.sh@7 -- # uname -s 00:19:48.900 20:37:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:48.900 20:37:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:48.900 20:37:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:48.900 20:37:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:48.900 20:37:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:48.900 20:37:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:48.900 20:37:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:48.900 20:37:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:48.900 20:37:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:48.900 20:37:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:48.900 20:37:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:19:48.900 20:37:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:19:48.900 20:37:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:48.900 20:37:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:48.900 20:37:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:48.900 20:37:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:48.900 20:37:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:48.900 20:37:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:48.900 20:37:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:48.900 20:37:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.900 20:37:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.901 20:37:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.901 20:37:06 -- paths/export.sh@5 -- # export PATH 00:19:48.901 20:37:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.901 20:37:06 -- nvmf/common.sh@46 -- # : 0 00:19:48.901 20:37:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:48.901 20:37:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:48.901 20:37:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:48.901 20:37:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:48.901 20:37:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:48.901 20:37:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:48.901 20:37:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:48.901 20:37:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:48.901 20:37:06 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:48.901 20:37:06 -- fips/fips.sh@89 -- # check_openssl_version 00:19:48.901 20:37:06 -- fips/fips.sh@83 -- # local target=3.0.0 00:19:48.901 20:37:06 -- fips/fips.sh@85 -- # openssl version 00:19:48.901 20:37:06 -- fips/fips.sh@85 -- # awk '{print $2}' 00:19:48.901 20:37:06 -- fips/fips.sh@85 -- # ge 3.0.9 3.0.0 00:19:48.901 20:37:06 -- scripts/common.sh@375 -- # cmp_versions 3.0.9 '>=' 3.0.0 00:19:48.901 20:37:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:48.901 20:37:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:48.901 20:37:06 -- scripts/common.sh@335 -- # IFS=.-: 00:19:48.901 20:37:06 -- scripts/common.sh@335 -- # read -ra ver1 00:19:48.901 20:37:06 -- scripts/common.sh@336 -- # IFS=.-: 00:19:48.901 20:37:06 -- scripts/common.sh@336 -- # read -ra ver2 00:19:48.901 20:37:06 -- scripts/common.sh@337 -- # local 'op=>=' 00:19:48.901 20:37:06 -- scripts/common.sh@339 -- # ver1_l=3 00:19:48.901 20:37:06 -- scripts/common.sh@340 -- # ver2_l=3 00:19:48.901 20:37:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:48.901 20:37:06 -- scripts/common.sh@343 -- # case "$op" in 00:19:48.901 20:37:06 -- scripts/common.sh@347 -- # : 1 00:19:48.901 20:37:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:48.901 20:37:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:48.901 20:37:06 -- scripts/common.sh@364 -- # decimal 3 00:19:48.901 20:37:06 -- scripts/common.sh@352 -- # local d=3 00:19:48.901 20:37:06 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:19:48.901 20:37:06 -- scripts/common.sh@354 -- # echo 3 00:19:48.901 20:37:06 -- scripts/common.sh@364 -- # ver1[v]=3 00:19:48.901 20:37:06 -- scripts/common.sh@365 -- # decimal 3 00:19:48.901 20:37:06 -- scripts/common.sh@352 -- # local d=3 00:19:48.901 20:37:06 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:19:48.901 20:37:06 -- scripts/common.sh@354 -- # echo 3 00:19:48.901 20:37:06 -- scripts/common.sh@365 -- # ver2[v]=3 00:19:48.901 20:37:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:48.901 20:37:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:48.901 20:37:06 -- scripts/common.sh@363 -- # (( v++ )) 00:19:48.901 20:37:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:48.901 20:37:06 -- scripts/common.sh@364 -- # decimal 0 00:19:48.901 20:37:06 -- scripts/common.sh@352 -- # local d=0 00:19:48.901 20:37:06 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:19:48.901 20:37:06 -- scripts/common.sh@354 -- # echo 0 00:19:48.901 20:37:06 -- scripts/common.sh@364 -- # ver1[v]=0 00:19:48.901 20:37:06 -- scripts/common.sh@365 -- # decimal 0 00:19:48.901 20:37:06 -- scripts/common.sh@352 -- # local d=0 00:19:48.901 20:37:06 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:19:48.901 20:37:06 -- scripts/common.sh@354 -- # echo 0 00:19:48.901 20:37:06 -- scripts/common.sh@365 -- # ver2[v]=0 00:19:48.901 20:37:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:48.901 20:37:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:48.901 20:37:06 -- scripts/common.sh@363 -- # (( v++ )) 00:19:48.901 20:37:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:48.901 20:37:06 -- scripts/common.sh@364 -- # decimal 9 00:19:48.901 20:37:06 -- scripts/common.sh@352 -- # local d=9 00:19:48.901 20:37:06 -- scripts/common.sh@353 -- # [[ 9 =~ ^[0-9]+$ ]] 00:19:48.901 20:37:06 -- scripts/common.sh@354 -- # echo 9 00:19:48.901 20:37:06 -- scripts/common.sh@364 -- # ver1[v]=9 00:19:48.901 20:37:06 -- scripts/common.sh@365 -- # decimal 0 00:19:48.901 20:37:06 -- scripts/common.sh@352 -- # local d=0 00:19:48.901 20:37:06 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:19:48.901 20:37:06 -- scripts/common.sh@354 -- # echo 0 00:19:48.901 20:37:06 -- scripts/common.sh@365 -- # ver2[v]=0 00:19:48.901 20:37:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:48.901 20:37:06 -- scripts/common.sh@366 -- # return 0 00:19:48.901 20:37:06 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:19:48.901 20:37:06 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:19:48.901 20:37:06 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:19:48.901 20:37:06 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:19:48.901 20:37:06 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:19:48.901 20:37:06 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:19:48.901 20:37:06 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:19:48.901 20:37:06 -- fips/fips.sh@105 -- # export OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:19:48.901 20:37:06 -- fips/fips.sh@105 -- # OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:19:48.901 20:37:06 -- fips/fips.sh@114 -- # build_openssl_config 00:19:48.901 20:37:06 -- fips/fips.sh@37 -- # cat 00:19:48.901 20:37:06 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:19:48.901 20:37:06 -- fips/fips.sh@58 -- # cat - 00:19:48.901 20:37:06 -- fips/fips.sh@115 -- # export OPENSSL_CONF=spdk_fips.conf 00:19:48.901 20:37:06 -- fips/fips.sh@115 -- # OPENSSL_CONF=spdk_fips.conf 00:19:48.901 20:37:06 -- fips/fips.sh@117 -- # mapfile -t providers 00:19:48.901 20:37:06 -- fips/fips.sh@117 -- # OPENSSL_CONF=spdk_fips.conf 00:19:48.901 20:37:06 -- fips/fips.sh@117 -- # openssl list -providers 00:19:48.901 20:37:06 -- fips/fips.sh@117 -- # grep name 00:19:48.901 20:37:06 -- fips/fips.sh@121 -- # (( 2 != 2 )) 00:19:48.901 20:37:06 -- fips/fips.sh@121 -- # [[ name: openssl base provider != *base* ]] 00:19:48.901 20:37:06 -- fips/fips.sh@121 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:19:48.901 20:37:06 -- fips/fips.sh@128 -- # NOT openssl md5 /dev/fd/62 00:19:48.901 20:37:06 -- common/autotest_common.sh@640 -- # local es=0 00:19:48.901 20:37:06 -- common/autotest_common.sh@642 -- # valid_exec_arg openssl md5 /dev/fd/62 00:19:48.901 20:37:06 -- common/autotest_common.sh@628 -- # local arg=openssl 00:19:48.901 20:37:06 -- fips/fips.sh@128 -- # : 00:19:48.901 20:37:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:48.901 20:37:06 -- common/autotest_common.sh@632 -- # type -t openssl 00:19:48.901 20:37:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:48.901 20:37:06 -- common/autotest_common.sh@634 -- # type -P openssl 00:19:48.901 20:37:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:19:48.901 20:37:06 -- common/autotest_common.sh@634 -- # arg=/usr/bin/openssl 00:19:48.901 20:37:06 -- common/autotest_common.sh@634 -- # [[ -x /usr/bin/openssl ]] 00:19:48.901 20:37:06 -- common/autotest_common.sh@643 -- # openssl md5 /dev/fd/62 00:19:48.901 Error setting digest 00:19:48.901 002243B8D67F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:373:Global default library context, Algorithm (MD5 : 97), Properties () 00:19:48.901 002243B8D67F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:254: 00:19:48.901 20:37:07 -- common/autotest_common.sh@643 -- # es=1 00:19:48.901 20:37:07 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:19:48.901 20:37:07 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:19:48.901 20:37:07 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:19:48.901 20:37:07 -- fips/fips.sh@131 -- # nvmftestinit 00:19:48.901 20:37:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:48.901 20:37:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:48.901 20:37:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:48.901 20:37:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:48.901 20:37:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:48.901 20:37:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:48.901 20:37:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:48.901 20:37:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:48.901 20:37:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:48.901 20:37:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:48.901 20:37:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:48.901 20:37:07 -- common/autotest_common.sh@10 -- # set +x 00:19:55.485 20:37:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:55.485 20:37:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:55.485 20:37:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:55.485 20:37:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:55.485 20:37:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:55.485 20:37:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:55.485 20:37:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:55.485 20:37:13 -- nvmf/common.sh@294 -- # net_devs=() 00:19:55.485 20:37:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:55.485 20:37:13 -- nvmf/common.sh@295 -- # e810=() 00:19:55.485 20:37:13 -- nvmf/common.sh@295 -- # local -ga e810 00:19:55.485 20:37:13 -- nvmf/common.sh@296 -- # x722=() 00:19:55.485 20:37:13 -- nvmf/common.sh@296 -- # local -ga x722 00:19:55.485 20:37:13 -- nvmf/common.sh@297 -- # mlx=() 00:19:55.485 20:37:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:55.485 20:37:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:55.485 20:37:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:55.485 20:37:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:55.485 20:37:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:55.485 20:37:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:55.485 20:37:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:55.485 20:37:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:55.485 20:37:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:55.485 20:37:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:55.485 20:37:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:55.485 20:37:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:55.485 20:37:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:55.485 20:37:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:55.485 20:37:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:55.485 20:37:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:55.485 20:37:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:19:55.485 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:19:55.485 20:37:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:55.485 20:37:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:19:55.485 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:19:55.485 20:37:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:55.485 20:37:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:55.485 20:37:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:55.486 20:37:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:55.486 20:37:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:55.486 20:37:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:55.486 20:37:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:55.486 20:37:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:19:55.486 Found net devices under 0000:4b:00.0: cvl_0_0 00:19:55.486 20:37:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:55.486 20:37:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:55.486 20:37:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:55.486 20:37:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:55.486 20:37:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:55.486 20:37:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:19:55.486 Found net devices under 0000:4b:00.1: cvl_0_1 00:19:55.486 20:37:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:55.486 20:37:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:55.486 20:37:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:55.486 20:37:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:55.486 20:37:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:55.486 20:37:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:55.486 20:37:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:55.486 20:37:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:55.486 20:37:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:55.486 20:37:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:55.486 20:37:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:55.486 20:37:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:55.486 20:37:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:55.486 20:37:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:55.486 20:37:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:55.486 20:37:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:55.486 20:37:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:55.486 20:37:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:55.486 20:37:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:55.486 20:37:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:55.486 20:37:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:55.486 20:37:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:55.486 20:37:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:55.486 20:37:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:55.486 20:37:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:55.486 20:37:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:55.486 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:55.486 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.688 ms 00:19:55.486 00:19:55.486 --- 10.0.0.2 ping statistics --- 00:19:55.486 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:55.486 rtt min/avg/max/mdev = 0.688/0.688/0.688/0.000 ms 00:19:55.486 20:37:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:55.486 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:55.486 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.420 ms 00:19:55.486 00:19:55.486 --- 10.0.0.1 ping statistics --- 00:19:55.486 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:55.486 rtt min/avg/max/mdev = 0.420/0.420/0.420/0.000 ms 00:19:55.486 20:37:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:55.486 20:37:13 -- nvmf/common.sh@410 -- # return 0 00:19:55.486 20:37:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:55.486 20:37:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:55.486 20:37:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:55.486 20:37:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:55.486 20:37:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:55.486 20:37:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:55.486 20:37:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:55.486 20:37:13 -- fips/fips.sh@132 -- # nvmfappstart -m 0x2 00:19:55.486 20:37:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:55.486 20:37:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:55.486 20:37:13 -- common/autotest_common.sh@10 -- # set +x 00:19:55.486 20:37:13 -- nvmf/common.sh@469 -- # nvmfpid=4084788 00:19:55.486 20:37:13 -- nvmf/common.sh@470 -- # waitforlisten 4084788 00:19:55.486 20:37:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:55.486 20:37:13 -- common/autotest_common.sh@819 -- # '[' -z 4084788 ']' 00:19:55.486 20:37:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:55.486 20:37:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:55.486 20:37:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:55.486 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:55.486 20:37:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:55.486 20:37:13 -- common/autotest_common.sh@10 -- # set +x 00:19:55.747 [2024-04-26 20:37:13.871691] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:55.747 [2024-04-26 20:37:13.871762] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:55.747 EAL: No free 2048 kB hugepages reported on node 1 00:19:55.747 [2024-04-26 20:37:13.941716] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:55.747 [2024-04-26 20:37:14.011947] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:55.747 [2024-04-26 20:37:14.012068] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:55.747 [2024-04-26 20:37:14.012076] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:55.747 [2024-04-26 20:37:14.012083] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:55.747 [2024-04-26 20:37:14.012099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:56.316 20:37:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:56.316 20:37:14 -- common/autotest_common.sh@852 -- # return 0 00:19:56.316 20:37:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:56.316 20:37:14 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:56.316 20:37:14 -- common/autotest_common.sh@10 -- # set +x 00:19:56.316 20:37:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:56.316 20:37:14 -- fips/fips.sh@134 -- # trap cleanup EXIT 00:19:56.317 20:37:14 -- fips/fips.sh@137 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:19:56.317 20:37:14 -- fips/fips.sh@138 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:19:56.317 20:37:14 -- fips/fips.sh@139 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:19:56.317 20:37:14 -- fips/fips.sh@140 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:19:56.578 20:37:14 -- fips/fips.sh@142 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:19:56.578 20:37:14 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:19:56.578 20:37:14 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:56.578 [2024-04-26 20:37:14.799015] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:56.578 [2024-04-26 20:37:14.815018] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:56.578 [2024-04-26 20:37:14.815207] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:56.578 malloc0 00:19:56.578 20:37:14 -- fips/fips.sh@145 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:56.578 20:37:14 -- fips/fips.sh@148 -- # bdevperf_pid=4084849 00:19:56.578 20:37:14 -- fips/fips.sh@149 -- # waitforlisten 4084849 /var/tmp/bdevperf.sock 00:19:56.578 20:37:14 -- fips/fips.sh@146 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:56.578 20:37:14 -- common/autotest_common.sh@819 -- # '[' -z 4084849 ']' 00:19:56.578 20:37:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:56.578 20:37:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:56.578 20:37:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:56.578 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:56.578 20:37:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:56.578 20:37:14 -- common/autotest_common.sh@10 -- # set +x 00:19:56.839 [2024-04-26 20:37:14.932326] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:19:56.839 [2024-04-26 20:37:14.932379] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4084849 ] 00:19:56.839 EAL: No free 2048 kB hugepages reported on node 1 00:19:56.839 [2024-04-26 20:37:14.981467] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:56.839 [2024-04-26 20:37:15.033118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:57.411 20:37:15 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:57.411 20:37:15 -- common/autotest_common.sh@852 -- # return 0 00:19:57.412 20:37:15 -- fips/fips.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:19:57.673 [2024-04-26 20:37:15.821949] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:57.673 TLSTESTn1 00:19:57.673 20:37:15 -- fips/fips.sh@155 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:19:57.673 Running I/O for 10 seconds... 00:20:09.912 00:20:09.912 Latency(us) 00:20:09.912 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:09.912 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:09.912 Verification LBA range: start 0x0 length 0x2000 00:20:09.912 TLSTESTn1 : 10.05 1594.58 6.23 0.00 0.00 80098.23 5734.40 82138.45 00:20:09.912 =================================================================================================================== 00:20:09.912 Total : 1594.58 6.23 0.00 0.00 80098.23 5734.40 82138.45 00:20:09.912 0 00:20:09.912 20:37:26 -- fips/fips.sh@1 -- # cleanup 00:20:09.912 20:37:26 -- fips/fips.sh@15 -- # process_shm --id 0 00:20:09.912 20:37:26 -- common/autotest_common.sh@796 -- # type=--id 00:20:09.912 20:37:26 -- common/autotest_common.sh@797 -- # id=0 00:20:09.912 20:37:26 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:20:09.912 20:37:26 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:20:09.912 20:37:26 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:20:09.912 20:37:26 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:20:09.912 20:37:26 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:20:09.912 20:37:26 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:20:09.912 nvmf_trace.0 00:20:09.912 20:37:26 -- common/autotest_common.sh@811 -- # return 0 00:20:09.912 20:37:26 -- fips/fips.sh@16 -- # killprocess 4084849 00:20:09.912 20:37:26 -- common/autotest_common.sh@926 -- # '[' -z 4084849 ']' 00:20:09.912 20:37:26 -- common/autotest_common.sh@930 -- # kill -0 4084849 00:20:09.912 20:37:26 -- common/autotest_common.sh@931 -- # uname 00:20:09.912 20:37:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:09.912 20:37:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4084849 00:20:09.912 20:37:26 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:09.912 20:37:26 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:09.912 20:37:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4084849' 00:20:09.912 killing process with pid 4084849 00:20:09.912 20:37:26 -- common/autotest_common.sh@945 -- # kill 4084849 00:20:09.912 Received shutdown signal, test time was about 10.000000 seconds 00:20:09.912 00:20:09.912 Latency(us) 00:20:09.912 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:09.912 =================================================================================================================== 00:20:09.912 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:09.912 20:37:26 -- common/autotest_common.sh@950 -- # wait 4084849 00:20:09.912 20:37:26 -- fips/fips.sh@17 -- # nvmftestfini 00:20:09.912 20:37:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:09.912 20:37:26 -- nvmf/common.sh@116 -- # sync 00:20:09.912 20:37:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:09.912 20:37:26 -- nvmf/common.sh@119 -- # set +e 00:20:09.912 20:37:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:09.912 20:37:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:09.912 rmmod nvme_tcp 00:20:09.912 rmmod nvme_fabrics 00:20:09.912 rmmod nvme_keyring 00:20:09.912 20:37:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:09.912 20:37:26 -- nvmf/common.sh@123 -- # set -e 00:20:09.912 20:37:26 -- nvmf/common.sh@124 -- # return 0 00:20:09.912 20:37:26 -- nvmf/common.sh@477 -- # '[' -n 4084788 ']' 00:20:09.912 20:37:26 -- nvmf/common.sh@478 -- # killprocess 4084788 00:20:09.912 20:37:26 -- common/autotest_common.sh@926 -- # '[' -z 4084788 ']' 00:20:09.912 20:37:26 -- common/autotest_common.sh@930 -- # kill -0 4084788 00:20:09.912 20:37:26 -- common/autotest_common.sh@931 -- # uname 00:20:09.912 20:37:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:09.912 20:37:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4084788 00:20:09.912 20:37:26 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:09.912 20:37:26 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:09.912 20:37:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4084788' 00:20:09.912 killing process with pid 4084788 00:20:09.912 20:37:26 -- common/autotest_common.sh@945 -- # kill 4084788 00:20:09.912 20:37:26 -- common/autotest_common.sh@950 -- # wait 4084788 00:20:09.912 20:37:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:09.912 20:37:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:09.912 20:37:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:09.912 20:37:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:09.912 20:37:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:09.912 20:37:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:09.912 20:37:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:09.912 20:37:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:10.485 20:37:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:10.485 20:37:28 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:10.485 00:20:10.485 real 0m21.891s 00:20:10.485 user 0m21.910s 00:20:10.485 sys 0m10.422s 00:20:10.485 20:37:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:20:10.485 20:37:28 -- common/autotest_common.sh@10 -- # set +x 00:20:10.485 ************************************ 00:20:10.485 END TEST nvmf_fips 00:20:10.485 ************************************ 00:20:10.485 20:37:28 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:20:10.485 20:37:28 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:20:10.485 20:37:28 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:20:10.485 20:37:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:20:10.485 20:37:28 -- common/autotest_common.sh@10 -- # set +x 00:20:10.485 ************************************ 00:20:10.485 START TEST nvmf_fuzz 00:20:10.485 ************************************ 00:20:10.485 20:37:28 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:20:10.485 * Looking for test storage... 00:20:10.485 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:10.485 20:37:28 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:10.485 20:37:28 -- nvmf/common.sh@7 -- # uname -s 00:20:10.485 20:37:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:10.485 20:37:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:10.485 20:37:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:10.485 20:37:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:10.485 20:37:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:10.485 20:37:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:10.485 20:37:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:10.485 20:37:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:10.485 20:37:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:10.485 20:37:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:10.485 20:37:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:20:10.485 20:37:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:20:10.485 20:37:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:10.485 20:37:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:10.792 20:37:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:10.792 20:37:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:10.792 20:37:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:10.792 20:37:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:10.793 20:37:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:10.793 20:37:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:10.793 20:37:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:10.793 20:37:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:10.793 20:37:28 -- paths/export.sh@5 -- # export PATH 00:20:10.793 20:37:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:10.793 20:37:28 -- nvmf/common.sh@46 -- # : 0 00:20:10.793 20:37:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:10.793 20:37:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:10.793 20:37:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:10.793 20:37:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:10.793 20:37:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:10.793 20:37:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:10.793 20:37:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:10.793 20:37:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:10.793 20:37:28 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:20:10.793 20:37:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:10.793 20:37:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:10.793 20:37:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:10.793 20:37:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:10.793 20:37:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:10.793 20:37:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:10.793 20:37:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:10.793 20:37:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:10.793 20:37:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:10.793 20:37:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:10.793 20:37:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:10.793 20:37:28 -- common/autotest_common.sh@10 -- # set +x 00:20:17.433 20:37:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:17.433 20:37:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:17.433 20:37:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:17.433 20:37:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:17.433 20:37:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:17.433 20:37:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:17.433 20:37:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:17.433 20:37:35 -- nvmf/common.sh@294 -- # net_devs=() 00:20:17.433 20:37:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:17.433 20:37:35 -- nvmf/common.sh@295 -- # e810=() 00:20:17.433 20:37:35 -- nvmf/common.sh@295 -- # local -ga e810 00:20:17.433 20:37:35 -- nvmf/common.sh@296 -- # x722=() 00:20:17.433 20:37:35 -- nvmf/common.sh@296 -- # local -ga x722 00:20:17.433 20:37:35 -- nvmf/common.sh@297 -- # mlx=() 00:20:17.433 20:37:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:17.433 20:37:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:17.433 20:37:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:17.433 20:37:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:17.433 20:37:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:17.433 20:37:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:17.433 20:37:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:17.433 20:37:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:17.433 20:37:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:17.433 20:37:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:17.433 20:37:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:17.433 20:37:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:17.433 20:37:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:17.433 20:37:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:17.433 20:37:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:17.433 20:37:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:17.433 20:37:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:20:17.433 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:20:17.433 20:37:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:17.433 20:37:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:20:17.433 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:20:17.433 20:37:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:17.433 20:37:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:17.433 20:37:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:17.433 20:37:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:17.433 20:37:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:17.433 20:37:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:20:17.433 Found net devices under 0000:4b:00.0: cvl_0_0 00:20:17.433 20:37:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:17.433 20:37:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:17.433 20:37:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:17.433 20:37:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:17.433 20:37:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:17.433 20:37:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:20:17.433 Found net devices under 0000:4b:00.1: cvl_0_1 00:20:17.433 20:37:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:17.433 20:37:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:17.433 20:37:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:17.433 20:37:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:17.433 20:37:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:17.433 20:37:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:17.433 20:37:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:17.433 20:37:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:17.433 20:37:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:17.433 20:37:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:17.433 20:37:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:17.433 20:37:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:17.433 20:37:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:17.433 20:37:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:17.433 20:37:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:17.433 20:37:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:17.433 20:37:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:17.433 20:37:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:17.695 20:37:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:17.695 20:37:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:17.695 20:37:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:17.695 20:37:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:17.695 20:37:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:17.695 20:37:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:17.695 20:37:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:17.695 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:17.695 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.468 ms 00:20:17.695 00:20:17.695 --- 10.0.0.2 ping statistics --- 00:20:17.695 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:17.695 rtt min/avg/max/mdev = 0.468/0.468/0.468/0.000 ms 00:20:17.695 20:37:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:17.696 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:17.696 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.373 ms 00:20:17.696 00:20:17.696 --- 10.0.0.1 ping statistics --- 00:20:17.696 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:17.696 rtt min/avg/max/mdev = 0.373/0.373/0.373/0.000 ms 00:20:17.696 20:37:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:17.696 20:37:35 -- nvmf/common.sh@410 -- # return 0 00:20:17.696 20:37:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:17.696 20:37:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:17.696 20:37:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:17.696 20:37:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:17.696 20:37:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:17.696 20:37:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:17.696 20:37:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:17.696 20:37:36 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=4091452 00:20:17.696 20:37:36 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:17.696 20:37:36 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:20:17.696 20:37:36 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 4091452 00:20:17.696 20:37:36 -- common/autotest_common.sh@819 -- # '[' -z 4091452 ']' 00:20:17.696 20:37:36 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:17.696 20:37:36 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:17.696 20:37:36 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:17.696 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:17.696 20:37:36 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:17.696 20:37:36 -- common/autotest_common.sh@10 -- # set +x 00:20:18.636 20:37:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:18.636 20:37:36 -- common/autotest_common.sh@852 -- # return 0 00:20:18.636 20:37:36 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:18.636 20:37:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:18.636 20:37:36 -- common/autotest_common.sh@10 -- # set +x 00:20:18.636 20:37:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:18.636 20:37:36 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:20:18.636 20:37:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:18.636 20:37:36 -- common/autotest_common.sh@10 -- # set +x 00:20:18.636 Malloc0 00:20:18.636 20:37:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:18.636 20:37:36 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:18.636 20:37:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:18.636 20:37:36 -- common/autotest_common.sh@10 -- # set +x 00:20:18.636 20:37:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:18.636 20:37:36 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:18.636 20:37:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:18.636 20:37:36 -- common/autotest_common.sh@10 -- # set +x 00:20:18.636 20:37:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:18.636 20:37:36 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:18.636 20:37:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:18.636 20:37:36 -- common/autotest_common.sh@10 -- # set +x 00:20:18.636 20:37:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:18.636 20:37:36 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:20:18.637 20:37:36 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:20:50.760 Fuzzing completed. Shutting down the fuzz application 00:20:50.760 00:20:50.760 Dumping successful admin opcodes: 00:20:50.760 8, 9, 10, 24, 00:20:50.760 Dumping successful io opcodes: 00:20:50.760 0, 9, 00:20:50.760 NS: 0x200003aeff00 I/O qp, Total commands completed: 781822, total successful commands: 4550, random_seed: 7837120 00:20:50.760 NS: 0x200003aeff00 admin qp, Total commands completed: 98600, total successful commands: 804, random_seed: 168788608 00:20:50.760 20:38:07 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:20:50.760 Fuzzing completed. Shutting down the fuzz application 00:20:50.760 00:20:50.760 Dumping successful admin opcodes: 00:20:50.760 24, 00:20:50.760 Dumping successful io opcodes: 00:20:50.760 00:20:50.760 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1496579465 00:20:50.760 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1496697599 00:20:50.760 20:38:08 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:50.760 20:38:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:50.760 20:38:08 -- common/autotest_common.sh@10 -- # set +x 00:20:50.760 20:38:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:50.760 20:38:08 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:20:50.760 20:38:08 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:20:50.760 20:38:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:50.760 20:38:08 -- nvmf/common.sh@116 -- # sync 00:20:50.760 20:38:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:50.760 20:38:08 -- nvmf/common.sh@119 -- # set +e 00:20:50.760 20:38:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:50.760 20:38:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:50.760 rmmod nvme_tcp 00:20:50.760 rmmod nvme_fabrics 00:20:50.760 rmmod nvme_keyring 00:20:50.760 20:38:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:50.760 20:38:08 -- nvmf/common.sh@123 -- # set -e 00:20:50.760 20:38:08 -- nvmf/common.sh@124 -- # return 0 00:20:50.760 20:38:08 -- nvmf/common.sh@477 -- # '[' -n 4091452 ']' 00:20:50.760 20:38:08 -- nvmf/common.sh@478 -- # killprocess 4091452 00:20:50.760 20:38:08 -- common/autotest_common.sh@926 -- # '[' -z 4091452 ']' 00:20:50.760 20:38:08 -- common/autotest_common.sh@930 -- # kill -0 4091452 00:20:50.760 20:38:08 -- common/autotest_common.sh@931 -- # uname 00:20:50.760 20:38:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:50.760 20:38:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4091452 00:20:50.760 20:38:08 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:20:50.760 20:38:08 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:20:50.760 20:38:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4091452' 00:20:50.760 killing process with pid 4091452 00:20:50.760 20:38:08 -- common/autotest_common.sh@945 -- # kill 4091452 00:20:50.760 20:38:08 -- common/autotest_common.sh@950 -- # wait 4091452 00:20:50.760 20:38:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:50.760 20:38:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:50.760 20:38:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:50.760 20:38:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:50.760 20:38:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:50.760 20:38:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:50.760 20:38:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:50.760 20:38:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:52.679 20:38:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:52.679 20:38:10 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:20:52.679 00:20:52.679 real 0m42.164s 00:20:52.679 user 0m55.875s 00:20:52.679 sys 0m15.447s 00:20:52.679 20:38:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:20:52.679 20:38:10 -- common/autotest_common.sh@10 -- # set +x 00:20:52.679 ************************************ 00:20:52.679 END TEST nvmf_fuzz 00:20:52.679 ************************************ 00:20:52.679 20:38:10 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:20:52.679 20:38:10 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:20:52.679 20:38:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:20:52.679 20:38:10 -- common/autotest_common.sh@10 -- # set +x 00:20:52.679 ************************************ 00:20:52.679 START TEST nvmf_multiconnection 00:20:52.679 ************************************ 00:20:52.679 20:38:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:20:52.679 * Looking for test storage... 00:20:52.679 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:52.679 20:38:11 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:52.680 20:38:11 -- nvmf/common.sh@7 -- # uname -s 00:20:52.680 20:38:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:52.680 20:38:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:52.680 20:38:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:52.680 20:38:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:52.680 20:38:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:52.680 20:38:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:52.680 20:38:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:52.680 20:38:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:52.680 20:38:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:52.941 20:38:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:52.941 20:38:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:20:52.941 20:38:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:20:52.941 20:38:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:52.941 20:38:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:52.941 20:38:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:52.941 20:38:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:52.941 20:38:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:52.941 20:38:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:52.941 20:38:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:52.941 20:38:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:52.941 20:38:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:52.941 20:38:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:52.941 20:38:11 -- paths/export.sh@5 -- # export PATH 00:20:52.942 20:38:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:52.942 20:38:11 -- nvmf/common.sh@46 -- # : 0 00:20:52.942 20:38:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:52.942 20:38:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:52.942 20:38:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:52.942 20:38:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:52.942 20:38:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:52.942 20:38:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:52.942 20:38:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:52.942 20:38:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:52.942 20:38:11 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:52.942 20:38:11 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:52.942 20:38:11 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:20:52.942 20:38:11 -- target/multiconnection.sh@16 -- # nvmftestinit 00:20:52.942 20:38:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:52.942 20:38:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:52.942 20:38:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:52.942 20:38:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:52.942 20:38:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:52.942 20:38:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:52.942 20:38:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:52.942 20:38:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:52.942 20:38:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:52.942 20:38:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:52.942 20:38:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:52.942 20:38:11 -- common/autotest_common.sh@10 -- # set +x 00:20:59.541 20:38:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:59.541 20:38:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:59.541 20:38:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:59.541 20:38:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:59.541 20:38:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:59.541 20:38:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:59.541 20:38:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:59.541 20:38:17 -- nvmf/common.sh@294 -- # net_devs=() 00:20:59.541 20:38:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:59.541 20:38:17 -- nvmf/common.sh@295 -- # e810=() 00:20:59.541 20:38:17 -- nvmf/common.sh@295 -- # local -ga e810 00:20:59.541 20:38:17 -- nvmf/common.sh@296 -- # x722=() 00:20:59.541 20:38:17 -- nvmf/common.sh@296 -- # local -ga x722 00:20:59.541 20:38:17 -- nvmf/common.sh@297 -- # mlx=() 00:20:59.541 20:38:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:59.541 20:38:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:59.541 20:38:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:59.541 20:38:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:59.541 20:38:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:59.541 20:38:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:59.541 20:38:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:59.541 20:38:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:59.541 20:38:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:59.541 20:38:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:59.541 20:38:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:59.541 20:38:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:59.541 20:38:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:59.541 20:38:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:59.541 20:38:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:59.541 20:38:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:59.541 20:38:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:20:59.541 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:20:59.541 20:38:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:59.541 20:38:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:20:59.541 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:20:59.541 20:38:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:59.541 20:38:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:59.541 20:38:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:59.541 20:38:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:59.541 20:38:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:59.541 20:38:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:20:59.541 Found net devices under 0000:4b:00.0: cvl_0_0 00:20:59.541 20:38:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:59.541 20:38:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:59.541 20:38:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:59.541 20:38:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:59.541 20:38:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:59.541 20:38:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:20:59.541 Found net devices under 0000:4b:00.1: cvl_0_1 00:20:59.541 20:38:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:59.541 20:38:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:59.541 20:38:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:59.541 20:38:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:59.541 20:38:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:59.541 20:38:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:59.541 20:38:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:59.541 20:38:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:59.541 20:38:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:59.541 20:38:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:59.541 20:38:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:59.541 20:38:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:59.541 20:38:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:59.541 20:38:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:59.541 20:38:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:59.541 20:38:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:59.541 20:38:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:59.541 20:38:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:59.541 20:38:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:59.541 20:38:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:59.541 20:38:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:59.541 20:38:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:59.803 20:38:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:59.803 20:38:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:59.803 20:38:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:59.803 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:59.803 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.620 ms 00:20:59.803 00:20:59.803 --- 10.0.0.2 ping statistics --- 00:20:59.803 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:59.803 rtt min/avg/max/mdev = 0.620/0.620/0.620/0.000 ms 00:20:59.803 20:38:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:59.803 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:59.803 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.375 ms 00:20:59.803 00:20:59.803 --- 10.0.0.1 ping statistics --- 00:20:59.803 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:59.803 rtt min/avg/max/mdev = 0.375/0.375/0.375/0.000 ms 00:20:59.803 20:38:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:59.803 20:38:17 -- nvmf/common.sh@410 -- # return 0 00:20:59.803 20:38:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:59.803 20:38:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:59.803 20:38:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:59.803 20:38:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:59.803 20:38:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:59.803 20:38:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:59.803 20:38:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:59.803 20:38:18 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:20:59.803 20:38:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:59.803 20:38:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:59.803 20:38:18 -- common/autotest_common.sh@10 -- # set +x 00:20:59.803 20:38:18 -- nvmf/common.sh@469 -- # nvmfpid=4101952 00:20:59.803 20:38:18 -- nvmf/common.sh@470 -- # waitforlisten 4101952 00:20:59.803 20:38:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:59.803 20:38:18 -- common/autotest_common.sh@819 -- # '[' -z 4101952 ']' 00:20:59.803 20:38:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:59.803 20:38:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:59.803 20:38:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:59.803 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:59.803 20:38:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:59.803 20:38:18 -- common/autotest_common.sh@10 -- # set +x 00:20:59.803 [2024-04-26 20:38:18.075120] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:20:59.803 [2024-04-26 20:38:18.075187] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:59.803 EAL: No free 2048 kB hugepages reported on node 1 00:20:59.803 [2024-04-26 20:38:18.145502] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:00.065 [2024-04-26 20:38:18.219492] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:00.065 [2024-04-26 20:38:18.219630] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:00.065 [2024-04-26 20:38:18.219642] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:00.065 [2024-04-26 20:38:18.219650] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:00.065 [2024-04-26 20:38:18.219780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:00.065 [2024-04-26 20:38:18.219895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:00.065 [2024-04-26 20:38:18.220023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:00.065 [2024-04-26 20:38:18.220026] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:00.638 20:38:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:00.638 20:38:18 -- common/autotest_common.sh@852 -- # return 0 00:21:00.638 20:38:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:00.638 20:38:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:00.639 20:38:18 -- common/autotest_common.sh@10 -- # set +x 00:21:00.639 20:38:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:00.639 20:38:18 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:00.639 20:38:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.639 20:38:18 -- common/autotest_common.sh@10 -- # set +x 00:21:00.639 [2024-04-26 20:38:18.899467] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:00.639 20:38:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.639 20:38:18 -- target/multiconnection.sh@21 -- # seq 1 11 00:21:00.639 20:38:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:00.639 20:38:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:00.639 20:38:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.639 20:38:18 -- common/autotest_common.sh@10 -- # set +x 00:21:00.639 Malloc1 00:21:00.639 20:38:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.639 20:38:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:21:00.639 20:38:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.639 20:38:18 -- common/autotest_common.sh@10 -- # set +x 00:21:00.639 20:38:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.639 20:38:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:00.639 20:38:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.639 20:38:18 -- common/autotest_common.sh@10 -- # set +x 00:21:00.639 20:38:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.639 20:38:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:00.639 20:38:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.639 20:38:18 -- common/autotest_common.sh@10 -- # set +x 00:21:00.639 [2024-04-26 20:38:18.966881] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:00.639 20:38:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.639 20:38:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:00.639 20:38:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:21:00.639 20:38:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.639 20:38:18 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 Malloc2 00:21:00.900 20:38:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:21:00.900 20:38:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.900 20:38:18 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:21:00.900 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.900 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:21:00.900 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.900 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:00.900 20:38:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:21:00.900 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.900 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 Malloc3 00:21:00.900 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:21:00.900 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.900 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:21:00.900 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.900 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:21:00.900 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.900 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:00.900 20:38:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:21:00.900 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.900 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 Malloc4 00:21:00.900 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:21:00.900 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.900 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:21:00.900 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.900 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:21:00.900 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.900 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:00.900 20:38:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:21:00.900 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.900 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 Malloc5 00:21:00.900 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:21:00.900 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.900 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.900 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.900 20:38:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:21:00.900 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.901 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.901 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.901 20:38:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:21:00.901 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.901 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.901 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.901 20:38:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:00.901 20:38:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:21:00.901 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.901 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.901 Malloc6 00:21:00.901 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.901 20:38:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:21:00.901 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.901 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.901 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.901 20:38:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:21:00.901 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.901 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.901 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.901 20:38:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:21:00.901 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.901 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:00.901 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.901 20:38:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:00.901 20:38:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:21:00.901 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.901 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 Malloc7 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:01.162 20:38:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 Malloc8 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:01.162 20:38:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 Malloc9 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:01.162 20:38:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 Malloc10 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:01.162 20:38:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 Malloc11 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:21:01.162 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.162 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.162 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.162 20:38:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:21:01.163 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.163 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.163 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.163 20:38:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:21:01.163 20:38:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:01.163 20:38:19 -- common/autotest_common.sh@10 -- # set +x 00:21:01.163 20:38:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:01.163 20:38:19 -- target/multiconnection.sh@28 -- # seq 1 11 00:21:01.163 20:38:19 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:01.163 20:38:19 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:21:03.074 20:38:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:21:03.074 20:38:20 -- common/autotest_common.sh@1177 -- # local i=0 00:21:03.074 20:38:20 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:03.074 20:38:20 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:03.074 20:38:20 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:04.985 20:38:22 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:04.985 20:38:22 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:04.985 20:38:22 -- common/autotest_common.sh@1186 -- # grep -c SPDK1 00:21:04.985 20:38:22 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:04.985 20:38:22 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:04.985 20:38:22 -- common/autotest_common.sh@1187 -- # return 0 00:21:04.985 20:38:22 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:04.985 20:38:22 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:21:06.371 20:38:24 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:21:06.371 20:38:24 -- common/autotest_common.sh@1177 -- # local i=0 00:21:06.371 20:38:24 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:06.371 20:38:24 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:06.371 20:38:24 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:08.283 20:38:26 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:08.283 20:38:26 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:08.283 20:38:26 -- common/autotest_common.sh@1186 -- # grep -c SPDK2 00:21:08.283 20:38:26 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:08.283 20:38:26 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:08.283 20:38:26 -- common/autotest_common.sh@1187 -- # return 0 00:21:08.283 20:38:26 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:08.283 20:38:26 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:21:10.200 20:38:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:21:10.200 20:38:28 -- common/autotest_common.sh@1177 -- # local i=0 00:21:10.200 20:38:28 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:10.200 20:38:28 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:10.200 20:38:28 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:12.114 20:38:30 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:12.114 20:38:30 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:12.114 20:38:30 -- common/autotest_common.sh@1186 -- # grep -c SPDK3 00:21:12.114 20:38:30 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:12.114 20:38:30 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:12.114 20:38:30 -- common/autotest_common.sh@1187 -- # return 0 00:21:12.114 20:38:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:12.114 20:38:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:21:13.502 20:38:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:21:13.502 20:38:31 -- common/autotest_common.sh@1177 -- # local i=0 00:21:13.502 20:38:31 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:13.502 20:38:31 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:13.502 20:38:31 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:15.416 20:38:33 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:15.416 20:38:33 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:15.416 20:38:33 -- common/autotest_common.sh@1186 -- # grep -c SPDK4 00:21:15.416 20:38:33 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:15.416 20:38:33 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:15.416 20:38:33 -- common/autotest_common.sh@1187 -- # return 0 00:21:15.416 20:38:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:15.416 20:38:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:21:17.407 20:38:35 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:21:17.407 20:38:35 -- common/autotest_common.sh@1177 -- # local i=0 00:21:17.407 20:38:35 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:17.407 20:38:35 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:17.407 20:38:35 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:19.319 20:38:37 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:19.319 20:38:37 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:19.319 20:38:37 -- common/autotest_common.sh@1186 -- # grep -c SPDK5 00:21:19.319 20:38:37 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:19.319 20:38:37 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:19.319 20:38:37 -- common/autotest_common.sh@1187 -- # return 0 00:21:19.319 20:38:37 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:19.319 20:38:37 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:21:20.701 20:38:38 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:21:20.701 20:38:38 -- common/autotest_common.sh@1177 -- # local i=0 00:21:20.701 20:38:38 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:20.701 20:38:38 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:20.701 20:38:38 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:23.246 20:38:40 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:23.246 20:38:40 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:23.246 20:38:40 -- common/autotest_common.sh@1186 -- # grep -c SPDK6 00:21:23.246 20:38:41 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:23.246 20:38:41 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:23.246 20:38:41 -- common/autotest_common.sh@1187 -- # return 0 00:21:23.246 20:38:41 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:23.246 20:38:41 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:21:24.632 20:38:42 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:21:24.632 20:38:42 -- common/autotest_common.sh@1177 -- # local i=0 00:21:24.632 20:38:42 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:24.632 20:38:42 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:24.632 20:38:42 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:26.544 20:38:44 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:26.544 20:38:44 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:26.544 20:38:44 -- common/autotest_common.sh@1186 -- # grep -c SPDK7 00:21:26.545 20:38:44 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:26.545 20:38:44 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:26.545 20:38:44 -- common/autotest_common.sh@1187 -- # return 0 00:21:26.545 20:38:44 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:26.545 20:38:44 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:21:28.458 20:38:46 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:21:28.458 20:38:46 -- common/autotest_common.sh@1177 -- # local i=0 00:21:28.458 20:38:46 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:28.458 20:38:46 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:28.458 20:38:46 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:30.372 20:38:48 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:30.372 20:38:48 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:30.372 20:38:48 -- common/autotest_common.sh@1186 -- # grep -c SPDK8 00:21:30.372 20:38:48 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:30.372 20:38:48 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:30.372 20:38:48 -- common/autotest_common.sh@1187 -- # return 0 00:21:30.372 20:38:48 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:30.372 20:38:48 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:21:32.293 20:38:50 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:21:32.293 20:38:50 -- common/autotest_common.sh@1177 -- # local i=0 00:21:32.293 20:38:50 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:32.293 20:38:50 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:32.293 20:38:50 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:34.206 20:38:52 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:34.206 20:38:52 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:34.206 20:38:52 -- common/autotest_common.sh@1186 -- # grep -c SPDK9 00:21:34.206 20:38:52 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:34.206 20:38:52 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:34.206 20:38:52 -- common/autotest_common.sh@1187 -- # return 0 00:21:34.206 20:38:52 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:34.206 20:38:52 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:21:36.122 20:38:54 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:21:36.122 20:38:54 -- common/autotest_common.sh@1177 -- # local i=0 00:21:36.122 20:38:54 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:36.122 20:38:54 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:36.122 20:38:54 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:38.036 20:38:56 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:38.036 20:38:56 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:38.036 20:38:56 -- common/autotest_common.sh@1186 -- # grep -c SPDK10 00:21:38.036 20:38:56 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:38.036 20:38:56 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:38.036 20:38:56 -- common/autotest_common.sh@1187 -- # return 0 00:21:38.036 20:38:56 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:38.036 20:38:56 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:21:39.952 20:38:58 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:21:39.952 20:38:58 -- common/autotest_common.sh@1177 -- # local i=0 00:21:39.952 20:38:58 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:39.952 20:38:58 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:39.952 20:38:58 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:42.522 20:39:00 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:42.522 20:39:00 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:42.522 20:39:00 -- common/autotest_common.sh@1186 -- # grep -c SPDK11 00:21:42.522 20:39:00 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:42.522 20:39:00 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:42.522 20:39:00 -- common/autotest_common.sh@1187 -- # return 0 00:21:42.522 20:39:00 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:21:42.522 [global] 00:21:42.522 thread=1 00:21:42.522 invalidate=1 00:21:42.522 rw=read 00:21:42.522 time_based=1 00:21:42.522 runtime=10 00:21:42.522 ioengine=libaio 00:21:42.522 direct=1 00:21:42.522 bs=262144 00:21:42.522 iodepth=64 00:21:42.522 norandommap=1 00:21:42.522 numjobs=1 00:21:42.522 00:21:42.522 [job0] 00:21:42.522 filename=/dev/nvme0n1 00:21:42.522 [job1] 00:21:42.522 filename=/dev/nvme10n1 00:21:42.522 [job2] 00:21:42.522 filename=/dev/nvme1n1 00:21:42.522 [job3] 00:21:42.522 filename=/dev/nvme2n1 00:21:42.522 [job4] 00:21:42.522 filename=/dev/nvme3n1 00:21:42.522 [job5] 00:21:42.522 filename=/dev/nvme4n1 00:21:42.522 [job6] 00:21:42.522 filename=/dev/nvme5n1 00:21:42.522 [job7] 00:21:42.522 filename=/dev/nvme6n1 00:21:42.522 [job8] 00:21:42.522 filename=/dev/nvme7n1 00:21:42.522 [job9] 00:21:42.522 filename=/dev/nvme8n1 00:21:42.522 [job10] 00:21:42.522 filename=/dev/nvme9n1 00:21:42.522 Could not set queue depth (nvme0n1) 00:21:42.522 Could not set queue depth (nvme10n1) 00:21:42.522 Could not set queue depth (nvme1n1) 00:21:42.522 Could not set queue depth (nvme2n1) 00:21:42.522 Could not set queue depth (nvme3n1) 00:21:42.522 Could not set queue depth (nvme4n1) 00:21:42.522 Could not set queue depth (nvme5n1) 00:21:42.522 Could not set queue depth (nvme6n1) 00:21:42.522 Could not set queue depth (nvme7n1) 00:21:42.522 Could not set queue depth (nvme8n1) 00:21:42.522 Could not set queue depth (nvme9n1) 00:21:42.522 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:42.522 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:42.522 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:42.522 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:42.522 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:42.522 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:42.522 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:42.522 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:42.523 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:42.523 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:42.523 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:42.523 fio-3.35 00:21:42.523 Starting 11 threads 00:21:54.765 00:21:54.765 job0: (groupid=0, jobs=1): err= 0: pid=4110837: Fri Apr 26 20:39:11 2024 00:21:54.765 read: IOPS=677, BW=169MiB/s (178MB/s)(1712MiB/10103msec) 00:21:54.765 slat (usec): min=6, max=50040, avg=1231.93, stdev=3435.58 00:21:54.765 clat (msec): min=18, max=200, avg=93.05, stdev=23.66 00:21:54.765 lat (msec): min=18, max=200, avg=94.28, stdev=24.00 00:21:54.765 clat percentiles (msec): 00:21:54.765 | 1.00th=[ 42], 5.00th=[ 64], 10.00th=[ 70], 20.00th=[ 74], 00:21:54.765 | 30.00th=[ 78], 40.00th=[ 81], 50.00th=[ 88], 60.00th=[ 101], 00:21:54.765 | 70.00th=[ 107], 80.00th=[ 114], 90.00th=[ 128], 95.00th=[ 134], 00:21:54.765 | 99.00th=[ 142], 99.50th=[ 157], 99.90th=[ 192], 99.95th=[ 197], 00:21:54.765 | 99.99th=[ 201] 00:21:54.765 bw ( KiB/s): min=116224, max=238592, per=7.43%, avg=173696.00, stdev=33565.81, samples=20 00:21:54.765 iops : min= 454, max= 932, avg=678.50, stdev=131.12, samples=20 00:21:54.765 lat (msec) : 20=0.04%, 50=2.25%, 100=57.45%, 250=40.26% 00:21:54.765 cpu : usr=0.27%, sys=2.07%, ctx=1860, majf=0, minf=4097 00:21:54.765 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:21:54.765 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:54.765 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:54.765 issued rwts: total=6848,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:54.765 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:54.765 job1: (groupid=0, jobs=1): err= 0: pid=4110855: Fri Apr 26 20:39:11 2024 00:21:54.765 read: IOPS=629, BW=157MiB/s (165MB/s)(1590MiB/10094msec) 00:21:54.765 slat (usec): min=6, max=47968, avg=1405.66, stdev=3723.35 00:21:54.765 clat (msec): min=31, max=192, avg=100.06, stdev=20.81 00:21:54.765 lat (msec): min=31, max=192, avg=101.47, stdev=21.12 00:21:54.765 clat percentiles (msec): 00:21:54.765 | 1.00th=[ 61], 5.00th=[ 74], 10.00th=[ 78], 20.00th=[ 83], 00:21:54.765 | 30.00th=[ 87], 40.00th=[ 92], 50.00th=[ 99], 60.00th=[ 104], 00:21:54.765 | 70.00th=[ 109], 80.00th=[ 116], 90.00th=[ 130], 95.00th=[ 136], 00:21:54.765 | 99.00th=[ 161], 99.50th=[ 174], 99.90th=[ 184], 99.95th=[ 184], 00:21:54.765 | 99.99th=[ 192] 00:21:54.765 bw ( KiB/s): min=126464, max=203264, per=6.90%, avg=161152.00, stdev=21183.29, samples=20 00:21:54.765 iops : min= 494, max= 794, avg=629.50, stdev=82.75, samples=20 00:21:54.765 lat (msec) : 50=0.46%, 100=53.33%, 250=46.21% 00:21:54.765 cpu : usr=0.37%, sys=2.11%, ctx=1549, majf=0, minf=4097 00:21:54.765 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:21:54.765 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:54.765 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:54.765 issued rwts: total=6358,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:54.765 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:54.765 job2: (groupid=0, jobs=1): err= 0: pid=4110866: Fri Apr 26 20:39:11 2024 00:21:54.765 read: IOPS=763, BW=191MiB/s (200MB/s)(1921MiB/10059msec) 00:21:54.765 slat (usec): min=6, max=41930, avg=1184.22, stdev=3204.78 00:21:54.765 clat (msec): min=15, max=159, avg=82.55, stdev=26.25 00:21:54.765 lat (msec): min=15, max=165, avg=83.74, stdev=26.47 00:21:54.765 clat percentiles (msec): 00:21:54.765 | 1.00th=[ 34], 5.00th=[ 47], 10.00th=[ 53], 20.00th=[ 61], 00:21:54.765 | 30.00th=[ 67], 40.00th=[ 72], 50.00th=[ 78], 60.00th=[ 85], 00:21:54.765 | 70.00th=[ 95], 80.00th=[ 107], 90.00th=[ 123], 95.00th=[ 134], 00:21:54.765 | 99.00th=[ 146], 99.50th=[ 150], 99.90th=[ 159], 99.95th=[ 159], 00:21:54.765 | 99.99th=[ 159] 00:21:54.765 bw ( KiB/s): min=118784, max=275456, per=8.35%, avg=195070.30, stdev=43100.71, samples=20 00:21:54.765 iops : min= 464, max= 1076, avg=761.95, stdev=168.32, samples=20 00:21:54.765 lat (msec) : 20=0.14%, 50=7.41%, 100=66.79%, 250=25.66% 00:21:54.765 cpu : usr=0.30%, sys=2.83%, ctx=1795, majf=0, minf=4097 00:21:54.765 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:21:54.765 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:54.765 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:54.765 issued rwts: total=7682,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:54.765 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:54.765 job3: (groupid=0, jobs=1): err= 0: pid=4110867: Fri Apr 26 20:39:11 2024 00:21:54.765 read: IOPS=1127, BW=282MiB/s (296MB/s)(2826MiB/10021msec) 00:21:54.765 slat (usec): min=8, max=24967, avg=881.12, stdev=2004.85 00:21:54.765 clat (msec): min=17, max=112, avg=55.79, stdev=20.21 00:21:54.765 lat (msec): min=21, max=114, avg=56.67, stdev=20.51 00:21:54.765 clat percentiles (msec): 00:21:54.765 | 1.00th=[ 28], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 35], 00:21:54.765 | 30.00th=[ 38], 40.00th=[ 50], 50.00th=[ 56], 60.00th=[ 60], 00:21:54.765 | 70.00th=[ 65], 80.00th=[ 75], 90.00th=[ 87], 95.00th=[ 93], 00:21:54.765 | 99.00th=[ 102], 99.50th=[ 104], 99.90th=[ 109], 99.95th=[ 110], 00:21:54.765 | 99.99th=[ 111] 00:21:54.765 bw ( KiB/s): min=166912, max=502784, per=12.31%, avg=287718.40, stdev=105475.33, samples=20 00:21:54.765 iops : min= 652, max= 1964, avg=1123.90, stdev=412.01, samples=20 00:21:54.765 lat (msec) : 20=0.01%, 50=40.65%, 100=57.88%, 250=1.46% 00:21:54.765 cpu : usr=0.49%, sys=4.16%, ctx=2539, majf=0, minf=4097 00:21:54.765 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:21:54.765 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:54.765 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:54.765 issued rwts: total=11302,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:54.765 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:54.765 job4: (groupid=0, jobs=1): err= 0: pid=4110868: Fri Apr 26 20:39:11 2024 00:21:54.765 read: IOPS=972, BW=243MiB/s (255MB/s)(2447MiB/10068msec) 00:21:54.765 slat (usec): min=7, max=72970, avg=1008.18, stdev=2489.33 00:21:54.765 clat (msec): min=31, max=157, avg=64.73, stdev=13.31 00:21:54.765 lat (msec): min=31, max=159, avg=65.74, stdev=13.45 00:21:54.765 clat percentiles (msec): 00:21:54.765 | 1.00th=[ 42], 5.00th=[ 48], 10.00th=[ 51], 20.00th=[ 55], 00:21:54.765 | 30.00th=[ 57], 40.00th=[ 61], 50.00th=[ 63], 60.00th=[ 66], 00:21:54.765 | 70.00th=[ 70], 80.00th=[ 74], 90.00th=[ 82], 95.00th=[ 88], 00:21:54.765 | 99.00th=[ 120], 99.50th=[ 121], 99.90th=[ 136], 99.95th=[ 142], 00:21:54.765 | 99.99th=[ 157] 00:21:54.765 bw ( KiB/s): min=155648, max=298496, per=10.65%, avg=248985.60, stdev=35322.77, samples=20 00:21:54.765 iops : min= 608, max= 1166, avg=972.60, stdev=137.98, samples=20 00:21:54.765 lat (msec) : 50=8.70%, 100=89.35%, 250=1.95% 00:21:54.765 cpu : usr=0.38%, sys=3.42%, ctx=2103, majf=0, minf=4097 00:21:54.765 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:21:54.765 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:54.765 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:54.765 issued rwts: total=9789,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:54.765 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:54.765 job5: (groupid=0, jobs=1): err= 0: pid=4110872: Fri Apr 26 20:39:11 2024 00:21:54.765 read: IOPS=717, BW=179MiB/s (188MB/s)(1811MiB/10091msec) 00:21:54.765 slat (usec): min=6, max=32986, avg=1376.40, stdev=3321.30 00:21:54.765 clat (msec): min=16, max=190, avg=87.68, stdev=23.83 00:21:54.765 lat (msec): min=16, max=190, avg=89.05, stdev=24.24 00:21:54.765 clat percentiles (msec): 00:21:54.765 | 1.00th=[ 36], 5.00th=[ 54], 10.00th=[ 61], 20.00th=[ 70], 00:21:54.765 | 30.00th=[ 73], 40.00th=[ 77], 50.00th=[ 81], 60.00th=[ 96], 00:21:54.765 | 70.00th=[ 103], 80.00th=[ 107], 90.00th=[ 122], 95.00th=[ 130], 00:21:54.765 | 99.00th=[ 144], 99.50th=[ 153], 99.90th=[ 186], 99.95th=[ 188], 00:21:54.765 | 99.99th=[ 190] 00:21:54.765 bw ( KiB/s): min=123392, max=265728, per=7.87%, avg=183808.00, stdev=40563.98, samples=20 00:21:54.765 iops : min= 482, max= 1038, avg=718.00, stdev=158.45, samples=20 00:21:54.765 lat (msec) : 20=0.14%, 50=3.23%, 100=62.39%, 250=34.24% 00:21:54.765 cpu : usr=0.27%, sys=2.72%, ctx=1734, majf=0, minf=3534 00:21:54.765 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:21:54.765 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:54.765 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:54.765 issued rwts: total=7243,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:54.765 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:54.765 job6: (groupid=0, jobs=1): err= 0: pid=4110873: Fri Apr 26 20:39:11 2024 00:21:54.765 read: IOPS=721, BW=180MiB/s (189MB/s)(1815MiB/10060msec) 00:21:54.765 slat (usec): min=10, max=83045, avg=1186.36, stdev=3544.96 00:21:54.765 clat (msec): min=9, max=185, avg=87.44, stdev=25.20 00:21:54.765 lat (msec): min=9, max=185, avg=88.63, stdev=25.67 00:21:54.765 clat percentiles (msec): 00:21:54.765 | 1.00th=[ 24], 5.00th=[ 45], 10.00th=[ 61], 20.00th=[ 70], 00:21:54.765 | 30.00th=[ 77], 40.00th=[ 81], 50.00th=[ 86], 60.00th=[ 91], 00:21:54.765 | 70.00th=[ 97], 80.00th=[ 106], 90.00th=[ 126], 95.00th=[ 136], 00:21:54.765 | 99.00th=[ 148], 99.50th=[ 157], 99.90th=[ 165], 99.95th=[ 169], 00:21:54.765 | 99.99th=[ 186] 00:21:54.765 bw ( KiB/s): min=115200, max=237056, per=7.88%, avg=184192.00, stdev=38056.91, samples=20 00:21:54.765 iops : min= 450, max= 926, avg=719.50, stdev=148.66, samples=20 00:21:54.765 lat (msec) : 10=0.01%, 20=0.61%, 50=5.43%, 100=68.10%, 250=25.85% 00:21:54.765 cpu : usr=0.37%, sys=2.73%, ctx=1784, majf=0, minf=4097 00:21:54.765 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:21:54.765 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:54.765 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:54.765 issued rwts: total=7258,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:54.765 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:54.765 job7: (groupid=0, jobs=1): err= 0: pid=4110874: Fri Apr 26 20:39:11 2024 00:21:54.766 read: IOPS=995, BW=249MiB/s (261MB/s)(2493MiB/10020msec) 00:21:54.766 slat (usec): min=8, max=20673, avg=956.07, stdev=2186.39 00:21:54.766 clat (msec): min=6, max=126, avg=63.28, stdev=16.79 00:21:54.766 lat (msec): min=6, max=126, avg=64.23, stdev=17.01 00:21:54.766 clat percentiles (msec): 00:21:54.766 | 1.00th=[ 26], 5.00th=[ 38], 10.00th=[ 43], 20.00th=[ 50], 00:21:54.766 | 30.00th=[ 54], 40.00th=[ 58], 50.00th=[ 62], 60.00th=[ 69], 00:21:54.766 | 70.00th=[ 74], 80.00th=[ 79], 90.00th=[ 84], 95.00th=[ 91], 00:21:54.766 | 99.00th=[ 104], 99.50th=[ 109], 99.90th=[ 125], 99.95th=[ 127], 00:21:54.766 | 99.99th=[ 127] 00:21:54.766 bw ( KiB/s): min=178688, max=371200, per=10.86%, avg=253694.20, stdev=50777.79, samples=20 00:21:54.766 iops : min= 698, max= 1450, avg=990.95, stdev=198.36, samples=20 00:21:54.766 lat (msec) : 10=0.16%, 20=0.40%, 50=21.28%, 100=76.44%, 250=1.71% 00:21:54.766 cpu : usr=0.35%, sys=3.72%, ctx=2352, majf=0, minf=4097 00:21:54.766 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:21:54.766 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:54.766 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:54.766 issued rwts: total=9972,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:54.766 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:54.766 job8: (groupid=0, jobs=1): err= 0: pid=4110883: Fri Apr 26 20:39:11 2024 00:21:54.766 read: IOPS=896, BW=224MiB/s (235MB/s)(2263MiB/10095msec) 00:21:54.766 slat (usec): min=7, max=30871, avg=1071.28, stdev=2543.01 00:21:54.766 clat (msec): min=11, max=190, avg=70.21, stdev=20.39 00:21:54.766 lat (msec): min=11, max=190, avg=71.28, stdev=20.55 00:21:54.766 clat percentiles (msec): 00:21:54.766 | 1.00th=[ 37], 5.00th=[ 42], 10.00th=[ 45], 20.00th=[ 52], 00:21:54.766 | 30.00th=[ 58], 40.00th=[ 65], 50.00th=[ 70], 60.00th=[ 75], 00:21:54.766 | 70.00th=[ 81], 80.00th=[ 85], 90.00th=[ 97], 95.00th=[ 106], 00:21:54.766 | 99.00th=[ 121], 99.50th=[ 129], 99.90th=[ 184], 99.95th=[ 190], 00:21:54.766 | 99.99th=[ 192] 00:21:54.766 bw ( KiB/s): min=164352, max=379904, per=9.85%, avg=230114.40, stdev=56211.03, samples=20 00:21:54.766 iops : min= 642, max= 1484, avg=898.85, stdev=219.58, samples=20 00:21:54.766 lat (msec) : 20=0.10%, 50=17.06%, 100=74.90%, 250=7.94% 00:21:54.766 cpu : usr=0.41%, sys=3.14%, ctx=2073, majf=0, minf=4097 00:21:54.766 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:21:54.766 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:54.766 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:54.766 issued rwts: total=9051,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:54.766 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:54.766 job9: (groupid=0, jobs=1): err= 0: pid=4110884: Fri Apr 26 20:39:11 2024 00:21:54.766 read: IOPS=820, BW=205MiB/s (215MB/s)(2070MiB/10092msec) 00:21:54.766 slat (usec): min=8, max=43433, avg=1198.36, stdev=2915.69 00:21:54.766 clat (msec): min=28, max=203, avg=76.71, stdev=18.29 00:21:54.766 lat (msec): min=28, max=203, avg=77.90, stdev=18.59 00:21:54.766 clat percentiles (msec): 00:21:54.766 | 1.00th=[ 48], 5.00th=[ 54], 10.00th=[ 57], 20.00th=[ 61], 00:21:54.766 | 30.00th=[ 66], 40.00th=[ 71], 50.00th=[ 74], 60.00th=[ 78], 00:21:54.766 | 70.00th=[ 82], 80.00th=[ 94], 90.00th=[ 104], 95.00th=[ 109], 00:21:54.766 | 99.00th=[ 122], 99.50th=[ 133], 99.90th=[ 186], 99.95th=[ 190], 00:21:54.766 | 99.99th=[ 205] 00:21:54.766 bw ( KiB/s): min=152576, max=274432, per=9.00%, avg=210380.80, stdev=40904.01, samples=20 00:21:54.766 iops : min= 596, max= 1072, avg=821.80, stdev=159.78, samples=20 00:21:54.766 lat (msec) : 50=2.02%, 100=83.49%, 250=14.49% 00:21:54.766 cpu : usr=0.41%, sys=3.32%, ctx=1894, majf=0, minf=4097 00:21:54.766 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:21:54.766 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:54.766 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:54.766 issued rwts: total=8281,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:54.766 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:54.766 job10: (groupid=0, jobs=1): err= 0: pid=4110891: Fri Apr 26 20:39:11 2024 00:21:54.766 read: IOPS=838, BW=210MiB/s (220MB/s)(2111MiB/10067msec) 00:21:54.766 slat (usec): min=7, max=45353, avg=1180.66, stdev=2947.30 00:21:54.766 clat (msec): min=35, max=164, avg=75.03, stdev=17.59 00:21:54.766 lat (msec): min=35, max=165, avg=76.21, stdev=17.74 00:21:54.766 clat percentiles (msec): 00:21:54.766 | 1.00th=[ 46], 5.00th=[ 53], 10.00th=[ 56], 20.00th=[ 61], 00:21:54.766 | 30.00th=[ 64], 40.00th=[ 68], 50.00th=[ 72], 60.00th=[ 77], 00:21:54.766 | 70.00th=[ 83], 80.00th=[ 90], 90.00th=[ 101], 95.00th=[ 109], 00:21:54.766 | 99.00th=[ 123], 99.50th=[ 128], 99.90th=[ 150], 99.95th=[ 165], 00:21:54.766 | 99.99th=[ 165] 00:21:54.766 bw ( KiB/s): min=160768, max=269312, per=9.18%, avg=214579.20, stdev=36238.49, samples=20 00:21:54.766 iops : min= 628, max= 1052, avg=838.20, stdev=141.56, samples=20 00:21:54.766 lat (msec) : 50=3.29%, 100=86.87%, 250=9.84% 00:21:54.766 cpu : usr=0.23%, sys=3.18%, ctx=1714, majf=0, minf=4097 00:21:54.766 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:21:54.766 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:54.766 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:54.766 issued rwts: total=8445,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:54.766 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:54.766 00:21:54.766 Run status group 0 (all jobs): 00:21:54.766 READ: bw=2282MiB/s (2393MB/s), 157MiB/s-282MiB/s (165MB/s-296MB/s), io=22.5GiB (24.2GB), run=10020-10103msec 00:21:54.766 00:21:54.766 Disk stats (read/write): 00:21:54.766 nvme0n1: ios=13380/0, merge=0/0, ticks=1216865/0, in_queue=1216865, util=96.40% 00:21:54.766 nvme10n1: ios=12420/0, merge=0/0, ticks=1217608/0, in_queue=1217608, util=96.67% 00:21:54.766 nvme1n1: ios=14992/0, merge=0/0, ticks=1218182/0, in_queue=1218182, util=97.00% 00:21:54.766 nvme2n1: ios=22102/0, merge=0/0, ticks=1221770/0, in_queue=1221770, util=97.30% 00:21:54.766 nvme3n1: ios=19216/0, merge=0/0, ticks=1214796/0, in_queue=1214796, util=97.34% 00:21:54.766 nvme4n1: ios=14210/0, merge=0/0, ticks=1209864/0, in_queue=1209864, util=97.87% 00:21:54.766 nvme5n1: ios=14183/0, merge=0/0, ticks=1217421/0, in_queue=1217421, util=97.99% 00:21:54.766 nvme6n1: ios=19423/0, merge=0/0, ticks=1217919/0, in_queue=1217919, util=98.23% 00:21:54.766 nvme7n1: ios=17819/0, merge=0/0, ticks=1216681/0, in_queue=1216681, util=98.77% 00:21:54.766 nvme8n1: ios=16247/0, merge=0/0, ticks=1212718/0, in_queue=1212718, util=98.98% 00:21:54.766 nvme9n1: ios=16553/0, merge=0/0, ticks=1215225/0, in_queue=1215225, util=99.13% 00:21:54.766 20:39:11 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:21:54.766 [global] 00:21:54.766 thread=1 00:21:54.766 invalidate=1 00:21:54.766 rw=randwrite 00:21:54.766 time_based=1 00:21:54.766 runtime=10 00:21:54.766 ioengine=libaio 00:21:54.766 direct=1 00:21:54.766 bs=262144 00:21:54.766 iodepth=64 00:21:54.766 norandommap=1 00:21:54.766 numjobs=1 00:21:54.766 00:21:54.766 [job0] 00:21:54.766 filename=/dev/nvme0n1 00:21:54.766 [job1] 00:21:54.766 filename=/dev/nvme10n1 00:21:54.766 [job2] 00:21:54.766 filename=/dev/nvme1n1 00:21:54.766 [job3] 00:21:54.766 filename=/dev/nvme2n1 00:21:54.766 [job4] 00:21:54.766 filename=/dev/nvme3n1 00:21:54.766 [job5] 00:21:54.766 filename=/dev/nvme4n1 00:21:54.766 [job6] 00:21:54.766 filename=/dev/nvme5n1 00:21:54.766 [job7] 00:21:54.766 filename=/dev/nvme6n1 00:21:54.766 [job8] 00:21:54.766 filename=/dev/nvme7n1 00:21:54.766 [job9] 00:21:54.766 filename=/dev/nvme8n1 00:21:54.766 [job10] 00:21:54.766 filename=/dev/nvme9n1 00:21:54.766 Could not set queue depth (nvme0n1) 00:21:54.766 Could not set queue depth (nvme10n1) 00:21:54.766 Could not set queue depth (nvme1n1) 00:21:54.766 Could not set queue depth (nvme2n1) 00:21:54.766 Could not set queue depth (nvme3n1) 00:21:54.766 Could not set queue depth (nvme4n1) 00:21:54.766 Could not set queue depth (nvme5n1) 00:21:54.766 Could not set queue depth (nvme6n1) 00:21:54.766 Could not set queue depth (nvme7n1) 00:21:54.766 Could not set queue depth (nvme8n1) 00:21:54.766 Could not set queue depth (nvme9n1) 00:21:54.766 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:54.766 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:54.766 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:54.766 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:54.766 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:54.766 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:54.766 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:54.766 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:54.766 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:54.766 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:54.766 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:54.766 fio-3.35 00:21:54.766 Starting 11 threads 00:22:04.776 00:22:04.777 job0: (groupid=0, jobs=1): err= 0: pid=4113328: Fri Apr 26 20:39:22 2024 00:22:04.777 write: IOPS=305, BW=76.4MiB/s (80.1MB/s)(777MiB/10179msec); 0 zone resets 00:22:04.777 slat (usec): min=19, max=74099, avg=3137.02, stdev=6044.69 00:22:04.777 clat (msec): min=25, max=378, avg=206.31, stdev=39.23 00:22:04.777 lat (msec): min=25, max=379, avg=209.44, stdev=39.44 00:22:04.777 clat percentiles (msec): 00:22:04.777 | 1.00th=[ 80], 5.00th=[ 148], 10.00th=[ 159], 20.00th=[ 169], 00:22:04.777 | 30.00th=[ 178], 40.00th=[ 205], 50.00th=[ 218], 60.00th=[ 224], 00:22:04.777 | 70.00th=[ 230], 80.00th=[ 239], 90.00th=[ 247], 95.00th=[ 259], 00:22:04.777 | 99.00th=[ 279], 99.50th=[ 317], 99.90th=[ 368], 99.95th=[ 380], 00:22:04.777 | 99.99th=[ 380] 00:22:04.777 bw ( KiB/s): min=63488, max=102400, per=6.51%, avg=77977.60, stdev=12423.23, samples=20 00:22:04.777 iops : min= 248, max= 400, avg=304.60, stdev=48.53, samples=20 00:22:04.777 lat (msec) : 50=0.51%, 100=0.51%, 250=90.58%, 500=8.39% 00:22:04.777 cpu : usr=0.64%, sys=0.80%, ctx=867, majf=0, minf=1 00:22:04.777 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=0.5%, 32=1.0%, >=64=98.0% 00:22:04.777 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:04.777 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:04.777 issued rwts: total=0,3109,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:04.777 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:04.777 job1: (groupid=0, jobs=1): err= 0: pid=4113350: Fri Apr 26 20:39:22 2024 00:22:04.777 write: IOPS=393, BW=98.4MiB/s (103MB/s)(1001MiB/10171msec); 0 zone resets 00:22:04.777 slat (usec): min=23, max=117215, avg=2347.43, stdev=6020.86 00:22:04.777 clat (msec): min=4, max=382, avg=160.10, stdev=73.68 00:22:04.777 lat (msec): min=6, max=382, avg=162.44, stdev=74.64 00:22:04.777 clat percentiles (msec): 00:22:04.777 | 1.00th=[ 21], 5.00th=[ 53], 10.00th=[ 73], 20.00th=[ 82], 00:22:04.777 | 30.00th=[ 93], 40.00th=[ 117], 50.00th=[ 182], 60.00th=[ 215], 00:22:04.777 | 70.00th=[ 224], 80.00th=[ 230], 90.00th=[ 239], 95.00th=[ 249], 00:22:04.777 | 99.00th=[ 279], 99.50th=[ 296], 99.90th=[ 372], 99.95th=[ 372], 00:22:04.777 | 99.99th=[ 384] 00:22:04.777 bw ( KiB/s): min=61440, max=203776, per=8.42%, avg=100889.60, stdev=49337.89, samples=20 00:22:04.777 iops : min= 240, max= 796, avg=394.10, stdev=192.73, samples=20 00:22:04.777 lat (msec) : 10=0.07%, 20=0.87%, 50=3.57%, 100=29.60%, 250=61.21% 00:22:04.777 lat (msec) : 500=4.67% 00:22:04.777 cpu : usr=0.85%, sys=1.31%, ctx=1242, majf=0, minf=1 00:22:04.777 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:22:04.777 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:04.777 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:04.777 issued rwts: total=0,4004,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:04.777 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:04.777 job2: (groupid=0, jobs=1): err= 0: pid=4113374: Fri Apr 26 20:39:22 2024 00:22:04.777 write: IOPS=647, BW=162MiB/s (170MB/s)(1629MiB/10071msec); 0 zone resets 00:22:04.777 slat (usec): min=25, max=117052, avg=1392.28, stdev=3317.42 00:22:04.777 clat (msec): min=5, max=256, avg=97.50, stdev=43.90 00:22:04.777 lat (msec): min=7, max=256, avg=98.89, stdev=44.47 00:22:04.777 clat percentiles (msec): 00:22:04.777 | 1.00th=[ 22], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 68], 00:22:04.777 | 30.00th=[ 75], 40.00th=[ 83], 50.00th=[ 87], 60.00th=[ 91], 00:22:04.777 | 70.00th=[ 94], 80.00th=[ 104], 90.00th=[ 180], 95.00th=[ 199], 00:22:04.777 | 99.00th=[ 228], 99.50th=[ 234], 99.90th=[ 245], 99.95th=[ 245], 00:22:04.777 | 99.99th=[ 257] 00:22:04.777 bw ( KiB/s): min=69771, max=243200, per=13.79%, avg=165203.75, stdev=57992.52, samples=20 00:22:04.777 iops : min= 272, max= 950, avg=645.30, stdev=226.58, samples=20 00:22:04.777 lat (msec) : 10=0.15%, 20=0.55%, 50=2.95%, 100=75.09%, 250=21.21% 00:22:04.777 lat (msec) : 500=0.05% 00:22:04.777 cpu : usr=1.51%, sys=1.81%, ctx=2258, majf=0, minf=1 00:22:04.777 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:22:04.777 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:04.777 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:04.777 issued rwts: total=0,6516,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:04.777 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:04.777 job3: (groupid=0, jobs=1): err= 0: pid=4113381: Fri Apr 26 20:39:22 2024 00:22:04.777 write: IOPS=326, BW=81.6MiB/s (85.6MB/s)(822MiB/10077msec); 0 zone resets 00:22:04.777 slat (usec): min=25, max=52682, avg=2976.05, stdev=5738.85 00:22:04.777 clat (msec): min=9, max=277, avg=193.06, stdev=53.80 00:22:04.777 lat (msec): min=12, max=277, avg=196.03, stdev=54.48 00:22:04.777 clat percentiles (msec): 00:22:04.777 | 1.00th=[ 25], 5.00th=[ 68], 10.00th=[ 81], 20.00th=[ 171], 00:22:04.777 | 30.00th=[ 190], 40.00th=[ 203], 50.00th=[ 211], 60.00th=[ 215], 00:22:04.777 | 70.00th=[ 218], 80.00th=[ 224], 90.00th=[ 241], 95.00th=[ 257], 00:22:04.777 | 99.00th=[ 271], 99.50th=[ 275], 99.90th=[ 279], 99.95th=[ 279], 00:22:04.777 | 99.99th=[ 279] 00:22:04.777 bw ( KiB/s): min=59392, max=201728, per=6.89%, avg=82585.60, stdev=29297.05, samples=20 00:22:04.777 iops : min= 232, max= 788, avg=322.60, stdev=114.44, samples=20 00:22:04.777 lat (msec) : 10=0.03%, 20=0.30%, 50=3.50%, 100=6.75%, 250=82.79% 00:22:04.777 lat (msec) : 500=6.63% 00:22:04.777 cpu : usr=0.76%, sys=0.74%, ctx=1004, majf=0, minf=1 00:22:04.777 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=1.0%, >=64=98.1% 00:22:04.777 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:04.777 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:04.777 issued rwts: total=0,3289,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:04.777 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:04.777 job4: (groupid=0, jobs=1): err= 0: pid=4113387: Fri Apr 26 20:39:22 2024 00:22:04.777 write: IOPS=434, BW=109MiB/s (114MB/s)(1105MiB/10174msec); 0 zone resets 00:22:04.777 slat (usec): min=25, max=65345, avg=2096.08, stdev=4748.85 00:22:04.777 clat (msec): min=10, max=364, avg=145.19, stdev=78.01 00:22:04.777 lat (msec): min=10, max=364, avg=147.28, stdev=79.16 00:22:04.777 clat percentiles (msec): 00:22:04.777 | 1.00th=[ 22], 5.00th=[ 60], 10.00th=[ 70], 20.00th=[ 77], 00:22:04.777 | 30.00th=[ 82], 40.00th=[ 87], 50.00th=[ 96], 60.00th=[ 203], 00:22:04.777 | 70.00th=[ 224], 80.00th=[ 236], 90.00th=[ 243], 95.00th=[ 249], 00:22:04.777 | 99.00th=[ 266], 99.50th=[ 288], 99.90th=[ 355], 99.95th=[ 355], 00:22:04.777 | 99.99th=[ 363] 00:22:04.777 bw ( KiB/s): min=63488, max=210944, per=9.30%, avg=111503.40, stdev=59507.84, samples=20 00:22:04.777 iops : min= 248, max= 824, avg=435.55, stdev=232.44, samples=20 00:22:04.777 lat (msec) : 20=0.91%, 50=2.92%, 100=48.77%, 250=43.56%, 500=3.85% 00:22:04.777 cpu : usr=0.93%, sys=1.23%, ctx=1572, majf=0, minf=1 00:22:04.777 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:22:04.777 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:04.777 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:04.777 issued rwts: total=0,4419,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:04.777 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:04.777 job5: (groupid=0, jobs=1): err= 0: pid=4113411: Fri Apr 26 20:39:22 2024 00:22:04.777 write: IOPS=370, BW=92.6MiB/s (97.1MB/s)(942MiB/10174msec); 0 zone resets 00:22:04.777 slat (usec): min=17, max=79371, avg=2541.15, stdev=5275.95 00:22:04.777 clat (msec): min=16, max=358, avg=169.92, stdev=67.62 00:22:04.777 lat (msec): min=16, max=358, avg=172.46, stdev=68.40 00:22:04.777 clat percentiles (msec): 00:22:04.777 | 1.00th=[ 62], 5.00th=[ 72], 10.00th=[ 75], 20.00th=[ 83], 00:22:04.777 | 30.00th=[ 116], 40.00th=[ 153], 50.00th=[ 205], 60.00th=[ 215], 00:22:04.777 | 70.00th=[ 222], 80.00th=[ 228], 90.00th=[ 239], 95.00th=[ 247], 00:22:04.777 | 99.00th=[ 305], 99.50th=[ 326], 99.90th=[ 351], 99.95th=[ 355], 00:22:04.777 | 99.99th=[ 359] 00:22:04.777 bw ( KiB/s): min=65536, max=206336, per=7.91%, avg=94848.00, stdev=46641.24, samples=20 00:22:04.777 iops : min= 256, max= 806, avg=370.50, stdev=182.19, samples=20 00:22:04.777 lat (msec) : 20=0.08%, 100=26.96%, 250=69.09%, 500=3.87% 00:22:04.777 cpu : usr=0.68%, sys=1.11%, ctx=1167, majf=0, minf=1 00:22:04.777 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.3% 00:22:04.777 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:04.777 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:04.777 issued rwts: total=0,3769,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:04.777 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:04.777 job6: (groupid=0, jobs=1): err= 0: pid=4113423: Fri Apr 26 20:39:22 2024 00:22:04.777 write: IOPS=666, BW=167MiB/s (175MB/s)(1681MiB/10085msec); 0 zone resets 00:22:04.777 slat (usec): min=18, max=63386, avg=1357.53, stdev=2943.69 00:22:04.777 clat (msec): min=4, max=287, avg=94.48, stdev=33.05 00:22:04.777 lat (msec): min=6, max=291, avg=95.83, stdev=33.46 00:22:04.777 clat percentiles (msec): 00:22:04.777 | 1.00th=[ 19], 5.00th=[ 50], 10.00th=[ 71], 20.00th=[ 77], 00:22:04.777 | 30.00th=[ 81], 40.00th=[ 85], 50.00th=[ 89], 60.00th=[ 95], 00:22:04.777 | 70.00th=[ 103], 80.00th=[ 112], 90.00th=[ 126], 95.00th=[ 136], 00:22:04.777 | 99.00th=[ 262], 99.50th=[ 271], 99.90th=[ 284], 99.95th=[ 284], 00:22:04.777 | 99.99th=[ 288] 00:22:04.777 bw ( KiB/s): min=83968, max=214016, per=14.23%, avg=170506.45, stdev=37242.10, samples=20 00:22:04.777 iops : min= 328, max= 836, avg=666.00, stdev=145.55, samples=20 00:22:04.777 lat (msec) : 10=0.12%, 20=1.04%, 50=3.94%, 100=62.72%, 250=30.86% 00:22:04.777 lat (msec) : 500=1.31% 00:22:04.777 cpu : usr=1.24%, sys=2.11%, ctx=2273, majf=0, minf=1 00:22:04.777 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:04.777 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:04.777 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:04.777 issued rwts: total=0,6723,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:04.777 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:04.777 job7: (groupid=0, jobs=1): err= 0: pid=4113433: Fri Apr 26 20:39:22 2024 00:22:04.777 write: IOPS=301, BW=75.3MiB/s (78.9MB/s)(766MiB/10175msec); 0 zone resets 00:22:04.777 slat (usec): min=25, max=67079, avg=3262.35, stdev=6116.60 00:22:04.777 clat (msec): min=24, max=347, avg=209.18, stdev=34.43 00:22:04.777 lat (msec): min=24, max=347, avg=212.44, stdev=34.42 00:22:04.777 clat percentiles (msec): 00:22:04.777 | 1.00th=[ 79], 5.00th=[ 155], 10.00th=[ 167], 20.00th=[ 186], 00:22:04.777 | 30.00th=[ 201], 40.00th=[ 207], 50.00th=[ 215], 60.00th=[ 220], 00:22:04.778 | 70.00th=[ 226], 80.00th=[ 236], 90.00th=[ 245], 95.00th=[ 251], 00:22:04.778 | 99.00th=[ 268], 99.50th=[ 300], 99.90th=[ 338], 99.95th=[ 347], 00:22:04.778 | 99.99th=[ 347] 00:22:04.778 bw ( KiB/s): min=63488, max=102400, per=6.41%, avg=76800.00, stdev=9889.06, samples=20 00:22:04.778 iops : min= 248, max= 400, avg=300.00, stdev=38.63, samples=20 00:22:04.778 lat (msec) : 50=0.52%, 100=0.91%, 250=93.02%, 500=5.55% 00:22:04.778 cpu : usr=0.73%, sys=0.96%, ctx=817, majf=0, minf=1 00:22:04.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=0.5%, 32=1.0%, >=64=97.9% 00:22:04.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:04.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:04.778 issued rwts: total=0,3064,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:04.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:04.778 job8: (groupid=0, jobs=1): err= 0: pid=4113460: Fri Apr 26 20:39:22 2024 00:22:04.778 write: IOPS=387, BW=96.8MiB/s (102MB/s)(982MiB/10141msec); 0 zone resets 00:22:04.778 slat (usec): min=21, max=60500, avg=2097.20, stdev=5357.36 00:22:04.778 clat (msec): min=3, max=333, avg=163.08, stdev=75.17 00:22:04.778 lat (msec): min=4, max=333, avg=165.18, stdev=76.31 00:22:04.778 clat percentiles (msec): 00:22:04.778 | 1.00th=[ 9], 5.00th=[ 25], 10.00th=[ 41], 20.00th=[ 88], 00:22:04.778 | 30.00th=[ 112], 40.00th=[ 161], 50.00th=[ 201], 60.00th=[ 213], 00:22:04.778 | 70.00th=[ 220], 80.00th=[ 224], 90.00th=[ 236], 95.00th=[ 243], 00:22:04.778 | 99.00th=[ 284], 99.50th=[ 296], 99.90th=[ 326], 99.95th=[ 334], 00:22:04.778 | 99.99th=[ 334] 00:22:04.778 bw ( KiB/s): min=69632, max=219136, per=8.26%, avg=98932.70, stdev=38935.99, samples=20 00:22:04.778 iops : min= 272, max= 856, avg=386.45, stdev=152.09, samples=20 00:22:04.778 lat (msec) : 4=0.03%, 10=1.17%, 20=2.14%, 50=9.04%, 100=14.79% 00:22:04.778 lat (msec) : 250=69.25%, 500=3.59% 00:22:04.778 cpu : usr=1.05%, sys=1.08%, ctx=1886, majf=0, minf=1 00:22:04.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:22:04.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:04.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:04.778 issued rwts: total=0,3928,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:04.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:04.778 job9: (groupid=0, jobs=1): err= 0: pid=4113474: Fri Apr 26 20:39:22 2024 00:22:04.778 write: IOPS=565, BW=141MiB/s (148MB/s)(1439MiB/10178msec); 0 zone resets 00:22:04.778 slat (usec): min=22, max=161063, avg=1583.32, stdev=4260.77 00:22:04.778 clat (msec): min=5, max=375, avg=111.53, stdev=61.95 00:22:04.778 lat (msec): min=5, max=375, avg=113.12, stdev=62.70 00:22:04.778 clat percentiles (msec): 00:22:04.778 | 1.00th=[ 22], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 75], 00:22:04.778 | 30.00th=[ 80], 40.00th=[ 84], 50.00th=[ 89], 60.00th=[ 94], 00:22:04.778 | 70.00th=[ 102], 80.00th=[ 155], 90.00th=[ 224], 95.00th=[ 259], 00:22:04.778 | 99.00th=[ 288], 99.50th=[ 305], 99.90th=[ 363], 99.95th=[ 363], 00:22:04.778 | 99.99th=[ 376] 00:22:04.778 bw ( KiB/s): min=61440, max=215040, per=12.16%, avg=145734.50, stdev=53772.53, samples=20 00:22:04.778 iops : min= 240, max= 840, avg=569.25, stdev=210.03, samples=20 00:22:04.778 lat (msec) : 10=0.12%, 20=0.54%, 50=3.63%, 100=64.82%, 250=23.96% 00:22:04.778 lat (msec) : 500=6.93% 00:22:04.778 cpu : usr=1.28%, sys=1.69%, ctx=1923, majf=0, minf=1 00:22:04.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:04.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:04.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:04.778 issued rwts: total=0,5756,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:04.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:04.778 job10: (groupid=0, jobs=1): err= 0: pid=4113484: Fri Apr 26 20:39:22 2024 00:22:04.778 write: IOPS=302, BW=75.5MiB/s (79.2MB/s)(768MiB/10173msec); 0 zone resets 00:22:04.778 slat (usec): min=21, max=65843, avg=3251.67, stdev=6019.82 00:22:04.778 clat (msec): min=26, max=357, avg=208.53, stdev=32.84 00:22:04.778 lat (msec): min=26, max=357, avg=211.78, stdev=32.79 00:22:04.778 clat percentiles (msec): 00:22:04.778 | 1.00th=[ 108], 5.00th=[ 153], 10.00th=[ 167], 20.00th=[ 184], 00:22:04.778 | 30.00th=[ 194], 40.00th=[ 207], 50.00th=[ 215], 60.00th=[ 222], 00:22:04.778 | 70.00th=[ 226], 80.00th=[ 236], 90.00th=[ 241], 95.00th=[ 247], 00:22:04.778 | 99.00th=[ 264], 99.50th=[ 305], 99.90th=[ 347], 99.95th=[ 359], 00:22:04.778 | 99.99th=[ 359] 00:22:04.778 bw ( KiB/s): min=63488, max=100352, per=6.43%, avg=77030.40, stdev=9508.49, samples=20 00:22:04.778 iops : min= 248, max= 392, avg=300.90, stdev=37.14, samples=20 00:22:04.778 lat (msec) : 50=0.39%, 100=0.52%, 250=95.74%, 500=3.35% 00:22:04.778 cpu : usr=0.68%, sys=1.03%, ctx=819, majf=0, minf=1 00:22:04.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=0.5%, 32=1.0%, >=64=97.9% 00:22:04.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:04.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:04.778 issued rwts: total=0,3073,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:04.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:04.778 00:22:04.778 Run status group 0 (all jobs): 00:22:04.778 WRITE: bw=1170MiB/s (1227MB/s), 75.3MiB/s-167MiB/s (78.9MB/s-175MB/s), io=11.6GiB (12.5GB), run=10071-10179msec 00:22:04.778 00:22:04.778 Disk stats (read/write): 00:22:04.778 nvme0n1: ios=49/6150, merge=0/0, ticks=108/1223297, in_queue=1223405, util=97.02% 00:22:04.778 nvme10n1: ios=51/7947, merge=0/0, ticks=3550/1184464, in_queue=1188014, util=99.94% 00:22:04.778 nvme1n1: ios=30/12602, merge=0/0, ticks=414/1203136, in_queue=1203550, util=97.65% 00:22:04.778 nvme2n1: ios=23/6202, merge=0/0, ticks=96/1200318, in_queue=1200414, util=97.39% 00:22:04.778 nvme3n1: ios=0/8774, merge=0/0, ticks=0/1227223, in_queue=1227223, util=97.32% 00:22:04.778 nvme4n1: ios=48/7474, merge=0/0, ticks=877/1223993, in_queue=1224870, util=99.98% 00:22:04.778 nvme5n1: ios=48/13082, merge=0/0, ticks=1826/1199404, in_queue=1201230, util=99.99% 00:22:04.778 nvme6n1: ios=0/6063, merge=0/0, ticks=0/1222209, in_queue=1222209, util=98.15% 00:22:04.778 nvme7n1: ios=0/7800, merge=0/0, ticks=0/1233356, in_queue=1233356, util=98.66% 00:22:04.778 nvme8n1: ios=0/11441, merge=0/0, ticks=0/1225296, in_queue=1225296, util=98.90% 00:22:04.778 nvme9n1: ios=0/6083, merge=0/0, ticks=0/1222611, in_queue=1222611, util=99.09% 00:22:04.778 20:39:22 -- target/multiconnection.sh@36 -- # sync 00:22:04.778 20:39:22 -- target/multiconnection.sh@37 -- # seq 1 11 00:22:04.778 20:39:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:04.778 20:39:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:22:04.778 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:22:04.778 20:39:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:22:04.778 20:39:22 -- common/autotest_common.sh@1198 -- # local i=0 00:22:04.778 20:39:22 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:04.778 20:39:22 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK1 00:22:04.778 20:39:22 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:04.778 20:39:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:22:04.778 20:39:22 -- common/autotest_common.sh@1210 -- # return 0 00:22:04.778 20:39:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:04.778 20:39:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:04.778 20:39:22 -- common/autotest_common.sh@10 -- # set +x 00:22:04.778 20:39:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:04.778 20:39:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:04.778 20:39:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:22:05.351 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:22:05.351 20:39:23 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:22:05.351 20:39:23 -- common/autotest_common.sh@1198 -- # local i=0 00:22:05.351 20:39:23 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:05.351 20:39:23 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK2 00:22:05.351 20:39:23 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:05.351 20:39:23 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:22:05.351 20:39:23 -- common/autotest_common.sh@1210 -- # return 0 00:22:05.351 20:39:23 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:05.351 20:39:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:05.351 20:39:23 -- common/autotest_common.sh@10 -- # set +x 00:22:05.351 20:39:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:05.351 20:39:23 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:05.351 20:39:23 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:22:05.612 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:22:05.612 20:39:23 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:22:05.612 20:39:23 -- common/autotest_common.sh@1198 -- # local i=0 00:22:05.612 20:39:23 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:05.612 20:39:23 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK3 00:22:05.612 20:39:23 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:05.612 20:39:23 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:22:05.612 20:39:23 -- common/autotest_common.sh@1210 -- # return 0 00:22:05.612 20:39:23 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:22:05.612 20:39:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:05.612 20:39:23 -- common/autotest_common.sh@10 -- # set +x 00:22:05.612 20:39:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:05.612 20:39:23 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:05.612 20:39:23 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:22:05.874 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:22:05.874 20:39:24 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:22:05.874 20:39:24 -- common/autotest_common.sh@1198 -- # local i=0 00:22:05.874 20:39:24 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:05.874 20:39:24 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK4 00:22:05.874 20:39:24 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:05.874 20:39:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:22:05.874 20:39:24 -- common/autotest_common.sh@1210 -- # return 0 00:22:05.874 20:39:24 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:22:05.874 20:39:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:05.874 20:39:24 -- common/autotest_common.sh@10 -- # set +x 00:22:05.874 20:39:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:05.874 20:39:24 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:05.874 20:39:24 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:22:06.136 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:22:06.136 20:39:24 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:22:06.136 20:39:24 -- common/autotest_common.sh@1198 -- # local i=0 00:22:06.136 20:39:24 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:06.136 20:39:24 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK5 00:22:06.136 20:39:24 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:06.136 20:39:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:22:06.136 20:39:24 -- common/autotest_common.sh@1210 -- # return 0 00:22:06.136 20:39:24 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:22:06.136 20:39:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:06.136 20:39:24 -- common/autotest_common.sh@10 -- # set +x 00:22:06.136 20:39:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:06.136 20:39:24 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:06.136 20:39:24 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:22:06.396 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:22:06.396 20:39:24 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:22:06.396 20:39:24 -- common/autotest_common.sh@1198 -- # local i=0 00:22:06.396 20:39:24 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:06.396 20:39:24 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK6 00:22:06.396 20:39:24 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:06.396 20:39:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:22:06.396 20:39:24 -- common/autotest_common.sh@1210 -- # return 0 00:22:06.396 20:39:24 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:22:06.396 20:39:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:06.397 20:39:24 -- common/autotest_common.sh@10 -- # set +x 00:22:06.397 20:39:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:06.397 20:39:24 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:06.397 20:39:24 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:22:06.686 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:22:06.686 20:39:24 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:22:06.686 20:39:24 -- common/autotest_common.sh@1198 -- # local i=0 00:22:06.686 20:39:24 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:06.686 20:39:24 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK7 00:22:06.686 20:39:24 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:06.686 20:39:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:22:06.686 20:39:24 -- common/autotest_common.sh@1210 -- # return 0 00:22:06.686 20:39:24 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:22:06.686 20:39:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:06.686 20:39:24 -- common/autotest_common.sh@10 -- # set +x 00:22:06.686 20:39:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:06.686 20:39:24 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:06.686 20:39:24 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:22:06.971 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:22:06.971 20:39:25 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:22:06.971 20:39:25 -- common/autotest_common.sh@1198 -- # local i=0 00:22:06.971 20:39:25 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:06.971 20:39:25 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK8 00:22:06.971 20:39:25 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:06.971 20:39:25 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:22:06.971 20:39:25 -- common/autotest_common.sh@1210 -- # return 0 00:22:06.971 20:39:25 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:22:06.971 20:39:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:06.971 20:39:25 -- common/autotest_common.sh@10 -- # set +x 00:22:06.971 20:39:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:06.971 20:39:25 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:06.971 20:39:25 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:22:07.237 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:22:07.237 20:39:25 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:22:07.237 20:39:25 -- common/autotest_common.sh@1198 -- # local i=0 00:22:07.237 20:39:25 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:07.237 20:39:25 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK9 00:22:07.237 20:39:25 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:07.237 20:39:25 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:22:07.237 20:39:25 -- common/autotest_common.sh@1210 -- # return 0 00:22:07.237 20:39:25 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:22:07.237 20:39:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:07.237 20:39:25 -- common/autotest_common.sh@10 -- # set +x 00:22:07.237 20:39:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:07.237 20:39:25 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:07.237 20:39:25 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:22:07.237 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:22:07.237 20:39:25 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:22:07.237 20:39:25 -- common/autotest_common.sh@1198 -- # local i=0 00:22:07.237 20:39:25 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:07.237 20:39:25 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK10 00:22:07.237 20:39:25 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:07.237 20:39:25 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:22:07.237 20:39:25 -- common/autotest_common.sh@1210 -- # return 0 00:22:07.237 20:39:25 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:22:07.237 20:39:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:07.237 20:39:25 -- common/autotest_common.sh@10 -- # set +x 00:22:07.498 20:39:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:07.498 20:39:25 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:07.498 20:39:25 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:22:07.498 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:22:07.498 20:39:25 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:22:07.498 20:39:25 -- common/autotest_common.sh@1198 -- # local i=0 00:22:07.498 20:39:25 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:07.498 20:39:25 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK11 00:22:07.498 20:39:25 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:07.498 20:39:25 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:22:07.498 20:39:25 -- common/autotest_common.sh@1210 -- # return 0 00:22:07.498 20:39:25 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:22:07.498 20:39:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:07.498 20:39:25 -- common/autotest_common.sh@10 -- # set +x 00:22:07.498 20:39:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:07.498 20:39:25 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:22:07.498 20:39:25 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:22:07.498 20:39:25 -- target/multiconnection.sh@47 -- # nvmftestfini 00:22:07.498 20:39:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:07.498 20:39:25 -- nvmf/common.sh@116 -- # sync 00:22:07.498 20:39:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:07.498 20:39:25 -- nvmf/common.sh@119 -- # set +e 00:22:07.498 20:39:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:07.498 20:39:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:07.498 rmmod nvme_tcp 00:22:07.498 rmmod nvme_fabrics 00:22:07.498 rmmod nvme_keyring 00:22:07.498 20:39:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:07.498 20:39:25 -- nvmf/common.sh@123 -- # set -e 00:22:07.498 20:39:25 -- nvmf/common.sh@124 -- # return 0 00:22:07.498 20:39:25 -- nvmf/common.sh@477 -- # '[' -n 4101952 ']' 00:22:07.498 20:39:25 -- nvmf/common.sh@478 -- # killprocess 4101952 00:22:07.498 20:39:25 -- common/autotest_common.sh@926 -- # '[' -z 4101952 ']' 00:22:07.498 20:39:25 -- common/autotest_common.sh@930 -- # kill -0 4101952 00:22:07.498 20:39:25 -- common/autotest_common.sh@931 -- # uname 00:22:07.498 20:39:25 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:07.498 20:39:25 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4101952 00:22:07.759 20:39:25 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:07.759 20:39:25 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:07.759 20:39:25 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4101952' 00:22:07.759 killing process with pid 4101952 00:22:07.759 20:39:25 -- common/autotest_common.sh@945 -- # kill 4101952 00:22:07.759 20:39:25 -- common/autotest_common.sh@950 -- # wait 4101952 00:22:08.020 20:39:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:08.020 20:39:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:08.020 20:39:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:08.020 20:39:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:08.020 20:39:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:08.020 20:39:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:08.020 20:39:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:08.020 20:39:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:09.936 20:39:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:09.936 00:22:09.936 real 1m17.275s 00:22:09.936 user 4m50.606s 00:22:09.936 sys 0m20.084s 00:22:09.936 20:39:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:09.936 20:39:28 -- common/autotest_common.sh@10 -- # set +x 00:22:09.936 ************************************ 00:22:09.936 END TEST nvmf_multiconnection 00:22:09.936 ************************************ 00:22:09.936 20:39:28 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:09.936 20:39:28 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:09.936 20:39:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:09.936 20:39:28 -- common/autotest_common.sh@10 -- # set +x 00:22:09.936 ************************************ 00:22:09.936 START TEST nvmf_initiator_timeout 00:22:09.936 ************************************ 00:22:09.936 20:39:28 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:10.197 * Looking for test storage... 00:22:10.197 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:10.197 20:39:28 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:10.197 20:39:28 -- nvmf/common.sh@7 -- # uname -s 00:22:10.197 20:39:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:10.197 20:39:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:10.197 20:39:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:10.197 20:39:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:10.197 20:39:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:10.197 20:39:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:10.197 20:39:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:10.197 20:39:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:10.197 20:39:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:10.197 20:39:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:10.197 20:39:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:22:10.197 20:39:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:22:10.197 20:39:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:10.197 20:39:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:10.197 20:39:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:10.197 20:39:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:10.197 20:39:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:10.197 20:39:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:10.197 20:39:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:10.197 20:39:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:10.197 20:39:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:10.198 20:39:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:10.198 20:39:28 -- paths/export.sh@5 -- # export PATH 00:22:10.198 20:39:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:10.198 20:39:28 -- nvmf/common.sh@46 -- # : 0 00:22:10.198 20:39:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:10.198 20:39:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:10.198 20:39:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:10.198 20:39:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:10.198 20:39:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:10.198 20:39:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:10.198 20:39:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:10.198 20:39:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:10.198 20:39:28 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:10.198 20:39:28 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:10.198 20:39:28 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:22:10.198 20:39:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:10.198 20:39:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:10.198 20:39:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:10.198 20:39:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:10.198 20:39:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:10.198 20:39:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:10.198 20:39:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:10.198 20:39:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:10.198 20:39:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:10.198 20:39:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:10.198 20:39:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:10.198 20:39:28 -- common/autotest_common.sh@10 -- # set +x 00:22:18.344 20:39:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:18.344 20:39:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:18.344 20:39:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:18.344 20:39:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:18.344 20:39:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:18.344 20:39:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:18.344 20:39:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:18.344 20:39:35 -- nvmf/common.sh@294 -- # net_devs=() 00:22:18.344 20:39:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:18.344 20:39:35 -- nvmf/common.sh@295 -- # e810=() 00:22:18.344 20:39:35 -- nvmf/common.sh@295 -- # local -ga e810 00:22:18.344 20:39:35 -- nvmf/common.sh@296 -- # x722=() 00:22:18.344 20:39:35 -- nvmf/common.sh@296 -- # local -ga x722 00:22:18.344 20:39:35 -- nvmf/common.sh@297 -- # mlx=() 00:22:18.344 20:39:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:18.344 20:39:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:18.344 20:39:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:18.344 20:39:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:18.344 20:39:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:18.344 20:39:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:18.344 20:39:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:18.344 20:39:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:18.344 20:39:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:18.344 20:39:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:18.344 20:39:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:18.344 20:39:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:18.344 20:39:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:18.344 20:39:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:18.345 20:39:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:18.345 20:39:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:18.345 20:39:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:22:18.345 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:22:18.345 20:39:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:18.345 20:39:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:22:18.345 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:22:18.345 20:39:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:18.345 20:39:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:18.345 20:39:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:18.345 20:39:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:18.345 20:39:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:18.345 20:39:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:22:18.345 Found net devices under 0000:4b:00.0: cvl_0_0 00:22:18.345 20:39:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:18.345 20:39:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:18.345 20:39:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:18.345 20:39:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:18.345 20:39:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:18.345 20:39:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:22:18.345 Found net devices under 0000:4b:00.1: cvl_0_1 00:22:18.345 20:39:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:18.345 20:39:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:18.345 20:39:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:18.345 20:39:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:18.345 20:39:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:18.345 20:39:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:18.345 20:39:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:18.345 20:39:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:18.345 20:39:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:18.345 20:39:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:18.345 20:39:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:18.345 20:39:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:18.345 20:39:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:18.345 20:39:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:18.345 20:39:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:18.345 20:39:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:18.345 20:39:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:18.345 20:39:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:18.345 20:39:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:18.345 20:39:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:18.345 20:39:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:18.345 20:39:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:18.345 20:39:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:18.345 20:39:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:18.345 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:18.345 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.591 ms 00:22:18.345 00:22:18.345 --- 10.0.0.2 ping statistics --- 00:22:18.345 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:18.345 rtt min/avg/max/mdev = 0.591/0.591/0.591/0.000 ms 00:22:18.345 20:39:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:18.345 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:18.345 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.283 ms 00:22:18.345 00:22:18.345 --- 10.0.0.1 ping statistics --- 00:22:18.345 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:18.345 rtt min/avg/max/mdev = 0.283/0.283/0.283/0.000 ms 00:22:18.345 20:39:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:18.345 20:39:35 -- nvmf/common.sh@410 -- # return 0 00:22:18.345 20:39:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:18.345 20:39:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:18.345 20:39:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:18.345 20:39:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:18.345 20:39:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:18.345 20:39:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:18.345 20:39:35 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:22:18.345 20:39:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:18.345 20:39:35 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:18.345 20:39:35 -- common/autotest_common.sh@10 -- # set +x 00:22:18.345 20:39:35 -- nvmf/common.sh@469 -- # nvmfpid=4120422 00:22:18.345 20:39:35 -- nvmf/common.sh@470 -- # waitforlisten 4120422 00:22:18.345 20:39:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:18.345 20:39:35 -- common/autotest_common.sh@819 -- # '[' -z 4120422 ']' 00:22:18.345 20:39:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:18.345 20:39:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:18.345 20:39:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:18.345 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:18.345 20:39:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:18.345 20:39:35 -- common/autotest_common.sh@10 -- # set +x 00:22:18.345 [2024-04-26 20:39:35.634610] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:22:18.345 [2024-04-26 20:39:35.634660] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:18.345 EAL: No free 2048 kB hugepages reported on node 1 00:22:18.345 [2024-04-26 20:39:35.701416] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:18.345 [2024-04-26 20:39:35.767182] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:18.345 [2024-04-26 20:39:35.767323] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:18.345 [2024-04-26 20:39:35.767335] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:18.345 [2024-04-26 20:39:35.767343] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:18.345 [2024-04-26 20:39:35.767582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:18.345 [2024-04-26 20:39:35.767760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:18.345 [2024-04-26 20:39:35.767890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:18.345 [2024-04-26 20:39:35.767894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:18.345 20:39:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:18.345 20:39:36 -- common/autotest_common.sh@852 -- # return 0 00:22:18.345 20:39:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:18.345 20:39:36 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:18.345 20:39:36 -- common/autotest_common.sh@10 -- # set +x 00:22:18.345 20:39:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:18.345 20:39:36 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:22:18.345 20:39:36 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:18.345 20:39:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:18.345 20:39:36 -- common/autotest_common.sh@10 -- # set +x 00:22:18.345 Malloc0 00:22:18.345 20:39:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:18.345 20:39:36 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:22:18.345 20:39:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:18.345 20:39:36 -- common/autotest_common.sh@10 -- # set +x 00:22:18.345 Delay0 00:22:18.345 20:39:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:18.345 20:39:36 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:18.345 20:39:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:18.345 20:39:36 -- common/autotest_common.sh@10 -- # set +x 00:22:18.345 [2024-04-26 20:39:36.478731] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:18.345 20:39:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:18.345 20:39:36 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:22:18.345 20:39:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:18.345 20:39:36 -- common/autotest_common.sh@10 -- # set +x 00:22:18.345 20:39:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:18.345 20:39:36 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:22:18.345 20:39:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:18.345 20:39:36 -- common/autotest_common.sh@10 -- # set +x 00:22:18.345 20:39:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:18.345 20:39:36 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:18.345 20:39:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:18.345 20:39:36 -- common/autotest_common.sh@10 -- # set +x 00:22:18.346 [2024-04-26 20:39:36.519017] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:18.346 20:39:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:18.346 20:39:36 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:19.732 20:39:37 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:22:19.732 20:39:37 -- common/autotest_common.sh@1177 -- # local i=0 00:22:19.732 20:39:37 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:19.732 20:39:37 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:19.732 20:39:37 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:21.649 20:39:39 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:21.649 20:39:39 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:21.649 20:39:39 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:22:21.949 20:39:40 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:21.949 20:39:40 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:21.949 20:39:40 -- common/autotest_common.sh@1187 -- # return 0 00:22:21.949 20:39:40 -- target/initiator_timeout.sh@35 -- # fio_pid=4121244 00:22:21.949 20:39:40 -- target/initiator_timeout.sh@37 -- # sleep 3 00:22:21.949 20:39:40 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:22:21.949 [global] 00:22:21.949 thread=1 00:22:21.949 invalidate=1 00:22:21.949 rw=write 00:22:21.949 time_based=1 00:22:21.949 runtime=60 00:22:21.949 ioengine=libaio 00:22:21.949 direct=1 00:22:21.949 bs=4096 00:22:21.949 iodepth=1 00:22:21.949 norandommap=0 00:22:21.949 numjobs=1 00:22:21.949 00:22:21.949 verify_dump=1 00:22:21.949 verify_backlog=512 00:22:21.949 verify_state_save=0 00:22:21.949 do_verify=1 00:22:21.949 verify=crc32c-intel 00:22:21.949 [job0] 00:22:21.949 filename=/dev/nvme0n1 00:22:21.949 Could not set queue depth (nvme0n1) 00:22:22.218 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:22:22.218 fio-3.35 00:22:22.218 Starting 1 thread 00:22:24.768 20:39:43 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:22:24.768 20:39:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:24.768 20:39:43 -- common/autotest_common.sh@10 -- # set +x 00:22:24.768 true 00:22:24.768 20:39:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:24.768 20:39:43 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:22:24.768 20:39:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:24.768 20:39:43 -- common/autotest_common.sh@10 -- # set +x 00:22:24.768 true 00:22:24.768 20:39:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:24.768 20:39:43 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:22:24.768 20:39:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:24.768 20:39:43 -- common/autotest_common.sh@10 -- # set +x 00:22:24.768 true 00:22:24.768 20:39:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:24.768 20:39:43 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:22:24.768 20:39:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:24.768 20:39:43 -- common/autotest_common.sh@10 -- # set +x 00:22:24.768 true 00:22:24.768 20:39:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:24.768 20:39:43 -- target/initiator_timeout.sh@45 -- # sleep 3 00:22:28.070 20:39:46 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:22:28.070 20:39:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:28.070 20:39:46 -- common/autotest_common.sh@10 -- # set +x 00:22:28.070 true 00:22:28.070 20:39:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:28.070 20:39:46 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:22:28.070 20:39:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:28.070 20:39:46 -- common/autotest_common.sh@10 -- # set +x 00:22:28.070 true 00:22:28.070 20:39:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:28.070 20:39:46 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:22:28.070 20:39:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:28.070 20:39:46 -- common/autotest_common.sh@10 -- # set +x 00:22:28.070 true 00:22:28.070 20:39:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:28.070 20:39:46 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:22:28.070 20:39:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:28.070 20:39:46 -- common/autotest_common.sh@10 -- # set +x 00:22:28.070 true 00:22:28.070 20:39:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:28.070 20:39:46 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:22:28.070 20:39:46 -- target/initiator_timeout.sh@54 -- # wait 4121244 00:23:24.343 00:23:24.343 job0: (groupid=0, jobs=1): err= 0: pid=4121439: Fri Apr 26 20:40:40 2024 00:23:24.343 read: IOPS=7, BW=28.6KiB/s (29.3kB/s)(1716KiB/60024msec) 00:23:24.343 slat (usec): min=7, max=217, avg=25.63, stdev= 9.36 00:23:24.343 clat (usec): min=1199, max=41817k, avg=138772.77, stdev=2016926.84 00:23:24.343 lat (usec): min=1228, max=41817k, avg=138798.40, stdev=2016926.78 00:23:24.343 clat percentiles (usec): 00:23:24.343 | 1.00th=[ 1434], 5.00th=[ 41681], 10.00th=[ 41681], 00:23:24.343 | 20.00th=[ 41681], 30.00th=[ 42206], 40.00th=[ 42206], 00:23:24.343 | 50.00th=[ 42206], 60.00th=[ 42206], 70.00th=[ 42206], 00:23:24.343 | 80.00th=[ 42206], 90.00th=[ 42206], 95.00th=[ 42206], 00:23:24.343 | 99.00th=[ 42206], 99.50th=[ 42730], 99.90th=[17112761], 00:23:24.343 | 99.95th=[17112761], 99.99th=[17112761] 00:23:24.343 write: IOPS=8, BW=34.1KiB/s (34.9kB/s)(2048KiB/60024msec); 0 zone resets 00:23:24.343 slat (nsec): min=10424, max=67723, avg=30960.39, stdev=5648.17 00:23:24.343 clat (usec): min=577, max=1075, avg=889.02, stdev=70.65 00:23:24.343 lat (usec): min=607, max=1106, avg=919.98, stdev=72.17 00:23:24.343 clat percentiles (usec): 00:23:24.343 | 1.00th=[ 709], 5.00th=[ 758], 10.00th=[ 791], 20.00th=[ 832], 00:23:24.343 | 30.00th=[ 857], 40.00th=[ 881], 50.00th=[ 906], 60.00th=[ 914], 00:23:24.343 | 70.00th=[ 930], 80.00th=[ 947], 90.00th=[ 963], 95.00th=[ 988], 00:23:24.343 | 99.00th=[ 1037], 99.50th=[ 1045], 99.90th=[ 1074], 99.95th=[ 1074], 00:23:24.343 | 99.99th=[ 1074] 00:23:24.343 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:23:24.343 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:23:24.343 lat (usec) : 750=2.13%, 1000=49.95% 00:23:24.343 lat (msec) : 2=2.98%, 50=44.85%, >=2000=0.11% 00:23:24.343 cpu : usr=0.04%, sys=0.03%, ctx=942, majf=0, minf=1 00:23:24.343 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:24.343 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:24.343 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:24.344 issued rwts: total=429,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:24.344 latency : target=0, window=0, percentile=100.00%, depth=1 00:23:24.344 00:23:24.344 Run status group 0 (all jobs): 00:23:24.344 READ: bw=28.6KiB/s (29.3kB/s), 28.6KiB/s-28.6KiB/s (29.3kB/s-29.3kB/s), io=1716KiB (1757kB), run=60024-60024msec 00:23:24.344 WRITE: bw=34.1KiB/s (34.9kB/s), 34.1KiB/s-34.1KiB/s (34.9kB/s-34.9kB/s), io=2048KiB (2097kB), run=60024-60024msec 00:23:24.344 00:23:24.344 Disk stats (read/write): 00:23:24.344 nvme0n1: ios=524/512, merge=0/0, ticks=18927/416, in_queue=19343, util=99.64% 00:23:24.344 20:40:40 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:24.344 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:24.344 20:40:40 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:23:24.344 20:40:40 -- common/autotest_common.sh@1198 -- # local i=0 00:23:24.344 20:40:40 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:24.344 20:40:40 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:24.344 20:40:40 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:24.344 20:40:40 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:24.344 20:40:40 -- common/autotest_common.sh@1210 -- # return 0 00:23:24.344 20:40:40 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:23:24.344 20:40:40 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:23:24.344 nvmf hotplug test: fio successful as expected 00:23:24.344 20:40:40 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:24.344 20:40:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:24.344 20:40:40 -- common/autotest_common.sh@10 -- # set +x 00:23:24.344 20:40:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:24.344 20:40:40 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:23:24.344 20:40:40 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:23:24.344 20:40:40 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:23:24.344 20:40:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:24.344 20:40:40 -- nvmf/common.sh@116 -- # sync 00:23:24.344 20:40:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:24.344 20:40:40 -- nvmf/common.sh@119 -- # set +e 00:23:24.344 20:40:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:24.344 20:40:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:24.344 rmmod nvme_tcp 00:23:24.344 rmmod nvme_fabrics 00:23:24.344 rmmod nvme_keyring 00:23:24.344 20:40:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:24.344 20:40:40 -- nvmf/common.sh@123 -- # set -e 00:23:24.344 20:40:40 -- nvmf/common.sh@124 -- # return 0 00:23:24.344 20:40:40 -- nvmf/common.sh@477 -- # '[' -n 4120422 ']' 00:23:24.344 20:40:40 -- nvmf/common.sh@478 -- # killprocess 4120422 00:23:24.344 20:40:40 -- common/autotest_common.sh@926 -- # '[' -z 4120422 ']' 00:23:24.344 20:40:40 -- common/autotest_common.sh@930 -- # kill -0 4120422 00:23:24.344 20:40:40 -- common/autotest_common.sh@931 -- # uname 00:23:24.344 20:40:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:24.344 20:40:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4120422 00:23:24.344 20:40:40 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:24.344 20:40:40 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:24.344 20:40:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4120422' 00:23:24.344 killing process with pid 4120422 00:23:24.344 20:40:40 -- common/autotest_common.sh@945 -- # kill 4120422 00:23:24.344 20:40:40 -- common/autotest_common.sh@950 -- # wait 4120422 00:23:24.344 20:40:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:24.344 20:40:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:24.344 20:40:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:24.344 20:40:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:24.344 20:40:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:24.344 20:40:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:24.344 20:40:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:24.344 20:40:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:24.916 20:40:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:24.916 00:23:24.916 real 1m14.801s 00:23:24.916 user 4m39.579s 00:23:24.916 sys 0m6.800s 00:23:24.916 20:40:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:24.916 20:40:43 -- common/autotest_common.sh@10 -- # set +x 00:23:24.916 ************************************ 00:23:24.916 END TEST nvmf_initiator_timeout 00:23:24.916 ************************************ 00:23:24.916 20:40:43 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:23:24.916 20:40:43 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:23:24.916 20:40:43 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:23:24.916 20:40:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:24.916 20:40:43 -- common/autotest_common.sh@10 -- # set +x 00:23:33.066 20:40:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:33.066 20:40:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:33.066 20:40:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:33.066 20:40:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:33.066 20:40:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:33.066 20:40:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:33.066 20:40:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:33.066 20:40:49 -- nvmf/common.sh@294 -- # net_devs=() 00:23:33.066 20:40:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:33.066 20:40:49 -- nvmf/common.sh@295 -- # e810=() 00:23:33.066 20:40:49 -- nvmf/common.sh@295 -- # local -ga e810 00:23:33.066 20:40:49 -- nvmf/common.sh@296 -- # x722=() 00:23:33.066 20:40:49 -- nvmf/common.sh@296 -- # local -ga x722 00:23:33.066 20:40:49 -- nvmf/common.sh@297 -- # mlx=() 00:23:33.066 20:40:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:33.066 20:40:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:33.066 20:40:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:33.066 20:40:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:33.066 20:40:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:33.066 20:40:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:33.066 20:40:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:33.066 20:40:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:33.066 20:40:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:33.066 20:40:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:33.066 20:40:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:33.066 20:40:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:33.066 20:40:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:33.066 20:40:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:33.066 20:40:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:33.066 20:40:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:33.066 20:40:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:23:33.066 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:23:33.066 20:40:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:33.066 20:40:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:23:33.066 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:23:33.066 20:40:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:33.066 20:40:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:33.066 20:40:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:33.066 20:40:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:33.066 20:40:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:33.066 20:40:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:33.066 20:40:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:23:33.066 Found net devices under 0000:4b:00.0: cvl_0_0 00:23:33.066 20:40:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:33.066 20:40:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:33.066 20:40:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:33.066 20:40:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:33.066 20:40:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:33.066 20:40:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:23:33.066 Found net devices under 0000:4b:00.1: cvl_0_1 00:23:33.066 20:40:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:33.066 20:40:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:33.066 20:40:49 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:33.066 20:40:49 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:23:33.066 20:40:49 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:23:33.066 20:40:49 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:23:33.066 20:40:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:23:33.066 20:40:49 -- common/autotest_common.sh@10 -- # set +x 00:23:33.066 ************************************ 00:23:33.066 START TEST nvmf_perf_adq 00:23:33.066 ************************************ 00:23:33.066 20:40:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:23:33.066 * Looking for test storage... 00:23:33.066 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:33.066 20:40:50 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:33.066 20:40:50 -- nvmf/common.sh@7 -- # uname -s 00:23:33.066 20:40:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:33.066 20:40:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:33.066 20:40:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:33.066 20:40:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:33.066 20:40:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:33.066 20:40:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:33.066 20:40:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:33.066 20:40:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:33.066 20:40:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:33.066 20:40:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:33.066 20:40:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:33.066 20:40:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:33.066 20:40:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:33.066 20:40:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:33.066 20:40:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:33.066 20:40:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:33.066 20:40:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:33.066 20:40:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:33.066 20:40:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:33.066 20:40:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:33.066 20:40:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:33.066 20:40:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:33.066 20:40:50 -- paths/export.sh@5 -- # export PATH 00:23:33.066 20:40:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:33.066 20:40:50 -- nvmf/common.sh@46 -- # : 0 00:23:33.066 20:40:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:33.066 20:40:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:33.066 20:40:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:33.066 20:40:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:33.066 20:40:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:33.066 20:40:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:33.066 20:40:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:33.066 20:40:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:33.066 20:40:50 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:23:33.066 20:40:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:33.066 20:40:50 -- common/autotest_common.sh@10 -- # set +x 00:23:39.659 20:40:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:39.659 20:40:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:39.659 20:40:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:39.659 20:40:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:39.659 20:40:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:39.659 20:40:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:39.659 20:40:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:39.659 20:40:56 -- nvmf/common.sh@294 -- # net_devs=() 00:23:39.659 20:40:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:39.659 20:40:56 -- nvmf/common.sh@295 -- # e810=() 00:23:39.659 20:40:56 -- nvmf/common.sh@295 -- # local -ga e810 00:23:39.659 20:40:56 -- nvmf/common.sh@296 -- # x722=() 00:23:39.659 20:40:56 -- nvmf/common.sh@296 -- # local -ga x722 00:23:39.659 20:40:56 -- nvmf/common.sh@297 -- # mlx=() 00:23:39.659 20:40:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:39.659 20:40:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:39.659 20:40:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:39.659 20:40:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:39.659 20:40:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:39.659 20:40:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:39.659 20:40:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:39.659 20:40:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:39.659 20:40:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:39.659 20:40:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:39.659 20:40:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:39.659 20:40:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:39.659 20:40:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:39.659 20:40:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:39.659 20:40:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:39.659 20:40:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:39.659 20:40:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:39.659 20:40:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:39.659 20:40:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:39.659 20:40:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:23:39.659 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:23:39.659 20:40:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:39.659 20:40:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:39.659 20:40:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:39.659 20:40:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:39.659 20:40:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:39.659 20:40:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:39.659 20:40:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:23:39.659 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:23:39.659 20:40:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:39.659 20:40:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:39.659 20:40:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:39.659 20:40:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:39.660 20:40:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:39.660 20:40:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:39.660 20:40:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:39.660 20:40:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:39.660 20:40:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:39.660 20:40:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:39.660 20:40:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:39.660 20:40:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:39.660 20:40:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:23:39.660 Found net devices under 0000:4b:00.0: cvl_0_0 00:23:39.660 20:40:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:39.660 20:40:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:39.660 20:40:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:39.660 20:40:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:39.660 20:40:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:39.660 20:40:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:23:39.660 Found net devices under 0000:4b:00.1: cvl_0_1 00:23:39.660 20:40:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:39.660 20:40:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:39.660 20:40:56 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:39.660 20:40:56 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:23:39.660 20:40:56 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:23:39.660 20:40:56 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:23:39.660 20:40:56 -- target/perf_adq.sh@52 -- # rmmod ice 00:23:40.232 20:40:58 -- target/perf_adq.sh@53 -- # modprobe ice 00:23:42.199 20:41:00 -- target/perf_adq.sh@54 -- # sleep 5 00:23:47.496 20:41:05 -- target/perf_adq.sh@67 -- # nvmftestinit 00:23:47.496 20:41:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:47.496 20:41:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:47.496 20:41:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:47.496 20:41:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:47.496 20:41:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:47.496 20:41:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:47.496 20:41:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:47.496 20:41:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:47.496 20:41:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:47.497 20:41:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:47.497 20:41:05 -- common/autotest_common.sh@10 -- # set +x 00:23:47.497 20:41:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:47.497 20:41:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:47.497 20:41:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:47.497 20:41:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:47.497 20:41:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:47.497 20:41:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:47.497 20:41:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:47.497 20:41:05 -- nvmf/common.sh@294 -- # net_devs=() 00:23:47.497 20:41:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:47.497 20:41:05 -- nvmf/common.sh@295 -- # e810=() 00:23:47.497 20:41:05 -- nvmf/common.sh@295 -- # local -ga e810 00:23:47.497 20:41:05 -- nvmf/common.sh@296 -- # x722=() 00:23:47.497 20:41:05 -- nvmf/common.sh@296 -- # local -ga x722 00:23:47.497 20:41:05 -- nvmf/common.sh@297 -- # mlx=() 00:23:47.497 20:41:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:47.497 20:41:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:47.497 20:41:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:47.497 20:41:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:47.497 20:41:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:47.497 20:41:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:47.497 20:41:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:47.497 20:41:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:47.497 20:41:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:47.497 20:41:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:47.497 20:41:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:47.497 20:41:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:47.497 20:41:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:47.497 20:41:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:47.497 20:41:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:47.497 20:41:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:47.497 20:41:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:23:47.497 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:23:47.497 20:41:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:47.497 20:41:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:23:47.497 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:23:47.497 20:41:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:47.497 20:41:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:47.497 20:41:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:47.497 20:41:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:47.497 20:41:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:47.497 20:41:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:23:47.497 Found net devices under 0000:4b:00.0: cvl_0_0 00:23:47.497 20:41:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:47.497 20:41:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:47.497 20:41:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:47.497 20:41:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:47.497 20:41:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:47.497 20:41:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:23:47.497 Found net devices under 0000:4b:00.1: cvl_0_1 00:23:47.497 20:41:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:47.497 20:41:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:47.497 20:41:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:47.497 20:41:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:47.497 20:41:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:47.497 20:41:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:47.497 20:41:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:47.497 20:41:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:47.497 20:41:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:47.497 20:41:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:47.497 20:41:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:47.497 20:41:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:47.497 20:41:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:47.497 20:41:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:47.497 20:41:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:47.497 20:41:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:47.497 20:41:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:47.497 20:41:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:47.497 20:41:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:47.497 20:41:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:47.497 20:41:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:47.497 20:41:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:47.497 20:41:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:47.497 20:41:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:47.497 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:47.497 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.608 ms 00:23:47.497 00:23:47.497 --- 10.0.0.2 ping statistics --- 00:23:47.497 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:47.497 rtt min/avg/max/mdev = 0.608/0.608/0.608/0.000 ms 00:23:47.497 20:41:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:47.497 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:47.497 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.377 ms 00:23:47.497 00:23:47.497 --- 10.0.0.1 ping statistics --- 00:23:47.497 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:47.497 rtt min/avg/max/mdev = 0.377/0.377/0.377/0.000 ms 00:23:47.497 20:41:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:47.497 20:41:05 -- nvmf/common.sh@410 -- # return 0 00:23:47.497 20:41:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:47.497 20:41:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:47.497 20:41:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:47.497 20:41:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:47.497 20:41:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:47.497 20:41:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:47.497 20:41:05 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:23:47.497 20:41:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:47.497 20:41:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:23:47.497 20:41:05 -- common/autotest_common.sh@10 -- # set +x 00:23:47.497 20:41:05 -- nvmf/common.sh@469 -- # nvmfpid=4142920 00:23:47.497 20:41:05 -- nvmf/common.sh@470 -- # waitforlisten 4142920 00:23:47.497 20:41:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:23:47.497 20:41:05 -- common/autotest_common.sh@819 -- # '[' -z 4142920 ']' 00:23:47.497 20:41:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:47.497 20:41:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:23:47.497 20:41:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:47.497 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:47.497 20:41:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:23:47.497 20:41:05 -- common/autotest_common.sh@10 -- # set +x 00:23:47.497 [2024-04-26 20:41:05.655986] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:23:47.497 [2024-04-26 20:41:05.656048] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:47.497 EAL: No free 2048 kB hugepages reported on node 1 00:23:47.497 [2024-04-26 20:41:05.725992] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:47.497 [2024-04-26 20:41:05.798910] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:47.497 [2024-04-26 20:41:05.799044] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:47.497 [2024-04-26 20:41:05.799054] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:47.497 [2024-04-26 20:41:05.799066] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:47.497 [2024-04-26 20:41:05.799232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:47.497 [2024-04-26 20:41:05.799341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:47.497 [2024-04-26 20:41:05.799420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:47.497 [2024-04-26 20:41:05.799423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:48.443 20:41:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:23:48.443 20:41:06 -- common/autotest_common.sh@852 -- # return 0 00:23:48.443 20:41:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:48.443 20:41:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:23:48.443 20:41:06 -- common/autotest_common.sh@10 -- # set +x 00:23:48.443 20:41:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:48.443 20:41:06 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:23:48.443 20:41:06 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:23:48.443 20:41:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.443 20:41:06 -- common/autotest_common.sh@10 -- # set +x 00:23:48.443 20:41:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:48.443 20:41:06 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:23:48.443 20:41:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.443 20:41:06 -- common/autotest_common.sh@10 -- # set +x 00:23:48.443 20:41:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:48.443 20:41:06 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:23:48.443 20:41:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.443 20:41:06 -- common/autotest_common.sh@10 -- # set +x 00:23:48.443 [2024-04-26 20:41:06.566218] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:48.443 20:41:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:48.443 20:41:06 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:48.443 20:41:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.443 20:41:06 -- common/autotest_common.sh@10 -- # set +x 00:23:48.443 Malloc1 00:23:48.443 20:41:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:48.443 20:41:06 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:48.443 20:41:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.443 20:41:06 -- common/autotest_common.sh@10 -- # set +x 00:23:48.443 20:41:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:48.443 20:41:06 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:23:48.443 20:41:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.443 20:41:06 -- common/autotest_common.sh@10 -- # set +x 00:23:48.443 20:41:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:48.443 20:41:06 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:48.443 20:41:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:48.443 20:41:06 -- common/autotest_common.sh@10 -- # set +x 00:23:48.443 [2024-04-26 20:41:06.621568] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:48.443 20:41:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:48.443 20:41:06 -- target/perf_adq.sh@73 -- # perfpid=4143085 00:23:48.443 20:41:06 -- target/perf_adq.sh@74 -- # sleep 2 00:23:48.443 20:41:06 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:23:48.443 EAL: No free 2048 kB hugepages reported on node 1 00:23:50.359 20:41:08 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:23:50.359 20:41:08 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:23:50.359 20:41:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:50.359 20:41:08 -- target/perf_adq.sh@76 -- # wc -l 00:23:50.359 20:41:08 -- common/autotest_common.sh@10 -- # set +x 00:23:50.359 20:41:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:50.359 20:41:08 -- target/perf_adq.sh@76 -- # count=4 00:23:50.359 20:41:08 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:23:50.359 20:41:08 -- target/perf_adq.sh@81 -- # wait 4143085 00:23:58.499 Initializing NVMe Controllers 00:23:58.499 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:58.499 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:23:58.499 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:23:58.499 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:23:58.499 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:23:58.499 Initialization complete. Launching workers. 00:23:58.499 ======================================================== 00:23:58.499 Latency(us) 00:23:58.499 Device Information : IOPS MiB/s Average min max 00:23:58.499 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11044.20 43.14 5795.12 1980.59 9417.67 00:23:58.499 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 17221.50 67.27 3715.74 924.65 9843.22 00:23:58.500 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11246.10 43.93 5690.60 1905.66 9966.08 00:23:58.500 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10231.10 39.97 6254.78 3605.96 11770.96 00:23:58.500 ======================================================== 00:23:58.500 Total : 49742.90 194.31 5146.13 924.65 11770.96 00:23:58.500 00:23:58.500 20:41:16 -- target/perf_adq.sh@82 -- # nvmftestfini 00:23:58.500 20:41:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:58.500 20:41:16 -- nvmf/common.sh@116 -- # sync 00:23:58.500 20:41:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:58.500 20:41:16 -- nvmf/common.sh@119 -- # set +e 00:23:58.500 20:41:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:58.500 20:41:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:58.500 rmmod nvme_tcp 00:23:58.500 rmmod nvme_fabrics 00:23:58.500 rmmod nvme_keyring 00:23:58.500 20:41:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:58.761 20:41:16 -- nvmf/common.sh@123 -- # set -e 00:23:58.761 20:41:16 -- nvmf/common.sh@124 -- # return 0 00:23:58.761 20:41:16 -- nvmf/common.sh@477 -- # '[' -n 4142920 ']' 00:23:58.761 20:41:16 -- nvmf/common.sh@478 -- # killprocess 4142920 00:23:58.761 20:41:16 -- common/autotest_common.sh@926 -- # '[' -z 4142920 ']' 00:23:58.761 20:41:16 -- common/autotest_common.sh@930 -- # kill -0 4142920 00:23:58.761 20:41:16 -- common/autotest_common.sh@931 -- # uname 00:23:58.761 20:41:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:58.761 20:41:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4142920 00:23:58.761 20:41:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:58.761 20:41:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:58.761 20:41:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4142920' 00:23:58.761 killing process with pid 4142920 00:23:58.761 20:41:16 -- common/autotest_common.sh@945 -- # kill 4142920 00:23:58.761 20:41:16 -- common/autotest_common.sh@950 -- # wait 4142920 00:23:58.761 20:41:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:58.761 20:41:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:58.761 20:41:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:58.761 20:41:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:58.761 20:41:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:58.761 20:41:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:58.761 20:41:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:58.761 20:41:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:01.311 20:41:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:01.311 20:41:19 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:01.311 20:41:19 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:02.696 20:41:20 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:04.082 20:41:22 -- target/perf_adq.sh@54 -- # sleep 5 00:24:09.388 20:41:27 -- target/perf_adq.sh@87 -- # nvmftestinit 00:24:09.388 20:41:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:09.388 20:41:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:09.388 20:41:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:09.388 20:41:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:09.388 20:41:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:09.388 20:41:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:09.388 20:41:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:09.388 20:41:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:09.388 20:41:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:09.388 20:41:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:09.388 20:41:27 -- common/autotest_common.sh@10 -- # set +x 00:24:09.388 20:41:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:09.388 20:41:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:09.388 20:41:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:09.388 20:41:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:09.388 20:41:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:09.388 20:41:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:09.388 20:41:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:09.388 20:41:27 -- nvmf/common.sh@294 -- # net_devs=() 00:24:09.388 20:41:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:09.388 20:41:27 -- nvmf/common.sh@295 -- # e810=() 00:24:09.388 20:41:27 -- nvmf/common.sh@295 -- # local -ga e810 00:24:09.388 20:41:27 -- nvmf/common.sh@296 -- # x722=() 00:24:09.388 20:41:27 -- nvmf/common.sh@296 -- # local -ga x722 00:24:09.388 20:41:27 -- nvmf/common.sh@297 -- # mlx=() 00:24:09.388 20:41:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:09.388 20:41:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:09.388 20:41:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:09.388 20:41:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:09.388 20:41:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:09.388 20:41:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:09.388 20:41:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:09.388 20:41:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:09.388 20:41:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:09.388 20:41:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:09.388 20:41:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:09.388 20:41:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:09.388 20:41:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:09.388 20:41:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:09.388 20:41:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:09.388 20:41:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:09.388 20:41:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:24:09.388 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:24:09.388 20:41:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:09.388 20:41:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:24:09.388 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:24:09.388 20:41:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:09.388 20:41:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:09.388 20:41:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:09.388 20:41:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:09.388 20:41:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:09.388 20:41:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:24:09.388 Found net devices under 0000:4b:00.0: cvl_0_0 00:24:09.388 20:41:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:09.388 20:41:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:09.388 20:41:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:09.388 20:41:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:09.388 20:41:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:09.388 20:41:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:24:09.388 Found net devices under 0000:4b:00.1: cvl_0_1 00:24:09.388 20:41:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:09.388 20:41:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:09.388 20:41:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:09.388 20:41:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:09.388 20:41:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:09.388 20:41:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:09.388 20:41:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:09.388 20:41:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:09.388 20:41:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:09.388 20:41:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:09.388 20:41:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:09.388 20:41:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:09.388 20:41:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:09.388 20:41:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:09.388 20:41:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:09.388 20:41:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:09.388 20:41:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:09.388 20:41:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:09.388 20:41:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:09.388 20:41:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:09.388 20:41:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:09.388 20:41:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:09.388 20:41:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:09.388 20:41:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:09.650 20:41:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:09.650 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:09.650 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.714 ms 00:24:09.650 00:24:09.650 --- 10.0.0.2 ping statistics --- 00:24:09.650 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:09.650 rtt min/avg/max/mdev = 0.714/0.714/0.714/0.000 ms 00:24:09.650 20:41:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:09.650 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:09.650 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.356 ms 00:24:09.650 00:24:09.650 --- 10.0.0.1 ping statistics --- 00:24:09.650 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:09.650 rtt min/avg/max/mdev = 0.356/0.356/0.356/0.000 ms 00:24:09.650 20:41:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:09.650 20:41:27 -- nvmf/common.sh@410 -- # return 0 00:24:09.650 20:41:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:09.650 20:41:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:09.650 20:41:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:09.650 20:41:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:09.650 20:41:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:09.650 20:41:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:09.650 20:41:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:09.650 20:41:27 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:24:09.650 20:41:27 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:24:09.650 20:41:27 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:24:09.650 20:41:27 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:24:09.650 net.core.busy_poll = 1 00:24:09.650 20:41:27 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:24:09.650 net.core.busy_read = 1 00:24:09.650 20:41:27 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:24:09.650 20:41:27 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:24:09.650 20:41:27 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:24:09.650 20:41:27 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:24:09.912 20:41:27 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:24:09.912 20:41:28 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:09.912 20:41:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:09.912 20:41:28 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:09.912 20:41:28 -- common/autotest_common.sh@10 -- # set +x 00:24:09.912 20:41:28 -- nvmf/common.sh@469 -- # nvmfpid=4147788 00:24:09.912 20:41:28 -- nvmf/common.sh@470 -- # waitforlisten 4147788 00:24:09.912 20:41:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:09.912 20:41:28 -- common/autotest_common.sh@819 -- # '[' -z 4147788 ']' 00:24:09.912 20:41:28 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:09.912 20:41:28 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:09.912 20:41:28 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:09.912 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:09.912 20:41:28 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:09.912 20:41:28 -- common/autotest_common.sh@10 -- # set +x 00:24:09.912 [2024-04-26 20:41:28.103482] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:24:09.912 [2024-04-26 20:41:28.103533] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:09.912 EAL: No free 2048 kB hugepages reported on node 1 00:24:09.912 [2024-04-26 20:41:28.168119] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:09.912 [2024-04-26 20:41:28.231724] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:09.912 [2024-04-26 20:41:28.231853] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:09.912 [2024-04-26 20:41:28.231862] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:09.912 [2024-04-26 20:41:28.231871] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:09.912 [2024-04-26 20:41:28.231989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:09.912 [2024-04-26 20:41:28.232102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:09.912 [2024-04-26 20:41:28.232248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:09.912 [2024-04-26 20:41:28.232250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:10.857 20:41:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:10.857 20:41:28 -- common/autotest_common.sh@852 -- # return 0 00:24:10.857 20:41:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:10.857 20:41:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:10.857 20:41:28 -- common/autotest_common.sh@10 -- # set +x 00:24:10.857 20:41:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:10.857 20:41:28 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:24:10.857 20:41:28 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:24:10.857 20:41:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.857 20:41:28 -- common/autotest_common.sh@10 -- # set +x 00:24:10.857 20:41:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.857 20:41:28 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:10.857 20:41:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.857 20:41:28 -- common/autotest_common.sh@10 -- # set +x 00:24:10.857 20:41:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.857 20:41:28 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:24:10.857 20:41:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.857 20:41:28 -- common/autotest_common.sh@10 -- # set +x 00:24:10.857 [2024-04-26 20:41:29.006195] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:10.857 20:41:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.857 20:41:29 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:10.857 20:41:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.857 20:41:29 -- common/autotest_common.sh@10 -- # set +x 00:24:10.857 Malloc1 00:24:10.857 20:41:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.857 20:41:29 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:10.857 20:41:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.857 20:41:29 -- common/autotest_common.sh@10 -- # set +x 00:24:10.857 20:41:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.857 20:41:29 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:10.857 20:41:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.857 20:41:29 -- common/autotest_common.sh@10 -- # set +x 00:24:10.857 20:41:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.857 20:41:29 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:10.857 20:41:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.857 20:41:29 -- common/autotest_common.sh@10 -- # set +x 00:24:10.857 [2024-04-26 20:41:29.061491] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:10.857 20:41:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.857 20:41:29 -- target/perf_adq.sh@94 -- # perfpid=4147899 00:24:10.857 20:41:29 -- target/perf_adq.sh@95 -- # sleep 2 00:24:10.857 20:41:29 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:10.857 EAL: No free 2048 kB hugepages reported on node 1 00:24:12.775 20:41:31 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:24:12.775 20:41:31 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:24:12.775 20:41:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:12.775 20:41:31 -- target/perf_adq.sh@97 -- # wc -l 00:24:12.775 20:41:31 -- common/autotest_common.sh@10 -- # set +x 00:24:12.775 20:41:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:12.775 20:41:31 -- target/perf_adq.sh@97 -- # count=3 00:24:12.775 20:41:31 -- target/perf_adq.sh@98 -- # [[ 3 -lt 2 ]] 00:24:12.775 20:41:31 -- target/perf_adq.sh@103 -- # wait 4147899 00:24:22.782 Initializing NVMe Controllers 00:24:22.782 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:22.782 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:22.782 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:22.782 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:22.782 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:22.782 Initialization complete. Launching workers. 00:24:22.782 ======================================================== 00:24:22.782 Latency(us) 00:24:22.782 Device Information : IOPS MiB/s Average min max 00:24:22.782 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5205.50 20.33 12294.47 1804.67 58249.57 00:24:22.782 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4923.00 19.23 13023.80 1840.82 58187.42 00:24:22.782 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5119.80 20.00 12500.35 1530.23 58356.71 00:24:22.782 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4912.00 19.19 13028.38 1724.15 59515.92 00:24:22.782 ======================================================== 00:24:22.782 Total : 20160.29 78.75 12703.67 1530.23 59515.92 00:24:22.782 00:24:22.782 20:41:39 -- target/perf_adq.sh@104 -- # nvmftestfini 00:24:22.782 20:41:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:22.782 20:41:39 -- nvmf/common.sh@116 -- # sync 00:24:22.782 20:41:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:22.782 20:41:39 -- nvmf/common.sh@119 -- # set +e 00:24:22.782 20:41:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:22.782 20:41:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:22.782 rmmod nvme_tcp 00:24:22.782 rmmod nvme_fabrics 00:24:22.782 rmmod nvme_keyring 00:24:22.782 20:41:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:22.782 20:41:39 -- nvmf/common.sh@123 -- # set -e 00:24:22.782 20:41:39 -- nvmf/common.sh@124 -- # return 0 00:24:22.782 20:41:39 -- nvmf/common.sh@477 -- # '[' -n 4147788 ']' 00:24:22.782 20:41:39 -- nvmf/common.sh@478 -- # killprocess 4147788 00:24:22.782 20:41:39 -- common/autotest_common.sh@926 -- # '[' -z 4147788 ']' 00:24:22.782 20:41:39 -- common/autotest_common.sh@930 -- # kill -0 4147788 00:24:22.782 20:41:39 -- common/autotest_common.sh@931 -- # uname 00:24:22.782 20:41:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:22.782 20:41:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4147788 00:24:22.782 20:41:39 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:22.782 20:41:39 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:22.782 20:41:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4147788' 00:24:22.782 killing process with pid 4147788 00:24:22.782 20:41:39 -- common/autotest_common.sh@945 -- # kill 4147788 00:24:22.782 20:41:39 -- common/autotest_common.sh@950 -- # wait 4147788 00:24:22.782 20:41:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:22.782 20:41:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:22.782 20:41:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:22.783 20:41:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:22.783 20:41:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:22.783 20:41:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:22.783 20:41:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:22.783 20:41:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:24.700 20:41:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:24.700 20:41:42 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:24:24.700 00:24:24.700 real 0m52.750s 00:24:24.700 user 2m49.456s 00:24:24.700 sys 0m10.224s 00:24:24.700 20:41:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:24.700 20:41:42 -- common/autotest_common.sh@10 -- # set +x 00:24:24.700 ************************************ 00:24:24.700 END TEST nvmf_perf_adq 00:24:24.700 ************************************ 00:24:24.700 20:41:42 -- nvmf/nvmf.sh@80 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:24.700 20:41:42 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:24.700 20:41:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:24.700 20:41:42 -- common/autotest_common.sh@10 -- # set +x 00:24:24.700 ************************************ 00:24:24.700 START TEST nvmf_shutdown 00:24:24.700 ************************************ 00:24:24.700 20:41:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:24.700 * Looking for test storage... 00:24:24.700 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:24.700 20:41:42 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:24.700 20:41:42 -- nvmf/common.sh@7 -- # uname -s 00:24:24.700 20:41:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:24.700 20:41:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:24.700 20:41:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:24.700 20:41:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:24.700 20:41:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:24.700 20:41:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:24.700 20:41:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:24.701 20:41:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:24.701 20:41:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:24.701 20:41:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:24.701 20:41:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:24:24.701 20:41:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:24:24.701 20:41:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:24.701 20:41:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:24.701 20:41:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:24.701 20:41:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:24.701 20:41:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:24.701 20:41:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:24.701 20:41:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:24.701 20:41:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:24.701 20:41:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:24.701 20:41:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:24.701 20:41:42 -- paths/export.sh@5 -- # export PATH 00:24:24.701 20:41:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:24.701 20:41:42 -- nvmf/common.sh@46 -- # : 0 00:24:24.701 20:41:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:24.701 20:41:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:24.701 20:41:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:24.701 20:41:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:24.701 20:41:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:24.701 20:41:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:24.701 20:41:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:24.701 20:41:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:24.701 20:41:42 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:24.701 20:41:42 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:24.701 20:41:42 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:24:24.701 20:41:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:24:24.701 20:41:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:24.701 20:41:42 -- common/autotest_common.sh@10 -- # set +x 00:24:24.701 ************************************ 00:24:24.701 START TEST nvmf_shutdown_tc1 00:24:24.701 ************************************ 00:24:24.701 20:41:42 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc1 00:24:24.701 20:41:42 -- target/shutdown.sh@74 -- # starttarget 00:24:24.701 20:41:42 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:24.701 20:41:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:24.701 20:41:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:24.701 20:41:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:24.701 20:41:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:24.701 20:41:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:24.701 20:41:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:24.701 20:41:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:24.701 20:41:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:24.701 20:41:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:24.701 20:41:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:24.701 20:41:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:24.701 20:41:42 -- common/autotest_common.sh@10 -- # set +x 00:24:31.294 20:41:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:31.294 20:41:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:31.294 20:41:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:31.294 20:41:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:31.294 20:41:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:31.294 20:41:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:31.294 20:41:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:31.294 20:41:49 -- nvmf/common.sh@294 -- # net_devs=() 00:24:31.294 20:41:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:31.294 20:41:49 -- nvmf/common.sh@295 -- # e810=() 00:24:31.294 20:41:49 -- nvmf/common.sh@295 -- # local -ga e810 00:24:31.294 20:41:49 -- nvmf/common.sh@296 -- # x722=() 00:24:31.294 20:41:49 -- nvmf/common.sh@296 -- # local -ga x722 00:24:31.294 20:41:49 -- nvmf/common.sh@297 -- # mlx=() 00:24:31.294 20:41:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:31.294 20:41:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:31.294 20:41:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:31.294 20:41:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:31.294 20:41:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:31.294 20:41:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:31.294 20:41:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:31.295 20:41:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:31.295 20:41:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:31.295 20:41:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:31.295 20:41:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:31.295 20:41:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:31.295 20:41:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:31.295 20:41:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:31.295 20:41:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:31.295 20:41:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:31.295 20:41:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:24:31.295 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:24:31.295 20:41:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:31.295 20:41:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:24:31.295 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:24:31.295 20:41:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:31.295 20:41:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:31.295 20:41:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:31.295 20:41:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:31.295 20:41:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:31.295 20:41:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:24:31.295 Found net devices under 0000:4b:00.0: cvl_0_0 00:24:31.295 20:41:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:31.295 20:41:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:31.295 20:41:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:31.295 20:41:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:31.295 20:41:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:31.295 20:41:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:24:31.295 Found net devices under 0000:4b:00.1: cvl_0_1 00:24:31.295 20:41:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:31.295 20:41:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:31.295 20:41:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:31.295 20:41:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:31.295 20:41:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:31.295 20:41:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:31.295 20:41:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:31.295 20:41:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:31.295 20:41:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:31.295 20:41:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:31.295 20:41:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:31.295 20:41:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:31.295 20:41:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:31.295 20:41:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:31.295 20:41:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:31.295 20:41:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:31.295 20:41:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:31.295 20:41:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:31.295 20:41:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:31.295 20:41:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:31.295 20:41:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:31.295 20:41:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:31.557 20:41:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:31.557 20:41:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:31.557 20:41:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:31.557 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:31.557 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.669 ms 00:24:31.557 00:24:31.557 --- 10.0.0.2 ping statistics --- 00:24:31.557 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:31.557 rtt min/avg/max/mdev = 0.669/0.669/0.669/0.000 ms 00:24:31.557 20:41:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:31.557 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:31.557 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.413 ms 00:24:31.557 00:24:31.557 --- 10.0.0.1 ping statistics --- 00:24:31.557 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:31.557 rtt min/avg/max/mdev = 0.413/0.413/0.413/0.000 ms 00:24:31.557 20:41:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:31.557 20:41:49 -- nvmf/common.sh@410 -- # return 0 00:24:31.557 20:41:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:31.557 20:41:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:31.557 20:41:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:31.557 20:41:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:31.557 20:41:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:31.557 20:41:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:31.557 20:41:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:31.557 20:41:49 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:31.557 20:41:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:31.557 20:41:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:31.557 20:41:49 -- common/autotest_common.sh@10 -- # set +x 00:24:31.557 20:41:49 -- nvmf/common.sh@469 -- # nvmfpid=4154318 00:24:31.557 20:41:49 -- nvmf/common.sh@470 -- # waitforlisten 4154318 00:24:31.557 20:41:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:31.557 20:41:49 -- common/autotest_common.sh@819 -- # '[' -z 4154318 ']' 00:24:31.557 20:41:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:31.557 20:41:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:31.557 20:41:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:31.557 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:31.557 20:41:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:31.557 20:41:49 -- common/autotest_common.sh@10 -- # set +x 00:24:31.557 [2024-04-26 20:41:49.844737] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:24:31.557 [2024-04-26 20:41:49.844800] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:31.557 EAL: No free 2048 kB hugepages reported on node 1 00:24:31.818 [2024-04-26 20:41:49.914680] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:31.818 [2024-04-26 20:41:49.987565] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:31.818 [2024-04-26 20:41:49.987694] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:31.818 [2024-04-26 20:41:49.987704] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:31.818 [2024-04-26 20:41:49.987712] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:31.818 [2024-04-26 20:41:49.987840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:31.818 [2024-04-26 20:41:49.987965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:31.818 [2024-04-26 20:41:49.988124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:31.818 [2024-04-26 20:41:49.988125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:32.392 20:41:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:32.392 20:41:50 -- common/autotest_common.sh@852 -- # return 0 00:24:32.392 20:41:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:32.392 20:41:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:32.392 20:41:50 -- common/autotest_common.sh@10 -- # set +x 00:24:32.392 20:41:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:32.392 20:41:50 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:32.392 20:41:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:32.392 20:41:50 -- common/autotest_common.sh@10 -- # set +x 00:24:32.392 [2024-04-26 20:41:50.668426] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:32.392 20:41:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:32.392 20:41:50 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:32.392 20:41:50 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:32.392 20:41:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:32.392 20:41:50 -- common/autotest_common.sh@10 -- # set +x 00:24:32.392 20:41:50 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:32.392 20:41:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:32.392 20:41:50 -- target/shutdown.sh@28 -- # cat 00:24:32.392 20:41:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:32.392 20:41:50 -- target/shutdown.sh@28 -- # cat 00:24:32.392 20:41:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:32.392 20:41:50 -- target/shutdown.sh@28 -- # cat 00:24:32.392 20:41:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:32.392 20:41:50 -- target/shutdown.sh@28 -- # cat 00:24:32.392 20:41:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:32.392 20:41:50 -- target/shutdown.sh@28 -- # cat 00:24:32.392 20:41:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:32.392 20:41:50 -- target/shutdown.sh@28 -- # cat 00:24:32.392 20:41:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:32.392 20:41:50 -- target/shutdown.sh@28 -- # cat 00:24:32.392 20:41:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:32.392 20:41:50 -- target/shutdown.sh@28 -- # cat 00:24:32.392 20:41:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:32.392 20:41:50 -- target/shutdown.sh@28 -- # cat 00:24:32.392 20:41:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:32.392 20:41:50 -- target/shutdown.sh@28 -- # cat 00:24:32.392 20:41:50 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:32.392 20:41:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:32.392 20:41:50 -- common/autotest_common.sh@10 -- # set +x 00:24:32.654 Malloc1 00:24:32.654 [2024-04-26 20:41:50.771741] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:32.654 Malloc2 00:24:32.654 Malloc3 00:24:32.654 Malloc4 00:24:32.654 Malloc5 00:24:32.654 Malloc6 00:24:32.654 Malloc7 00:24:32.915 Malloc8 00:24:32.915 Malloc9 00:24:32.915 Malloc10 00:24:32.915 20:41:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:32.915 20:41:51 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:32.915 20:41:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:32.915 20:41:51 -- common/autotest_common.sh@10 -- # set +x 00:24:32.915 20:41:51 -- target/shutdown.sh@78 -- # perfpid=4154707 00:24:32.915 20:41:51 -- target/shutdown.sh@79 -- # waitforlisten 4154707 /var/tmp/bdevperf.sock 00:24:32.915 20:41:51 -- common/autotest_common.sh@819 -- # '[' -z 4154707 ']' 00:24:32.915 20:41:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:32.915 20:41:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:32.915 20:41:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:32.915 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:32.915 20:41:51 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:24:32.915 20:41:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:32.915 20:41:51 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:32.915 20:41:51 -- common/autotest_common.sh@10 -- # set +x 00:24:32.915 20:41:51 -- nvmf/common.sh@520 -- # config=() 00:24:32.915 20:41:51 -- nvmf/common.sh@520 -- # local subsystem config 00:24:32.915 20:41:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:32.915 { 00:24:32.915 "params": { 00:24:32.915 "name": "Nvme$subsystem", 00:24:32.915 "trtype": "$TEST_TRANSPORT", 00:24:32.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:32.915 "adrfam": "ipv4", 00:24:32.915 "trsvcid": "$NVMF_PORT", 00:24:32.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:32.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:32.915 "hdgst": ${hdgst:-false}, 00:24:32.915 "ddgst": ${ddgst:-false} 00:24:32.915 }, 00:24:32.915 "method": "bdev_nvme_attach_controller" 00:24:32.915 } 00:24:32.915 EOF 00:24:32.915 )") 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # cat 00:24:32.915 20:41:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:32.915 { 00:24:32.915 "params": { 00:24:32.915 "name": "Nvme$subsystem", 00:24:32.915 "trtype": "$TEST_TRANSPORT", 00:24:32.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:32.915 "adrfam": "ipv4", 00:24:32.915 "trsvcid": "$NVMF_PORT", 00:24:32.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:32.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:32.915 "hdgst": ${hdgst:-false}, 00:24:32.915 "ddgst": ${ddgst:-false} 00:24:32.915 }, 00:24:32.915 "method": "bdev_nvme_attach_controller" 00:24:32.915 } 00:24:32.915 EOF 00:24:32.915 )") 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # cat 00:24:32.915 20:41:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:32.915 { 00:24:32.915 "params": { 00:24:32.915 "name": "Nvme$subsystem", 00:24:32.915 "trtype": "$TEST_TRANSPORT", 00:24:32.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:32.915 "adrfam": "ipv4", 00:24:32.915 "trsvcid": "$NVMF_PORT", 00:24:32.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:32.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:32.915 "hdgst": ${hdgst:-false}, 00:24:32.915 "ddgst": ${ddgst:-false} 00:24:32.915 }, 00:24:32.915 "method": "bdev_nvme_attach_controller" 00:24:32.915 } 00:24:32.915 EOF 00:24:32.915 )") 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # cat 00:24:32.915 20:41:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:32.915 { 00:24:32.915 "params": { 00:24:32.915 "name": "Nvme$subsystem", 00:24:32.915 "trtype": "$TEST_TRANSPORT", 00:24:32.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:32.915 "adrfam": "ipv4", 00:24:32.915 "trsvcid": "$NVMF_PORT", 00:24:32.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:32.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:32.915 "hdgst": ${hdgst:-false}, 00:24:32.915 "ddgst": ${ddgst:-false} 00:24:32.915 }, 00:24:32.915 "method": "bdev_nvme_attach_controller" 00:24:32.915 } 00:24:32.915 EOF 00:24:32.915 )") 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # cat 00:24:32.915 20:41:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:32.915 { 00:24:32.915 "params": { 00:24:32.915 "name": "Nvme$subsystem", 00:24:32.915 "trtype": "$TEST_TRANSPORT", 00:24:32.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:32.915 "adrfam": "ipv4", 00:24:32.915 "trsvcid": "$NVMF_PORT", 00:24:32.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:32.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:32.915 "hdgst": ${hdgst:-false}, 00:24:32.915 "ddgst": ${ddgst:-false} 00:24:32.915 }, 00:24:32.915 "method": "bdev_nvme_attach_controller" 00:24:32.915 } 00:24:32.915 EOF 00:24:32.915 )") 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # cat 00:24:32.915 20:41:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:32.915 { 00:24:32.915 "params": { 00:24:32.915 "name": "Nvme$subsystem", 00:24:32.915 "trtype": "$TEST_TRANSPORT", 00:24:32.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:32.915 "adrfam": "ipv4", 00:24:32.915 "trsvcid": "$NVMF_PORT", 00:24:32.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:32.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:32.915 "hdgst": ${hdgst:-false}, 00:24:32.915 "ddgst": ${ddgst:-false} 00:24:32.915 }, 00:24:32.915 "method": "bdev_nvme_attach_controller" 00:24:32.915 } 00:24:32.915 EOF 00:24:32.915 )") 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # cat 00:24:32.915 [2024-04-26 20:41:51.216534] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:24:32.915 [2024-04-26 20:41:51.216586] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:24:32.915 20:41:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:32.915 { 00:24:32.915 "params": { 00:24:32.915 "name": "Nvme$subsystem", 00:24:32.915 "trtype": "$TEST_TRANSPORT", 00:24:32.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:32.915 "adrfam": "ipv4", 00:24:32.915 "trsvcid": "$NVMF_PORT", 00:24:32.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:32.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:32.915 "hdgst": ${hdgst:-false}, 00:24:32.915 "ddgst": ${ddgst:-false} 00:24:32.915 }, 00:24:32.915 "method": "bdev_nvme_attach_controller" 00:24:32.915 } 00:24:32.915 EOF 00:24:32.915 )") 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # cat 00:24:32.915 20:41:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:32.915 20:41:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:32.915 { 00:24:32.915 "params": { 00:24:32.915 "name": "Nvme$subsystem", 00:24:32.915 "trtype": "$TEST_TRANSPORT", 00:24:32.915 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:32.915 "adrfam": "ipv4", 00:24:32.915 "trsvcid": "$NVMF_PORT", 00:24:32.915 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:32.915 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:32.915 "hdgst": ${hdgst:-false}, 00:24:32.915 "ddgst": ${ddgst:-false} 00:24:32.915 }, 00:24:32.915 "method": "bdev_nvme_attach_controller" 00:24:32.915 } 00:24:32.915 EOF 00:24:32.915 )") 00:24:32.916 20:41:51 -- nvmf/common.sh@542 -- # cat 00:24:32.916 20:41:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:32.916 20:41:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:32.916 { 00:24:32.916 "params": { 00:24:32.916 "name": "Nvme$subsystem", 00:24:32.916 "trtype": "$TEST_TRANSPORT", 00:24:32.916 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:32.916 "adrfam": "ipv4", 00:24:32.916 "trsvcid": "$NVMF_PORT", 00:24:32.916 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:32.916 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:32.916 "hdgst": ${hdgst:-false}, 00:24:32.916 "ddgst": ${ddgst:-false} 00:24:32.916 }, 00:24:32.916 "method": "bdev_nvme_attach_controller" 00:24:32.916 } 00:24:32.916 EOF 00:24:32.916 )") 00:24:32.916 20:41:51 -- nvmf/common.sh@542 -- # cat 00:24:32.916 EAL: No free 2048 kB hugepages reported on node 1 00:24:32.916 20:41:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:32.916 20:41:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:32.916 { 00:24:32.916 "params": { 00:24:32.916 "name": "Nvme$subsystem", 00:24:32.916 "trtype": "$TEST_TRANSPORT", 00:24:32.916 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:32.916 "adrfam": "ipv4", 00:24:32.916 "trsvcid": "$NVMF_PORT", 00:24:32.916 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:32.916 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:32.916 "hdgst": ${hdgst:-false}, 00:24:32.916 "ddgst": ${ddgst:-false} 00:24:32.916 }, 00:24:32.916 "method": "bdev_nvme_attach_controller" 00:24:32.916 } 00:24:32.916 EOF 00:24:32.916 )") 00:24:32.916 20:41:51 -- nvmf/common.sh@542 -- # cat 00:24:32.916 20:41:51 -- nvmf/common.sh@544 -- # jq . 00:24:32.916 20:41:51 -- nvmf/common.sh@545 -- # IFS=, 00:24:32.916 20:41:51 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:32.916 "params": { 00:24:32.916 "name": "Nvme1", 00:24:32.916 "trtype": "tcp", 00:24:32.916 "traddr": "10.0.0.2", 00:24:32.916 "adrfam": "ipv4", 00:24:32.916 "trsvcid": "4420", 00:24:32.916 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:32.916 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:32.916 "hdgst": false, 00:24:32.916 "ddgst": false 00:24:32.916 }, 00:24:32.916 "method": "bdev_nvme_attach_controller" 00:24:32.916 },{ 00:24:32.916 "params": { 00:24:32.916 "name": "Nvme2", 00:24:32.916 "trtype": "tcp", 00:24:32.916 "traddr": "10.0.0.2", 00:24:32.916 "adrfam": "ipv4", 00:24:32.916 "trsvcid": "4420", 00:24:32.916 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:32.916 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:32.916 "hdgst": false, 00:24:32.916 "ddgst": false 00:24:32.916 }, 00:24:32.916 "method": "bdev_nvme_attach_controller" 00:24:32.916 },{ 00:24:32.916 "params": { 00:24:32.916 "name": "Nvme3", 00:24:32.916 "trtype": "tcp", 00:24:32.916 "traddr": "10.0.0.2", 00:24:32.916 "adrfam": "ipv4", 00:24:32.916 "trsvcid": "4420", 00:24:32.916 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:32.916 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:32.916 "hdgst": false, 00:24:32.916 "ddgst": false 00:24:32.916 }, 00:24:32.916 "method": "bdev_nvme_attach_controller" 00:24:32.916 },{ 00:24:32.916 "params": { 00:24:32.916 "name": "Nvme4", 00:24:32.916 "trtype": "tcp", 00:24:32.916 "traddr": "10.0.0.2", 00:24:32.916 "adrfam": "ipv4", 00:24:32.916 "trsvcid": "4420", 00:24:32.916 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:32.916 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:32.916 "hdgst": false, 00:24:32.916 "ddgst": false 00:24:32.916 }, 00:24:32.916 "method": "bdev_nvme_attach_controller" 00:24:32.916 },{ 00:24:32.916 "params": { 00:24:32.916 "name": "Nvme5", 00:24:32.916 "trtype": "tcp", 00:24:32.916 "traddr": "10.0.0.2", 00:24:32.916 "adrfam": "ipv4", 00:24:32.916 "trsvcid": "4420", 00:24:32.916 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:32.916 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:32.916 "hdgst": false, 00:24:32.916 "ddgst": false 00:24:32.916 }, 00:24:32.916 "method": "bdev_nvme_attach_controller" 00:24:32.916 },{ 00:24:32.916 "params": { 00:24:32.916 "name": "Nvme6", 00:24:32.916 "trtype": "tcp", 00:24:32.916 "traddr": "10.0.0.2", 00:24:32.916 "adrfam": "ipv4", 00:24:32.916 "trsvcid": "4420", 00:24:32.916 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:32.916 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:32.916 "hdgst": false, 00:24:32.916 "ddgst": false 00:24:32.916 }, 00:24:32.916 "method": "bdev_nvme_attach_controller" 00:24:32.916 },{ 00:24:32.916 "params": { 00:24:32.916 "name": "Nvme7", 00:24:32.916 "trtype": "tcp", 00:24:32.916 "traddr": "10.0.0.2", 00:24:32.916 "adrfam": "ipv4", 00:24:32.916 "trsvcid": "4420", 00:24:32.916 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:32.916 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:32.916 "hdgst": false, 00:24:32.916 "ddgst": false 00:24:32.916 }, 00:24:32.916 "method": "bdev_nvme_attach_controller" 00:24:32.916 },{ 00:24:32.916 "params": { 00:24:32.916 "name": "Nvme8", 00:24:32.916 "trtype": "tcp", 00:24:32.916 "traddr": "10.0.0.2", 00:24:32.916 "adrfam": "ipv4", 00:24:32.916 "trsvcid": "4420", 00:24:32.916 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:32.916 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:32.916 "hdgst": false, 00:24:32.916 "ddgst": false 00:24:32.916 }, 00:24:32.916 "method": "bdev_nvme_attach_controller" 00:24:32.916 },{ 00:24:32.916 "params": { 00:24:32.916 "name": "Nvme9", 00:24:32.916 "trtype": "tcp", 00:24:32.916 "traddr": "10.0.0.2", 00:24:32.916 "adrfam": "ipv4", 00:24:32.916 "trsvcid": "4420", 00:24:32.916 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:32.916 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:32.916 "hdgst": false, 00:24:32.916 "ddgst": false 00:24:32.916 }, 00:24:32.916 "method": "bdev_nvme_attach_controller" 00:24:32.916 },{ 00:24:32.916 "params": { 00:24:32.916 "name": "Nvme10", 00:24:32.916 "trtype": "tcp", 00:24:32.916 "traddr": "10.0.0.2", 00:24:32.916 "adrfam": "ipv4", 00:24:32.916 "trsvcid": "4420", 00:24:32.916 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:32.916 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:32.916 "hdgst": false, 00:24:32.916 "ddgst": false 00:24:32.916 }, 00:24:32.916 "method": "bdev_nvme_attach_controller" 00:24:32.916 }' 00:24:33.177 [2024-04-26 20:41:51.276648] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:33.177 [2024-04-26 20:41:51.339655] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:34.663 20:41:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:34.663 20:41:52 -- common/autotest_common.sh@852 -- # return 0 00:24:34.663 20:41:52 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:34.663 20:41:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:34.663 20:41:52 -- common/autotest_common.sh@10 -- # set +x 00:24:34.663 20:41:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:34.663 20:41:52 -- target/shutdown.sh@83 -- # kill -9 4154707 00:24:34.663 20:41:52 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:24:34.663 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 4154707 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:24:34.663 20:41:52 -- target/shutdown.sh@87 -- # sleep 1 00:24:35.606 20:41:53 -- target/shutdown.sh@88 -- # kill -0 4154318 00:24:35.606 20:41:53 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:24:35.606 20:41:53 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:35.606 20:41:53 -- nvmf/common.sh@520 -- # config=() 00:24:35.606 20:41:53 -- nvmf/common.sh@520 -- # local subsystem config 00:24:35.606 20:41:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:35.607 { 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme$subsystem", 00:24:35.607 "trtype": "$TEST_TRANSPORT", 00:24:35.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:35.607 "adrfam": "ipv4", 00:24:35.607 "trsvcid": "$NVMF_PORT", 00:24:35.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:35.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:35.607 "hdgst": ${hdgst:-false}, 00:24:35.607 "ddgst": ${ddgst:-false} 00:24:35.607 }, 00:24:35.607 "method": "bdev_nvme_attach_controller" 00:24:35.607 } 00:24:35.607 EOF 00:24:35.607 )") 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # cat 00:24:35.607 20:41:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:35.607 { 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme$subsystem", 00:24:35.607 "trtype": "$TEST_TRANSPORT", 00:24:35.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:35.607 "adrfam": "ipv4", 00:24:35.607 "trsvcid": "$NVMF_PORT", 00:24:35.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:35.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:35.607 "hdgst": ${hdgst:-false}, 00:24:35.607 "ddgst": ${ddgst:-false} 00:24:35.607 }, 00:24:35.607 "method": "bdev_nvme_attach_controller" 00:24:35.607 } 00:24:35.607 EOF 00:24:35.607 )") 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # cat 00:24:35.607 20:41:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:35.607 { 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme$subsystem", 00:24:35.607 "trtype": "$TEST_TRANSPORT", 00:24:35.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:35.607 "adrfam": "ipv4", 00:24:35.607 "trsvcid": "$NVMF_PORT", 00:24:35.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:35.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:35.607 "hdgst": ${hdgst:-false}, 00:24:35.607 "ddgst": ${ddgst:-false} 00:24:35.607 }, 00:24:35.607 "method": "bdev_nvme_attach_controller" 00:24:35.607 } 00:24:35.607 EOF 00:24:35.607 )") 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # cat 00:24:35.607 20:41:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:35.607 { 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme$subsystem", 00:24:35.607 "trtype": "$TEST_TRANSPORT", 00:24:35.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:35.607 "adrfam": "ipv4", 00:24:35.607 "trsvcid": "$NVMF_PORT", 00:24:35.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:35.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:35.607 "hdgst": ${hdgst:-false}, 00:24:35.607 "ddgst": ${ddgst:-false} 00:24:35.607 }, 00:24:35.607 "method": "bdev_nvme_attach_controller" 00:24:35.607 } 00:24:35.607 EOF 00:24:35.607 )") 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # cat 00:24:35.607 20:41:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:35.607 { 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme$subsystem", 00:24:35.607 "trtype": "$TEST_TRANSPORT", 00:24:35.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:35.607 "adrfam": "ipv4", 00:24:35.607 "trsvcid": "$NVMF_PORT", 00:24:35.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:35.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:35.607 "hdgst": ${hdgst:-false}, 00:24:35.607 "ddgst": ${ddgst:-false} 00:24:35.607 }, 00:24:35.607 "method": "bdev_nvme_attach_controller" 00:24:35.607 } 00:24:35.607 EOF 00:24:35.607 )") 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # cat 00:24:35.607 20:41:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:35.607 { 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme$subsystem", 00:24:35.607 "trtype": "$TEST_TRANSPORT", 00:24:35.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:35.607 "adrfam": "ipv4", 00:24:35.607 "trsvcid": "$NVMF_PORT", 00:24:35.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:35.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:35.607 "hdgst": ${hdgst:-false}, 00:24:35.607 "ddgst": ${ddgst:-false} 00:24:35.607 }, 00:24:35.607 "method": "bdev_nvme_attach_controller" 00:24:35.607 } 00:24:35.607 EOF 00:24:35.607 )") 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # cat 00:24:35.607 [2024-04-26 20:41:53.701818] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:24:35.607 [2024-04-26 20:41:53.701869] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4155183 ] 00:24:35.607 20:41:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:35.607 { 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme$subsystem", 00:24:35.607 "trtype": "$TEST_TRANSPORT", 00:24:35.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:35.607 "adrfam": "ipv4", 00:24:35.607 "trsvcid": "$NVMF_PORT", 00:24:35.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:35.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:35.607 "hdgst": ${hdgst:-false}, 00:24:35.607 "ddgst": ${ddgst:-false} 00:24:35.607 }, 00:24:35.607 "method": "bdev_nvme_attach_controller" 00:24:35.607 } 00:24:35.607 EOF 00:24:35.607 )") 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # cat 00:24:35.607 20:41:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:35.607 { 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme$subsystem", 00:24:35.607 "trtype": "$TEST_TRANSPORT", 00:24:35.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:35.607 "adrfam": "ipv4", 00:24:35.607 "trsvcid": "$NVMF_PORT", 00:24:35.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:35.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:35.607 "hdgst": ${hdgst:-false}, 00:24:35.607 "ddgst": ${ddgst:-false} 00:24:35.607 }, 00:24:35.607 "method": "bdev_nvme_attach_controller" 00:24:35.607 } 00:24:35.607 EOF 00:24:35.607 )") 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # cat 00:24:35.607 20:41:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:35.607 { 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme$subsystem", 00:24:35.607 "trtype": "$TEST_TRANSPORT", 00:24:35.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:35.607 "adrfam": "ipv4", 00:24:35.607 "trsvcid": "$NVMF_PORT", 00:24:35.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:35.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:35.607 "hdgst": ${hdgst:-false}, 00:24:35.607 "ddgst": ${ddgst:-false} 00:24:35.607 }, 00:24:35.607 "method": "bdev_nvme_attach_controller" 00:24:35.607 } 00:24:35.607 EOF 00:24:35.607 )") 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # cat 00:24:35.607 EAL: No free 2048 kB hugepages reported on node 1 00:24:35.607 20:41:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:35.607 { 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme$subsystem", 00:24:35.607 "trtype": "$TEST_TRANSPORT", 00:24:35.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:35.607 "adrfam": "ipv4", 00:24:35.607 "trsvcid": "$NVMF_PORT", 00:24:35.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:35.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:35.607 "hdgst": ${hdgst:-false}, 00:24:35.607 "ddgst": ${ddgst:-false} 00:24:35.607 }, 00:24:35.607 "method": "bdev_nvme_attach_controller" 00:24:35.607 } 00:24:35.607 EOF 00:24:35.607 )") 00:24:35.607 20:41:53 -- nvmf/common.sh@542 -- # cat 00:24:35.607 20:41:53 -- nvmf/common.sh@544 -- # jq . 00:24:35.607 20:41:53 -- nvmf/common.sh@545 -- # IFS=, 00:24:35.607 20:41:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme1", 00:24:35.607 "trtype": "tcp", 00:24:35.607 "traddr": "10.0.0.2", 00:24:35.607 "adrfam": "ipv4", 00:24:35.607 "trsvcid": "4420", 00:24:35.607 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:35.607 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:35.607 "hdgst": false, 00:24:35.607 "ddgst": false 00:24:35.607 }, 00:24:35.607 "method": "bdev_nvme_attach_controller" 00:24:35.607 },{ 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme2", 00:24:35.607 "trtype": "tcp", 00:24:35.607 "traddr": "10.0.0.2", 00:24:35.607 "adrfam": "ipv4", 00:24:35.607 "trsvcid": "4420", 00:24:35.607 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:35.607 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:35.607 "hdgst": false, 00:24:35.607 "ddgst": false 00:24:35.607 }, 00:24:35.607 "method": "bdev_nvme_attach_controller" 00:24:35.607 },{ 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme3", 00:24:35.607 "trtype": "tcp", 00:24:35.607 "traddr": "10.0.0.2", 00:24:35.607 "adrfam": "ipv4", 00:24:35.607 "trsvcid": "4420", 00:24:35.607 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:35.607 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:35.607 "hdgst": false, 00:24:35.607 "ddgst": false 00:24:35.607 }, 00:24:35.607 "method": "bdev_nvme_attach_controller" 00:24:35.607 },{ 00:24:35.607 "params": { 00:24:35.607 "name": "Nvme4", 00:24:35.607 "trtype": "tcp", 00:24:35.607 "traddr": "10.0.0.2", 00:24:35.607 "adrfam": "ipv4", 00:24:35.608 "trsvcid": "4420", 00:24:35.608 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:35.608 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:35.608 "hdgst": false, 00:24:35.608 "ddgst": false 00:24:35.608 }, 00:24:35.608 "method": "bdev_nvme_attach_controller" 00:24:35.608 },{ 00:24:35.608 "params": { 00:24:35.608 "name": "Nvme5", 00:24:35.608 "trtype": "tcp", 00:24:35.608 "traddr": "10.0.0.2", 00:24:35.608 "adrfam": "ipv4", 00:24:35.608 "trsvcid": "4420", 00:24:35.608 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:35.608 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:35.608 "hdgst": false, 00:24:35.608 "ddgst": false 00:24:35.608 }, 00:24:35.608 "method": "bdev_nvme_attach_controller" 00:24:35.608 },{ 00:24:35.608 "params": { 00:24:35.608 "name": "Nvme6", 00:24:35.608 "trtype": "tcp", 00:24:35.608 "traddr": "10.0.0.2", 00:24:35.608 "adrfam": "ipv4", 00:24:35.608 "trsvcid": "4420", 00:24:35.608 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:35.608 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:35.608 "hdgst": false, 00:24:35.608 "ddgst": false 00:24:35.608 }, 00:24:35.608 "method": "bdev_nvme_attach_controller" 00:24:35.608 },{ 00:24:35.608 "params": { 00:24:35.608 "name": "Nvme7", 00:24:35.608 "trtype": "tcp", 00:24:35.608 "traddr": "10.0.0.2", 00:24:35.608 "adrfam": "ipv4", 00:24:35.608 "trsvcid": "4420", 00:24:35.608 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:35.608 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:35.608 "hdgst": false, 00:24:35.608 "ddgst": false 00:24:35.608 }, 00:24:35.608 "method": "bdev_nvme_attach_controller" 00:24:35.608 },{ 00:24:35.608 "params": { 00:24:35.608 "name": "Nvme8", 00:24:35.608 "trtype": "tcp", 00:24:35.608 "traddr": "10.0.0.2", 00:24:35.608 "adrfam": "ipv4", 00:24:35.608 "trsvcid": "4420", 00:24:35.608 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:35.608 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:35.608 "hdgst": false, 00:24:35.608 "ddgst": false 00:24:35.608 }, 00:24:35.608 "method": "bdev_nvme_attach_controller" 00:24:35.608 },{ 00:24:35.608 "params": { 00:24:35.608 "name": "Nvme9", 00:24:35.608 "trtype": "tcp", 00:24:35.608 "traddr": "10.0.0.2", 00:24:35.608 "adrfam": "ipv4", 00:24:35.608 "trsvcid": "4420", 00:24:35.608 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:35.608 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:35.608 "hdgst": false, 00:24:35.608 "ddgst": false 00:24:35.608 }, 00:24:35.608 "method": "bdev_nvme_attach_controller" 00:24:35.608 },{ 00:24:35.608 "params": { 00:24:35.608 "name": "Nvme10", 00:24:35.608 "trtype": "tcp", 00:24:35.608 "traddr": "10.0.0.2", 00:24:35.608 "adrfam": "ipv4", 00:24:35.608 "trsvcid": "4420", 00:24:35.608 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:35.608 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:35.608 "hdgst": false, 00:24:35.608 "ddgst": false 00:24:35.608 }, 00:24:35.608 "method": "bdev_nvme_attach_controller" 00:24:35.608 }' 00:24:35.608 [2024-04-26 20:41:53.761581] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:35.608 [2024-04-26 20:41:53.823929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:36.994 Running I/O for 1 seconds... 00:24:37.937 00:24:37.937 Latency(us) 00:24:37.937 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:37.937 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.937 Verification LBA range: start 0x0 length 0x400 00:24:37.937 Nvme1n1 : 1.08 449.79 28.11 0.00 0.00 138720.06 10922.67 113595.73 00:24:37.937 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.937 Verification LBA range: start 0x0 length 0x400 00:24:37.937 Nvme2n1 : 1.09 411.43 25.71 0.00 0.00 151913.81 12451.84 137188.69 00:24:37.937 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.937 Verification LBA range: start 0x0 length 0x400 00:24:37.937 Nvme3n1 : 1.09 442.02 27.63 0.00 0.00 139430.89 30801.92 126702.93 00:24:37.937 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.937 Verification LBA range: start 0x0 length 0x400 00:24:37.937 Nvme4n1 : 1.09 399.17 24.95 0.00 0.00 154462.49 14417.92 131072.00 00:24:37.937 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.937 Verification LBA range: start 0x0 length 0x400 00:24:37.937 Nvme5n1 : 1.14 421.98 26.37 0.00 0.00 139778.75 17803.95 116217.17 00:24:37.937 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.937 Verification LBA range: start 0x0 length 0x400 00:24:37.937 Nvme6n1 : 1.08 406.60 25.41 0.00 0.00 148265.91 25449.81 124955.31 00:24:37.937 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.937 Verification LBA range: start 0x0 length 0x400 00:24:37.937 Nvme7n1 : 1.10 394.46 24.65 0.00 0.00 153434.96 9011.20 123207.68 00:24:37.937 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.937 Verification LBA range: start 0x0 length 0x400 00:24:37.937 Nvme8n1 : 1.11 436.27 27.27 0.00 0.00 137653.70 11031.89 120586.24 00:24:37.937 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.937 Verification LBA range: start 0x0 length 0x400 00:24:37.937 Nvme9n1 : 1.11 436.06 27.25 0.00 0.00 137048.89 7099.73 124081.49 00:24:37.937 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:37.937 Verification LBA range: start 0x0 length 0x400 00:24:37.937 Nvme10n1 : 1.10 402.91 25.18 0.00 0.00 146279.56 6225.92 138936.32 00:24:37.937 =================================================================================================================== 00:24:37.937 Total : 4200.69 262.54 0.00 0.00 144398.14 6225.92 138936.32 00:24:38.200 20:41:56 -- target/shutdown.sh@93 -- # stoptarget 00:24:38.200 20:41:56 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:38.200 20:41:56 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:38.200 20:41:56 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:38.200 20:41:56 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:38.200 20:41:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:38.200 20:41:56 -- nvmf/common.sh@116 -- # sync 00:24:38.200 20:41:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:38.200 20:41:56 -- nvmf/common.sh@119 -- # set +e 00:24:38.200 20:41:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:38.200 20:41:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:38.200 rmmod nvme_tcp 00:24:38.200 rmmod nvme_fabrics 00:24:38.200 rmmod nvme_keyring 00:24:38.200 20:41:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:38.200 20:41:56 -- nvmf/common.sh@123 -- # set -e 00:24:38.200 20:41:56 -- nvmf/common.sh@124 -- # return 0 00:24:38.200 20:41:56 -- nvmf/common.sh@477 -- # '[' -n 4154318 ']' 00:24:38.200 20:41:56 -- nvmf/common.sh@478 -- # killprocess 4154318 00:24:38.200 20:41:56 -- common/autotest_common.sh@926 -- # '[' -z 4154318 ']' 00:24:38.200 20:41:56 -- common/autotest_common.sh@930 -- # kill -0 4154318 00:24:38.200 20:41:56 -- common/autotest_common.sh@931 -- # uname 00:24:38.200 20:41:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:38.200 20:41:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4154318 00:24:38.200 20:41:56 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:24:38.200 20:41:56 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:24:38.200 20:41:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4154318' 00:24:38.200 killing process with pid 4154318 00:24:38.200 20:41:56 -- common/autotest_common.sh@945 -- # kill 4154318 00:24:38.200 20:41:56 -- common/autotest_common.sh@950 -- # wait 4154318 00:24:38.463 20:41:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:38.463 20:41:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:38.463 20:41:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:38.463 20:41:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:38.463 20:41:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:38.463 20:41:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:38.463 20:41:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:38.463 20:41:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:41.011 20:41:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:41.011 00:24:41.011 real 0m15.984s 00:24:41.011 user 0m32.745s 00:24:41.011 sys 0m6.368s 00:24:41.011 20:41:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:41.011 20:41:58 -- common/autotest_common.sh@10 -- # set +x 00:24:41.011 ************************************ 00:24:41.011 END TEST nvmf_shutdown_tc1 00:24:41.011 ************************************ 00:24:41.011 20:41:58 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:24:41.011 20:41:58 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:24:41.011 20:41:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:41.011 20:41:58 -- common/autotest_common.sh@10 -- # set +x 00:24:41.011 ************************************ 00:24:41.011 START TEST nvmf_shutdown_tc2 00:24:41.011 ************************************ 00:24:41.011 20:41:58 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc2 00:24:41.011 20:41:58 -- target/shutdown.sh@98 -- # starttarget 00:24:41.011 20:41:58 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:41.011 20:41:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:41.011 20:41:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:41.011 20:41:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:41.011 20:41:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:41.011 20:41:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:41.011 20:41:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:41.011 20:41:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:41.011 20:41:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:41.011 20:41:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:41.011 20:41:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:41.011 20:41:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:41.011 20:41:58 -- common/autotest_common.sh@10 -- # set +x 00:24:41.011 20:41:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:41.011 20:41:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:41.011 20:41:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:41.011 20:41:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:41.011 20:41:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:41.011 20:41:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:41.011 20:41:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:41.011 20:41:58 -- nvmf/common.sh@294 -- # net_devs=() 00:24:41.011 20:41:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:41.011 20:41:58 -- nvmf/common.sh@295 -- # e810=() 00:24:41.011 20:41:58 -- nvmf/common.sh@295 -- # local -ga e810 00:24:41.011 20:41:58 -- nvmf/common.sh@296 -- # x722=() 00:24:41.011 20:41:58 -- nvmf/common.sh@296 -- # local -ga x722 00:24:41.011 20:41:58 -- nvmf/common.sh@297 -- # mlx=() 00:24:41.011 20:41:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:41.011 20:41:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:41.011 20:41:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:41.011 20:41:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:41.011 20:41:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:41.011 20:41:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:41.011 20:41:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:41.011 20:41:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:41.011 20:41:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:41.011 20:41:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:41.011 20:41:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:41.011 20:41:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:41.011 20:41:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:41.011 20:41:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:41.011 20:41:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:41.011 20:41:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:41.011 20:41:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:41.011 20:41:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:41.011 20:41:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:41.011 20:41:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:24:41.011 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:24:41.011 20:41:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:41.011 20:41:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:41.011 20:41:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:41.011 20:41:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:41.011 20:41:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:41.011 20:41:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:41.011 20:41:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:24:41.011 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:24:41.011 20:41:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:41.011 20:41:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:41.011 20:41:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:41.012 20:41:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:41.012 20:41:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:41.012 20:41:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:41.012 20:41:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:41.012 20:41:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:41.012 20:41:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:41.012 20:41:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:41.012 20:41:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:41.012 20:41:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:41.012 20:41:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:24:41.012 Found net devices under 0000:4b:00.0: cvl_0_0 00:24:41.012 20:41:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:41.012 20:41:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:41.012 20:41:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:41.012 20:41:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:41.012 20:41:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:41.012 20:41:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:24:41.012 Found net devices under 0000:4b:00.1: cvl_0_1 00:24:41.012 20:41:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:41.012 20:41:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:41.012 20:41:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:41.012 20:41:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:41.012 20:41:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:41.012 20:41:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:41.012 20:41:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:41.012 20:41:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:41.012 20:41:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:41.012 20:41:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:41.012 20:41:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:41.012 20:41:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:41.012 20:41:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:41.012 20:41:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:41.012 20:41:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:41.012 20:41:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:41.012 20:41:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:41.012 20:41:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:41.012 20:41:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:41.012 20:41:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:41.012 20:41:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:41.012 20:41:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:41.012 20:41:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:41.012 20:41:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:41.012 20:41:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:41.012 20:41:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:41.012 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:41.012 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.475 ms 00:24:41.012 00:24:41.012 --- 10.0.0.2 ping statistics --- 00:24:41.012 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:41.012 rtt min/avg/max/mdev = 0.475/0.475/0.475/0.000 ms 00:24:41.012 20:41:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:41.012 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:41.012 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.287 ms 00:24:41.012 00:24:41.012 --- 10.0.0.1 ping statistics --- 00:24:41.012 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:41.012 rtt min/avg/max/mdev = 0.287/0.287/0.287/0.000 ms 00:24:41.012 20:41:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:41.012 20:41:59 -- nvmf/common.sh@410 -- # return 0 00:24:41.012 20:41:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:41.012 20:41:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:41.012 20:41:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:41.012 20:41:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:41.012 20:41:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:41.012 20:41:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:41.012 20:41:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:41.012 20:41:59 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:41.012 20:41:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:41.012 20:41:59 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:41.012 20:41:59 -- common/autotest_common.sh@10 -- # set +x 00:24:41.012 20:41:59 -- nvmf/common.sh@469 -- # nvmfpid=4156536 00:24:41.012 20:41:59 -- nvmf/common.sh@470 -- # waitforlisten 4156536 00:24:41.012 20:41:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:41.012 20:41:59 -- common/autotest_common.sh@819 -- # '[' -z 4156536 ']' 00:24:41.012 20:41:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:41.012 20:41:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:41.012 20:41:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:41.012 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:41.012 20:41:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:41.012 20:41:59 -- common/autotest_common.sh@10 -- # set +x 00:24:41.012 [2024-04-26 20:41:59.314844] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:24:41.012 [2024-04-26 20:41:59.314892] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:41.012 EAL: No free 2048 kB hugepages reported on node 1 00:24:41.272 [2024-04-26 20:41:59.379239] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:41.273 [2024-04-26 20:41:59.442059] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:41.273 [2024-04-26 20:41:59.442195] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:41.273 [2024-04-26 20:41:59.442205] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:41.273 [2024-04-26 20:41:59.442213] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:41.273 [2024-04-26 20:41:59.442283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:41.273 [2024-04-26 20:41:59.442402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:41.273 [2024-04-26 20:41:59.442674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:41.273 [2024-04-26 20:41:59.442675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:41.842 20:42:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:41.843 20:42:00 -- common/autotest_common.sh@852 -- # return 0 00:24:41.843 20:42:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:41.843 20:42:00 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:41.843 20:42:00 -- common/autotest_common.sh@10 -- # set +x 00:24:41.843 20:42:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:41.843 20:42:00 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:41.843 20:42:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:41.843 20:42:00 -- common/autotest_common.sh@10 -- # set +x 00:24:41.843 [2024-04-26 20:42:00.165654] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:41.843 20:42:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:41.843 20:42:00 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:41.843 20:42:00 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:41.843 20:42:00 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:41.843 20:42:00 -- common/autotest_common.sh@10 -- # set +x 00:24:41.843 20:42:00 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:41.843 20:42:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:41.843 20:42:00 -- target/shutdown.sh@28 -- # cat 00:24:42.103 20:42:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:42.103 20:42:00 -- target/shutdown.sh@28 -- # cat 00:24:42.103 20:42:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:42.103 20:42:00 -- target/shutdown.sh@28 -- # cat 00:24:42.103 20:42:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:42.103 20:42:00 -- target/shutdown.sh@28 -- # cat 00:24:42.103 20:42:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:42.103 20:42:00 -- target/shutdown.sh@28 -- # cat 00:24:42.103 20:42:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:42.103 20:42:00 -- target/shutdown.sh@28 -- # cat 00:24:42.103 20:42:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:42.103 20:42:00 -- target/shutdown.sh@28 -- # cat 00:24:42.103 20:42:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:42.103 20:42:00 -- target/shutdown.sh@28 -- # cat 00:24:42.103 20:42:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:42.103 20:42:00 -- target/shutdown.sh@28 -- # cat 00:24:42.103 20:42:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:42.103 20:42:00 -- target/shutdown.sh@28 -- # cat 00:24:42.103 20:42:00 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:42.103 20:42:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:42.103 20:42:00 -- common/autotest_common.sh@10 -- # set +x 00:24:42.103 Malloc1 00:24:42.103 [2024-04-26 20:42:00.266346] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:42.103 Malloc2 00:24:42.103 Malloc3 00:24:42.103 Malloc4 00:24:42.103 Malloc5 00:24:42.103 Malloc6 00:24:42.365 Malloc7 00:24:42.365 Malloc8 00:24:42.365 Malloc9 00:24:42.365 Malloc10 00:24:42.365 20:42:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:42.365 20:42:00 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:42.365 20:42:00 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:42.365 20:42:00 -- common/autotest_common.sh@10 -- # set +x 00:24:42.365 20:42:00 -- target/shutdown.sh@102 -- # perfpid=4156819 00:24:42.365 20:42:00 -- target/shutdown.sh@103 -- # waitforlisten 4156819 /var/tmp/bdevperf.sock 00:24:42.365 20:42:00 -- common/autotest_common.sh@819 -- # '[' -z 4156819 ']' 00:24:42.365 20:42:00 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:42.365 20:42:00 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:42.365 20:42:00 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:42.365 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:42.365 20:42:00 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:24:42.365 20:42:00 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:42.365 20:42:00 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:42.365 20:42:00 -- common/autotest_common.sh@10 -- # set +x 00:24:42.365 20:42:00 -- nvmf/common.sh@520 -- # config=() 00:24:42.365 20:42:00 -- nvmf/common.sh@520 -- # local subsystem config 00:24:42.365 20:42:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:42.365 20:42:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:42.365 { 00:24:42.365 "params": { 00:24:42.365 "name": "Nvme$subsystem", 00:24:42.365 "trtype": "$TEST_TRANSPORT", 00:24:42.365 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.365 "adrfam": "ipv4", 00:24:42.365 "trsvcid": "$NVMF_PORT", 00:24:42.365 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.365 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.365 "hdgst": ${hdgst:-false}, 00:24:42.365 "ddgst": ${ddgst:-false} 00:24:42.365 }, 00:24:42.365 "method": "bdev_nvme_attach_controller" 00:24:42.365 } 00:24:42.365 EOF 00:24:42.365 )") 00:24:42.365 20:42:00 -- nvmf/common.sh@542 -- # cat 00:24:42.365 20:42:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:42.365 20:42:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:42.365 { 00:24:42.365 "params": { 00:24:42.365 "name": "Nvme$subsystem", 00:24:42.365 "trtype": "$TEST_TRANSPORT", 00:24:42.365 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.365 "adrfam": "ipv4", 00:24:42.365 "trsvcid": "$NVMF_PORT", 00:24:42.365 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.365 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.365 "hdgst": ${hdgst:-false}, 00:24:42.365 "ddgst": ${ddgst:-false} 00:24:42.365 }, 00:24:42.365 "method": "bdev_nvme_attach_controller" 00:24:42.365 } 00:24:42.365 EOF 00:24:42.365 )") 00:24:42.365 20:42:00 -- nvmf/common.sh@542 -- # cat 00:24:42.365 20:42:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:42.365 20:42:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:42.365 { 00:24:42.365 "params": { 00:24:42.365 "name": "Nvme$subsystem", 00:24:42.365 "trtype": "$TEST_TRANSPORT", 00:24:42.365 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.365 "adrfam": "ipv4", 00:24:42.365 "trsvcid": "$NVMF_PORT", 00:24:42.365 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.365 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.365 "hdgst": ${hdgst:-false}, 00:24:42.365 "ddgst": ${ddgst:-false} 00:24:42.365 }, 00:24:42.365 "method": "bdev_nvme_attach_controller" 00:24:42.365 } 00:24:42.365 EOF 00:24:42.365 )") 00:24:42.365 20:42:00 -- nvmf/common.sh@542 -- # cat 00:24:42.365 20:42:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:42.365 20:42:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:42.365 { 00:24:42.365 "params": { 00:24:42.365 "name": "Nvme$subsystem", 00:24:42.365 "trtype": "$TEST_TRANSPORT", 00:24:42.365 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.365 "adrfam": "ipv4", 00:24:42.365 "trsvcid": "$NVMF_PORT", 00:24:42.365 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.365 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.365 "hdgst": ${hdgst:-false}, 00:24:42.365 "ddgst": ${ddgst:-false} 00:24:42.365 }, 00:24:42.365 "method": "bdev_nvme_attach_controller" 00:24:42.365 } 00:24:42.365 EOF 00:24:42.365 )") 00:24:42.365 20:42:00 -- nvmf/common.sh@542 -- # cat 00:24:42.365 20:42:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:42.365 20:42:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:42.365 { 00:24:42.365 "params": { 00:24:42.366 "name": "Nvme$subsystem", 00:24:42.366 "trtype": "$TEST_TRANSPORT", 00:24:42.366 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.366 "adrfam": "ipv4", 00:24:42.366 "trsvcid": "$NVMF_PORT", 00:24:42.366 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.366 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.366 "hdgst": ${hdgst:-false}, 00:24:42.366 "ddgst": ${ddgst:-false} 00:24:42.366 }, 00:24:42.366 "method": "bdev_nvme_attach_controller" 00:24:42.366 } 00:24:42.366 EOF 00:24:42.366 )") 00:24:42.628 20:42:00 -- nvmf/common.sh@542 -- # cat 00:24:42.628 20:42:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:42.628 20:42:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:42.628 { 00:24:42.628 "params": { 00:24:42.628 "name": "Nvme$subsystem", 00:24:42.628 "trtype": "$TEST_TRANSPORT", 00:24:42.628 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.628 "adrfam": "ipv4", 00:24:42.628 "trsvcid": "$NVMF_PORT", 00:24:42.628 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.628 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.628 "hdgst": ${hdgst:-false}, 00:24:42.628 "ddgst": ${ddgst:-false} 00:24:42.628 }, 00:24:42.628 "method": "bdev_nvme_attach_controller" 00:24:42.628 } 00:24:42.628 EOF 00:24:42.628 )") 00:24:42.628 [2024-04-26 20:42:00.714838] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:24:42.628 [2024-04-26 20:42:00.714895] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4156819 ] 00:24:42.628 20:42:00 -- nvmf/common.sh@542 -- # cat 00:24:42.628 20:42:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:42.628 20:42:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:42.628 { 00:24:42.628 "params": { 00:24:42.628 "name": "Nvme$subsystem", 00:24:42.628 "trtype": "$TEST_TRANSPORT", 00:24:42.628 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.628 "adrfam": "ipv4", 00:24:42.628 "trsvcid": "$NVMF_PORT", 00:24:42.628 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.628 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.628 "hdgst": ${hdgst:-false}, 00:24:42.628 "ddgst": ${ddgst:-false} 00:24:42.628 }, 00:24:42.628 "method": "bdev_nvme_attach_controller" 00:24:42.628 } 00:24:42.628 EOF 00:24:42.628 )") 00:24:42.628 20:42:00 -- nvmf/common.sh@542 -- # cat 00:24:42.628 20:42:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:42.628 20:42:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:42.628 { 00:24:42.628 "params": { 00:24:42.628 "name": "Nvme$subsystem", 00:24:42.628 "trtype": "$TEST_TRANSPORT", 00:24:42.628 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.628 "adrfam": "ipv4", 00:24:42.628 "trsvcid": "$NVMF_PORT", 00:24:42.628 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.628 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.628 "hdgst": ${hdgst:-false}, 00:24:42.628 "ddgst": ${ddgst:-false} 00:24:42.628 }, 00:24:42.628 "method": "bdev_nvme_attach_controller" 00:24:42.628 } 00:24:42.628 EOF 00:24:42.628 )") 00:24:42.628 20:42:00 -- nvmf/common.sh@542 -- # cat 00:24:42.628 20:42:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:42.628 20:42:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:42.628 { 00:24:42.628 "params": { 00:24:42.628 "name": "Nvme$subsystem", 00:24:42.628 "trtype": "$TEST_TRANSPORT", 00:24:42.628 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.628 "adrfam": "ipv4", 00:24:42.628 "trsvcid": "$NVMF_PORT", 00:24:42.628 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.628 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.628 "hdgst": ${hdgst:-false}, 00:24:42.628 "ddgst": ${ddgst:-false} 00:24:42.628 }, 00:24:42.628 "method": "bdev_nvme_attach_controller" 00:24:42.628 } 00:24:42.628 EOF 00:24:42.628 )") 00:24:42.628 20:42:00 -- nvmf/common.sh@542 -- # cat 00:24:42.628 EAL: No free 2048 kB hugepages reported on node 1 00:24:42.628 20:42:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:42.628 20:42:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:42.628 { 00:24:42.628 "params": { 00:24:42.628 "name": "Nvme$subsystem", 00:24:42.628 "trtype": "$TEST_TRANSPORT", 00:24:42.628 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:42.628 "adrfam": "ipv4", 00:24:42.628 "trsvcid": "$NVMF_PORT", 00:24:42.628 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:42.628 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:42.628 "hdgst": ${hdgst:-false}, 00:24:42.628 "ddgst": ${ddgst:-false} 00:24:42.628 }, 00:24:42.628 "method": "bdev_nvme_attach_controller" 00:24:42.628 } 00:24:42.628 EOF 00:24:42.628 )") 00:24:42.628 20:42:00 -- nvmf/common.sh@542 -- # cat 00:24:42.628 20:42:00 -- nvmf/common.sh@544 -- # jq . 00:24:42.628 20:42:00 -- nvmf/common.sh@545 -- # IFS=, 00:24:42.628 20:42:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:42.628 "params": { 00:24:42.628 "name": "Nvme1", 00:24:42.628 "trtype": "tcp", 00:24:42.628 "traddr": "10.0.0.2", 00:24:42.628 "adrfam": "ipv4", 00:24:42.628 "trsvcid": "4420", 00:24:42.628 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:42.628 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:42.628 "hdgst": false, 00:24:42.628 "ddgst": false 00:24:42.628 }, 00:24:42.628 "method": "bdev_nvme_attach_controller" 00:24:42.628 },{ 00:24:42.628 "params": { 00:24:42.628 "name": "Nvme2", 00:24:42.628 "trtype": "tcp", 00:24:42.628 "traddr": "10.0.0.2", 00:24:42.628 "adrfam": "ipv4", 00:24:42.628 "trsvcid": "4420", 00:24:42.628 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:42.628 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:42.628 "hdgst": false, 00:24:42.628 "ddgst": false 00:24:42.628 }, 00:24:42.628 "method": "bdev_nvme_attach_controller" 00:24:42.628 },{ 00:24:42.628 "params": { 00:24:42.628 "name": "Nvme3", 00:24:42.628 "trtype": "tcp", 00:24:42.628 "traddr": "10.0.0.2", 00:24:42.628 "adrfam": "ipv4", 00:24:42.628 "trsvcid": "4420", 00:24:42.628 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:42.628 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:42.628 "hdgst": false, 00:24:42.628 "ddgst": false 00:24:42.628 }, 00:24:42.628 "method": "bdev_nvme_attach_controller" 00:24:42.628 },{ 00:24:42.628 "params": { 00:24:42.628 "name": "Nvme4", 00:24:42.628 "trtype": "tcp", 00:24:42.628 "traddr": "10.0.0.2", 00:24:42.628 "adrfam": "ipv4", 00:24:42.628 "trsvcid": "4420", 00:24:42.628 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:42.628 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:42.628 "hdgst": false, 00:24:42.628 "ddgst": false 00:24:42.628 }, 00:24:42.628 "method": "bdev_nvme_attach_controller" 00:24:42.628 },{ 00:24:42.628 "params": { 00:24:42.628 "name": "Nvme5", 00:24:42.628 "trtype": "tcp", 00:24:42.628 "traddr": "10.0.0.2", 00:24:42.628 "adrfam": "ipv4", 00:24:42.628 "trsvcid": "4420", 00:24:42.628 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:42.628 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:42.628 "hdgst": false, 00:24:42.628 "ddgst": false 00:24:42.628 }, 00:24:42.628 "method": "bdev_nvme_attach_controller" 00:24:42.628 },{ 00:24:42.628 "params": { 00:24:42.628 "name": "Nvme6", 00:24:42.628 "trtype": "tcp", 00:24:42.628 "traddr": "10.0.0.2", 00:24:42.628 "adrfam": "ipv4", 00:24:42.628 "trsvcid": "4420", 00:24:42.628 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:42.628 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:42.628 "hdgst": false, 00:24:42.628 "ddgst": false 00:24:42.628 }, 00:24:42.628 "method": "bdev_nvme_attach_controller" 00:24:42.628 },{ 00:24:42.628 "params": { 00:24:42.628 "name": "Nvme7", 00:24:42.628 "trtype": "tcp", 00:24:42.628 "traddr": "10.0.0.2", 00:24:42.628 "adrfam": "ipv4", 00:24:42.628 "trsvcid": "4420", 00:24:42.628 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:42.628 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:42.628 "hdgst": false, 00:24:42.628 "ddgst": false 00:24:42.628 }, 00:24:42.628 "method": "bdev_nvme_attach_controller" 00:24:42.628 },{ 00:24:42.628 "params": { 00:24:42.628 "name": "Nvme8", 00:24:42.628 "trtype": "tcp", 00:24:42.628 "traddr": "10.0.0.2", 00:24:42.628 "adrfam": "ipv4", 00:24:42.628 "trsvcid": "4420", 00:24:42.629 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:42.629 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:42.629 "hdgst": false, 00:24:42.629 "ddgst": false 00:24:42.629 }, 00:24:42.629 "method": "bdev_nvme_attach_controller" 00:24:42.629 },{ 00:24:42.629 "params": { 00:24:42.629 "name": "Nvme9", 00:24:42.629 "trtype": "tcp", 00:24:42.629 "traddr": "10.0.0.2", 00:24:42.629 "adrfam": "ipv4", 00:24:42.629 "trsvcid": "4420", 00:24:42.629 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:42.629 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:42.629 "hdgst": false, 00:24:42.629 "ddgst": false 00:24:42.629 }, 00:24:42.629 "method": "bdev_nvme_attach_controller" 00:24:42.629 },{ 00:24:42.629 "params": { 00:24:42.629 "name": "Nvme10", 00:24:42.629 "trtype": "tcp", 00:24:42.629 "traddr": "10.0.0.2", 00:24:42.629 "adrfam": "ipv4", 00:24:42.629 "trsvcid": "4420", 00:24:42.629 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:42.629 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:42.629 "hdgst": false, 00:24:42.629 "ddgst": false 00:24:42.629 }, 00:24:42.629 "method": "bdev_nvme_attach_controller" 00:24:42.629 }' 00:24:42.629 [2024-04-26 20:42:00.774904] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:42.629 [2024-04-26 20:42:00.838184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:44.014 Running I/O for 10 seconds... 00:24:44.014 20:42:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:44.014 20:42:02 -- common/autotest_common.sh@852 -- # return 0 00:24:44.014 20:42:02 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:44.014 20:42:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:44.014 20:42:02 -- common/autotest_common.sh@10 -- # set +x 00:24:44.014 20:42:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:44.014 20:42:02 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:24:44.014 20:42:02 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:24:44.014 20:42:02 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:24:44.014 20:42:02 -- target/shutdown.sh@57 -- # local ret=1 00:24:44.014 20:42:02 -- target/shutdown.sh@58 -- # local i 00:24:44.014 20:42:02 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:24:44.014 20:42:02 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:44.014 20:42:02 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:44.014 20:42:02 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:44.014 20:42:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:44.014 20:42:02 -- common/autotest_common.sh@10 -- # set +x 00:24:44.014 20:42:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:44.014 20:42:02 -- target/shutdown.sh@60 -- # read_io_count=3 00:24:44.014 20:42:02 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:24:44.014 20:42:02 -- target/shutdown.sh@67 -- # sleep 0.25 00:24:44.275 20:42:02 -- target/shutdown.sh@59 -- # (( i-- )) 00:24:44.275 20:42:02 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:44.275 20:42:02 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:44.275 20:42:02 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:44.275 20:42:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:44.275 20:42:02 -- common/autotest_common.sh@10 -- # set +x 00:24:44.275 20:42:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:44.275 20:42:02 -- target/shutdown.sh@60 -- # read_io_count=129 00:24:44.275 20:42:02 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:24:44.275 20:42:02 -- target/shutdown.sh@64 -- # ret=0 00:24:44.275 20:42:02 -- target/shutdown.sh@65 -- # break 00:24:44.275 20:42:02 -- target/shutdown.sh@69 -- # return 0 00:24:44.275 20:42:02 -- target/shutdown.sh@109 -- # killprocess 4156819 00:24:44.275 20:42:02 -- common/autotest_common.sh@926 -- # '[' -z 4156819 ']' 00:24:44.275 20:42:02 -- common/autotest_common.sh@930 -- # kill -0 4156819 00:24:44.275 20:42:02 -- common/autotest_common.sh@931 -- # uname 00:24:44.275 20:42:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:44.275 20:42:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4156819 00:24:44.275 20:42:02 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:44.275 20:42:02 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:44.275 20:42:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4156819' 00:24:44.276 killing process with pid 4156819 00:24:44.276 20:42:02 -- common/autotest_common.sh@945 -- # kill 4156819 00:24:44.276 20:42:02 -- common/autotest_common.sh@950 -- # wait 4156819 00:24:44.536 Received shutdown signal, test time was about 0.637317 seconds 00:24:44.536 00:24:44.537 Latency(us) 00:24:44.537 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:44.537 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:44.537 Verification LBA range: start 0x0 length 0x400 00:24:44.537 Nvme1n1 : 0.58 389.97 24.37 0.00 0.00 158364.29 14854.83 159034.03 00:24:44.537 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:44.537 Verification LBA range: start 0x0 length 0x400 00:24:44.537 Nvme2n1 : 0.64 427.39 26.71 0.00 0.00 135072.23 15400.96 124081.49 00:24:44.537 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:44.537 Verification LBA range: start 0x0 length 0x400 00:24:44.537 Nvme3n1 : 0.59 460.64 28.79 0.00 0.00 131079.43 17257.81 114469.55 00:24:44.537 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:44.537 Verification LBA range: start 0x0 length 0x400 00:24:44.537 Nvme4n1 : 0.59 462.65 28.92 0.00 0.00 128821.01 16602.45 110537.39 00:24:44.537 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:44.537 Verification LBA range: start 0x0 length 0x400 00:24:44.537 Nvme5n1 : 0.58 482.32 30.15 0.00 0.00 121418.85 4915.20 111411.20 00:24:44.537 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:44.537 Verification LBA range: start 0x0 length 0x400 00:24:44.537 Nvme6n1 : 0.57 403.67 25.23 0.00 0.00 143606.48 4205.23 121460.05 00:24:44.537 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:44.537 Verification LBA range: start 0x0 length 0x400 00:24:44.537 Nvme7n1 : 0.59 457.99 28.62 0.00 0.00 124724.61 16384.00 110537.39 00:24:44.537 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:44.537 Verification LBA range: start 0x0 length 0x400 00:24:44.537 Nvme8n1 : 0.60 452.60 28.29 0.00 0.00 124314.41 12943.36 111848.11 00:24:44.537 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:44.537 Verification LBA range: start 0x0 length 0x400 00:24:44.537 Nvme9n1 : 0.57 398.94 24.93 0.00 0.00 138103.05 14745.60 117090.99 00:24:44.537 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:44.537 Verification LBA range: start 0x0 length 0x400 00:24:44.537 Nvme10n1 : 0.59 388.89 24.31 0.00 0.00 140155.54 15291.73 127576.75 00:24:44.537 =================================================================================================================== 00:24:44.537 Total : 4325.07 270.32 0.00 0.00 133819.05 4205.23 159034.03 00:24:44.537 20:42:02 -- target/shutdown.sh@112 -- # sleep 1 00:24:45.921 20:42:03 -- target/shutdown.sh@113 -- # kill -0 4156536 00:24:45.921 20:42:03 -- target/shutdown.sh@115 -- # stoptarget 00:24:45.921 20:42:03 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:45.921 20:42:03 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:45.921 20:42:03 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:45.921 20:42:03 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:45.921 20:42:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:45.921 20:42:03 -- nvmf/common.sh@116 -- # sync 00:24:45.921 20:42:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:45.921 20:42:03 -- nvmf/common.sh@119 -- # set +e 00:24:45.921 20:42:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:45.921 20:42:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:45.921 rmmod nvme_tcp 00:24:45.921 rmmod nvme_fabrics 00:24:45.921 rmmod nvme_keyring 00:24:45.921 20:42:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:45.921 20:42:03 -- nvmf/common.sh@123 -- # set -e 00:24:45.921 20:42:03 -- nvmf/common.sh@124 -- # return 0 00:24:45.921 20:42:03 -- nvmf/common.sh@477 -- # '[' -n 4156536 ']' 00:24:45.921 20:42:03 -- nvmf/common.sh@478 -- # killprocess 4156536 00:24:45.921 20:42:03 -- common/autotest_common.sh@926 -- # '[' -z 4156536 ']' 00:24:45.921 20:42:03 -- common/autotest_common.sh@930 -- # kill -0 4156536 00:24:45.921 20:42:03 -- common/autotest_common.sh@931 -- # uname 00:24:45.921 20:42:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:45.921 20:42:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4156536 00:24:45.921 20:42:04 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:24:45.921 20:42:04 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:24:45.921 20:42:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4156536' 00:24:45.921 killing process with pid 4156536 00:24:45.921 20:42:04 -- common/autotest_common.sh@945 -- # kill 4156536 00:24:45.921 20:42:04 -- common/autotest_common.sh@950 -- # wait 4156536 00:24:46.182 20:42:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:46.182 20:42:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:46.182 20:42:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:46.182 20:42:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:46.182 20:42:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:46.182 20:42:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:46.182 20:42:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:46.182 20:42:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:48.098 20:42:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:48.098 00:24:48.098 real 0m7.452s 00:24:48.098 user 0m21.605s 00:24:48.098 sys 0m1.211s 00:24:48.098 20:42:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:48.098 20:42:06 -- common/autotest_common.sh@10 -- # set +x 00:24:48.098 ************************************ 00:24:48.098 END TEST nvmf_shutdown_tc2 00:24:48.098 ************************************ 00:24:48.098 20:42:06 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:24:48.098 20:42:06 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:24:48.098 20:42:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:48.098 20:42:06 -- common/autotest_common.sh@10 -- # set +x 00:24:48.098 ************************************ 00:24:48.098 START TEST nvmf_shutdown_tc3 00:24:48.098 ************************************ 00:24:48.098 20:42:06 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc3 00:24:48.098 20:42:06 -- target/shutdown.sh@120 -- # starttarget 00:24:48.098 20:42:06 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:48.098 20:42:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:48.098 20:42:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:48.098 20:42:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:48.098 20:42:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:48.098 20:42:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:48.098 20:42:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:48.098 20:42:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:48.098 20:42:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:48.098 20:42:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:48.098 20:42:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:48.098 20:42:06 -- common/autotest_common.sh@10 -- # set +x 00:24:48.098 20:42:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:48.098 20:42:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:48.098 20:42:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:48.098 20:42:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:48.098 20:42:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:48.098 20:42:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:48.098 20:42:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:48.098 20:42:06 -- nvmf/common.sh@294 -- # net_devs=() 00:24:48.098 20:42:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:48.098 20:42:06 -- nvmf/common.sh@295 -- # e810=() 00:24:48.098 20:42:06 -- nvmf/common.sh@295 -- # local -ga e810 00:24:48.098 20:42:06 -- nvmf/common.sh@296 -- # x722=() 00:24:48.098 20:42:06 -- nvmf/common.sh@296 -- # local -ga x722 00:24:48.098 20:42:06 -- nvmf/common.sh@297 -- # mlx=() 00:24:48.098 20:42:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:48.098 20:42:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:48.098 20:42:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:48.098 20:42:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:48.098 20:42:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:48.098 20:42:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:48.098 20:42:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:48.098 20:42:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:48.098 20:42:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:48.098 20:42:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:48.098 20:42:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:48.098 20:42:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:48.098 20:42:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:48.098 20:42:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:48.098 20:42:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:48.098 20:42:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:48.098 20:42:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:24:48.098 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:24:48.098 20:42:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:48.098 20:42:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:24:48.098 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:24:48.098 20:42:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:48.098 20:42:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:48.098 20:42:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:48.098 20:42:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:48.098 20:42:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:48.098 20:42:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:24:48.098 Found net devices under 0000:4b:00.0: cvl_0_0 00:24:48.098 20:42:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:48.098 20:42:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:48.098 20:42:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:48.098 20:42:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:48.098 20:42:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:48.098 20:42:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:24:48.098 Found net devices under 0000:4b:00.1: cvl_0_1 00:24:48.098 20:42:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:48.098 20:42:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:48.098 20:42:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:48.098 20:42:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:48.098 20:42:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:48.098 20:42:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:48.098 20:42:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:48.098 20:42:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:48.098 20:42:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:48.098 20:42:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:48.098 20:42:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:48.098 20:42:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:48.098 20:42:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:48.098 20:42:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:48.098 20:42:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:48.098 20:42:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:48.098 20:42:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:48.098 20:42:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:48.360 20:42:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:48.360 20:42:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:48.360 20:42:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:48.360 20:42:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:48.360 20:42:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:48.360 20:42:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:48.360 20:42:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:48.360 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:48.360 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.794 ms 00:24:48.360 00:24:48.360 --- 10.0.0.2 ping statistics --- 00:24:48.360 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:48.360 rtt min/avg/max/mdev = 0.794/0.794/0.794/0.000 ms 00:24:48.360 20:42:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:48.360 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:48.360 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.382 ms 00:24:48.360 00:24:48.360 --- 10.0.0.1 ping statistics --- 00:24:48.360 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:48.360 rtt min/avg/max/mdev = 0.382/0.382/0.382/0.000 ms 00:24:48.360 20:42:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:48.360 20:42:06 -- nvmf/common.sh@410 -- # return 0 00:24:48.360 20:42:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:48.360 20:42:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:48.360 20:42:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:48.360 20:42:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:48.360 20:42:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:48.360 20:42:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:48.360 20:42:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:48.360 20:42:06 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:48.360 20:42:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:48.360 20:42:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:48.360 20:42:06 -- common/autotest_common.sh@10 -- # set +x 00:24:48.360 20:42:06 -- nvmf/common.sh@469 -- # nvmfpid=4158175 00:24:48.360 20:42:06 -- nvmf/common.sh@470 -- # waitforlisten 4158175 00:24:48.360 20:42:06 -- common/autotest_common.sh@819 -- # '[' -z 4158175 ']' 00:24:48.360 20:42:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:48.360 20:42:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:48.360 20:42:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:48.360 20:42:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:48.360 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:48.360 20:42:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:48.360 20:42:06 -- common/autotest_common.sh@10 -- # set +x 00:24:48.621 [2024-04-26 20:42:06.760181] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:24:48.621 [2024-04-26 20:42:06.760235] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:48.621 EAL: No free 2048 kB hugepages reported on node 1 00:24:48.621 [2024-04-26 20:42:06.827010] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:48.621 [2024-04-26 20:42:06.894120] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:48.621 [2024-04-26 20:42:06.894254] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:48.621 [2024-04-26 20:42:06.894264] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:48.621 [2024-04-26 20:42:06.894272] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:48.621 [2024-04-26 20:42:06.894421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:48.621 [2024-04-26 20:42:06.894654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:48.621 [2024-04-26 20:42:06.894816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:48.621 [2024-04-26 20:42:06.894817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:49.194 20:42:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:49.194 20:42:07 -- common/autotest_common.sh@852 -- # return 0 00:24:49.194 20:42:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:49.194 20:42:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:49.194 20:42:07 -- common/autotest_common.sh@10 -- # set +x 00:24:49.456 20:42:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:49.456 20:42:07 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:49.456 20:42:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:49.456 20:42:07 -- common/autotest_common.sh@10 -- # set +x 00:24:49.456 [2024-04-26 20:42:07.564483] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:49.456 20:42:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:49.456 20:42:07 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:49.456 20:42:07 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:49.456 20:42:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:49.456 20:42:07 -- common/autotest_common.sh@10 -- # set +x 00:24:49.456 20:42:07 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:49.456 20:42:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.456 20:42:07 -- target/shutdown.sh@28 -- # cat 00:24:49.456 20:42:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.456 20:42:07 -- target/shutdown.sh@28 -- # cat 00:24:49.456 20:42:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.456 20:42:07 -- target/shutdown.sh@28 -- # cat 00:24:49.456 20:42:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.456 20:42:07 -- target/shutdown.sh@28 -- # cat 00:24:49.456 20:42:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.456 20:42:07 -- target/shutdown.sh@28 -- # cat 00:24:49.456 20:42:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.456 20:42:07 -- target/shutdown.sh@28 -- # cat 00:24:49.456 20:42:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.456 20:42:07 -- target/shutdown.sh@28 -- # cat 00:24:49.456 20:42:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.456 20:42:07 -- target/shutdown.sh@28 -- # cat 00:24:49.456 20:42:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.456 20:42:07 -- target/shutdown.sh@28 -- # cat 00:24:49.456 20:42:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:49.456 20:42:07 -- target/shutdown.sh@28 -- # cat 00:24:49.456 20:42:07 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:49.456 20:42:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:49.456 20:42:07 -- common/autotest_common.sh@10 -- # set +x 00:24:49.456 Malloc1 00:24:49.456 [2024-04-26 20:42:07.665097] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:49.456 Malloc2 00:24:49.456 Malloc3 00:24:49.456 Malloc4 00:24:49.456 Malloc5 00:24:49.718 Malloc6 00:24:49.718 Malloc7 00:24:49.718 Malloc8 00:24:49.718 Malloc9 00:24:49.718 Malloc10 00:24:49.718 20:42:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:49.718 20:42:08 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:49.718 20:42:08 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:49.718 20:42:08 -- common/autotest_common.sh@10 -- # set +x 00:24:49.980 20:42:08 -- target/shutdown.sh@124 -- # perfpid=4158561 00:24:49.980 20:42:08 -- target/shutdown.sh@125 -- # waitforlisten 4158561 /var/tmp/bdevperf.sock 00:24:49.980 20:42:08 -- common/autotest_common.sh@819 -- # '[' -z 4158561 ']' 00:24:49.980 20:42:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:49.980 20:42:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:49.980 20:42:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:49.980 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:49.980 20:42:08 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:24:49.980 20:42:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:49.980 20:42:08 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:49.980 20:42:08 -- common/autotest_common.sh@10 -- # set +x 00:24:49.980 20:42:08 -- nvmf/common.sh@520 -- # config=() 00:24:49.980 20:42:08 -- nvmf/common.sh@520 -- # local subsystem config 00:24:49.980 20:42:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:49.980 { 00:24:49.980 "params": { 00:24:49.980 "name": "Nvme$subsystem", 00:24:49.980 "trtype": "$TEST_TRANSPORT", 00:24:49.980 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:49.980 "adrfam": "ipv4", 00:24:49.980 "trsvcid": "$NVMF_PORT", 00:24:49.980 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:49.980 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:49.980 "hdgst": ${hdgst:-false}, 00:24:49.980 "ddgst": ${ddgst:-false} 00:24:49.980 }, 00:24:49.980 "method": "bdev_nvme_attach_controller" 00:24:49.980 } 00:24:49.980 EOF 00:24:49.980 )") 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # cat 00:24:49.980 20:42:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:49.980 { 00:24:49.980 "params": { 00:24:49.980 "name": "Nvme$subsystem", 00:24:49.980 "trtype": "$TEST_TRANSPORT", 00:24:49.980 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:49.980 "adrfam": "ipv4", 00:24:49.980 "trsvcid": "$NVMF_PORT", 00:24:49.980 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:49.980 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:49.980 "hdgst": ${hdgst:-false}, 00:24:49.980 "ddgst": ${ddgst:-false} 00:24:49.980 }, 00:24:49.980 "method": "bdev_nvme_attach_controller" 00:24:49.980 } 00:24:49.980 EOF 00:24:49.980 )") 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # cat 00:24:49.980 20:42:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:49.980 { 00:24:49.980 "params": { 00:24:49.980 "name": "Nvme$subsystem", 00:24:49.980 "trtype": "$TEST_TRANSPORT", 00:24:49.980 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:49.980 "adrfam": "ipv4", 00:24:49.980 "trsvcid": "$NVMF_PORT", 00:24:49.980 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:49.980 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:49.980 "hdgst": ${hdgst:-false}, 00:24:49.980 "ddgst": ${ddgst:-false} 00:24:49.980 }, 00:24:49.980 "method": "bdev_nvme_attach_controller" 00:24:49.980 } 00:24:49.980 EOF 00:24:49.980 )") 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # cat 00:24:49.980 20:42:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:49.980 { 00:24:49.980 "params": { 00:24:49.980 "name": "Nvme$subsystem", 00:24:49.980 "trtype": "$TEST_TRANSPORT", 00:24:49.980 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:49.980 "adrfam": "ipv4", 00:24:49.980 "trsvcid": "$NVMF_PORT", 00:24:49.980 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:49.980 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:49.980 "hdgst": ${hdgst:-false}, 00:24:49.980 "ddgst": ${ddgst:-false} 00:24:49.980 }, 00:24:49.980 "method": "bdev_nvme_attach_controller" 00:24:49.980 } 00:24:49.980 EOF 00:24:49.980 )") 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # cat 00:24:49.980 20:42:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:49.980 { 00:24:49.980 "params": { 00:24:49.980 "name": "Nvme$subsystem", 00:24:49.980 "trtype": "$TEST_TRANSPORT", 00:24:49.980 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:49.980 "adrfam": "ipv4", 00:24:49.980 "trsvcid": "$NVMF_PORT", 00:24:49.980 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:49.980 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:49.980 "hdgst": ${hdgst:-false}, 00:24:49.980 "ddgst": ${ddgst:-false} 00:24:49.980 }, 00:24:49.980 "method": "bdev_nvme_attach_controller" 00:24:49.980 } 00:24:49.980 EOF 00:24:49.980 )") 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # cat 00:24:49.980 20:42:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:49.980 { 00:24:49.980 "params": { 00:24:49.980 "name": "Nvme$subsystem", 00:24:49.980 "trtype": "$TEST_TRANSPORT", 00:24:49.980 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:49.980 "adrfam": "ipv4", 00:24:49.980 "trsvcid": "$NVMF_PORT", 00:24:49.980 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:49.980 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:49.980 "hdgst": ${hdgst:-false}, 00:24:49.980 "ddgst": ${ddgst:-false} 00:24:49.980 }, 00:24:49.980 "method": "bdev_nvme_attach_controller" 00:24:49.980 } 00:24:49.980 EOF 00:24:49.980 )") 00:24:49.980 [2024-04-26 20:42:08.108143] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:24:49.980 [2024-04-26 20:42:08.108200] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4158561 ] 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # cat 00:24:49.980 20:42:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:49.980 { 00:24:49.980 "params": { 00:24:49.980 "name": "Nvme$subsystem", 00:24:49.980 "trtype": "$TEST_TRANSPORT", 00:24:49.980 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:49.980 "adrfam": "ipv4", 00:24:49.980 "trsvcid": "$NVMF_PORT", 00:24:49.980 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:49.980 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:49.980 "hdgst": ${hdgst:-false}, 00:24:49.980 "ddgst": ${ddgst:-false} 00:24:49.980 }, 00:24:49.980 "method": "bdev_nvme_attach_controller" 00:24:49.980 } 00:24:49.980 EOF 00:24:49.980 )") 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # cat 00:24:49.980 20:42:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:49.980 20:42:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:49.981 { 00:24:49.981 "params": { 00:24:49.981 "name": "Nvme$subsystem", 00:24:49.981 "trtype": "$TEST_TRANSPORT", 00:24:49.981 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:49.981 "adrfam": "ipv4", 00:24:49.981 "trsvcid": "$NVMF_PORT", 00:24:49.981 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:49.981 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:49.981 "hdgst": ${hdgst:-false}, 00:24:49.981 "ddgst": ${ddgst:-false} 00:24:49.981 }, 00:24:49.981 "method": "bdev_nvme_attach_controller" 00:24:49.981 } 00:24:49.981 EOF 00:24:49.981 )") 00:24:49.981 20:42:08 -- nvmf/common.sh@542 -- # cat 00:24:49.981 20:42:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:49.981 20:42:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:49.981 { 00:24:49.981 "params": { 00:24:49.981 "name": "Nvme$subsystem", 00:24:49.981 "trtype": "$TEST_TRANSPORT", 00:24:49.981 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:49.981 "adrfam": "ipv4", 00:24:49.981 "trsvcid": "$NVMF_PORT", 00:24:49.981 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:49.981 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:49.981 "hdgst": ${hdgst:-false}, 00:24:49.981 "ddgst": ${ddgst:-false} 00:24:49.981 }, 00:24:49.981 "method": "bdev_nvme_attach_controller" 00:24:49.981 } 00:24:49.981 EOF 00:24:49.981 )") 00:24:49.981 20:42:08 -- nvmf/common.sh@542 -- # cat 00:24:49.981 EAL: No free 2048 kB hugepages reported on node 1 00:24:49.981 20:42:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:49.981 20:42:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:49.981 { 00:24:49.981 "params": { 00:24:49.981 "name": "Nvme$subsystem", 00:24:49.981 "trtype": "$TEST_TRANSPORT", 00:24:49.981 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:49.981 "adrfam": "ipv4", 00:24:49.981 "trsvcid": "$NVMF_PORT", 00:24:49.981 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:49.981 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:49.981 "hdgst": ${hdgst:-false}, 00:24:49.981 "ddgst": ${ddgst:-false} 00:24:49.981 }, 00:24:49.981 "method": "bdev_nvme_attach_controller" 00:24:49.981 } 00:24:49.981 EOF 00:24:49.981 )") 00:24:49.981 20:42:08 -- nvmf/common.sh@542 -- # cat 00:24:49.981 20:42:08 -- nvmf/common.sh@544 -- # jq . 00:24:49.981 20:42:08 -- nvmf/common.sh@545 -- # IFS=, 00:24:49.981 20:42:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:49.981 "params": { 00:24:49.981 "name": "Nvme1", 00:24:49.981 "trtype": "tcp", 00:24:49.981 "traddr": "10.0.0.2", 00:24:49.981 "adrfam": "ipv4", 00:24:49.981 "trsvcid": "4420", 00:24:49.981 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:49.981 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:49.981 "hdgst": false, 00:24:49.981 "ddgst": false 00:24:49.981 }, 00:24:49.981 "method": "bdev_nvme_attach_controller" 00:24:49.981 },{ 00:24:49.981 "params": { 00:24:49.981 "name": "Nvme2", 00:24:49.981 "trtype": "tcp", 00:24:49.981 "traddr": "10.0.0.2", 00:24:49.981 "adrfam": "ipv4", 00:24:49.981 "trsvcid": "4420", 00:24:49.981 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:49.981 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:49.981 "hdgst": false, 00:24:49.981 "ddgst": false 00:24:49.981 }, 00:24:49.981 "method": "bdev_nvme_attach_controller" 00:24:49.981 },{ 00:24:49.981 "params": { 00:24:49.981 "name": "Nvme3", 00:24:49.981 "trtype": "tcp", 00:24:49.981 "traddr": "10.0.0.2", 00:24:49.981 "adrfam": "ipv4", 00:24:49.981 "trsvcid": "4420", 00:24:49.981 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:49.981 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:49.981 "hdgst": false, 00:24:49.981 "ddgst": false 00:24:49.981 }, 00:24:49.981 "method": "bdev_nvme_attach_controller" 00:24:49.981 },{ 00:24:49.981 "params": { 00:24:49.981 "name": "Nvme4", 00:24:49.981 "trtype": "tcp", 00:24:49.981 "traddr": "10.0.0.2", 00:24:49.981 "adrfam": "ipv4", 00:24:49.981 "trsvcid": "4420", 00:24:49.981 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:49.981 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:49.981 "hdgst": false, 00:24:49.981 "ddgst": false 00:24:49.981 }, 00:24:49.981 "method": "bdev_nvme_attach_controller" 00:24:49.981 },{ 00:24:49.981 "params": { 00:24:49.981 "name": "Nvme5", 00:24:49.981 "trtype": "tcp", 00:24:49.981 "traddr": "10.0.0.2", 00:24:49.981 "adrfam": "ipv4", 00:24:49.981 "trsvcid": "4420", 00:24:49.981 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:49.981 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:49.981 "hdgst": false, 00:24:49.981 "ddgst": false 00:24:49.981 }, 00:24:49.981 "method": "bdev_nvme_attach_controller" 00:24:49.981 },{ 00:24:49.981 "params": { 00:24:49.981 "name": "Nvme6", 00:24:49.981 "trtype": "tcp", 00:24:49.981 "traddr": "10.0.0.2", 00:24:49.981 "adrfam": "ipv4", 00:24:49.981 "trsvcid": "4420", 00:24:49.981 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:49.981 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:49.981 "hdgst": false, 00:24:49.981 "ddgst": false 00:24:49.981 }, 00:24:49.981 "method": "bdev_nvme_attach_controller" 00:24:49.981 },{ 00:24:49.981 "params": { 00:24:49.981 "name": "Nvme7", 00:24:49.981 "trtype": "tcp", 00:24:49.981 "traddr": "10.0.0.2", 00:24:49.981 "adrfam": "ipv4", 00:24:49.981 "trsvcid": "4420", 00:24:49.981 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:49.981 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:49.981 "hdgst": false, 00:24:49.981 "ddgst": false 00:24:49.981 }, 00:24:49.981 "method": "bdev_nvme_attach_controller" 00:24:49.981 },{ 00:24:49.981 "params": { 00:24:49.981 "name": "Nvme8", 00:24:49.981 "trtype": "tcp", 00:24:49.981 "traddr": "10.0.0.2", 00:24:49.981 "adrfam": "ipv4", 00:24:49.981 "trsvcid": "4420", 00:24:49.981 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:49.981 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:49.981 "hdgst": false, 00:24:49.981 "ddgst": false 00:24:49.981 }, 00:24:49.981 "method": "bdev_nvme_attach_controller" 00:24:49.981 },{ 00:24:49.981 "params": { 00:24:49.981 "name": "Nvme9", 00:24:49.981 "trtype": "tcp", 00:24:49.981 "traddr": "10.0.0.2", 00:24:49.981 "adrfam": "ipv4", 00:24:49.981 "trsvcid": "4420", 00:24:49.981 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:49.981 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:49.981 "hdgst": false, 00:24:49.981 "ddgst": false 00:24:49.981 }, 00:24:49.981 "method": "bdev_nvme_attach_controller" 00:24:49.981 },{ 00:24:49.981 "params": { 00:24:49.981 "name": "Nvme10", 00:24:49.981 "trtype": "tcp", 00:24:49.981 "traddr": "10.0.0.2", 00:24:49.981 "adrfam": "ipv4", 00:24:49.981 "trsvcid": "4420", 00:24:49.981 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:49.981 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:49.981 "hdgst": false, 00:24:49.981 "ddgst": false 00:24:49.981 }, 00:24:49.981 "method": "bdev_nvme_attach_controller" 00:24:49.981 }' 00:24:49.981 [2024-04-26 20:42:08.167876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:49.981 [2024-04-26 20:42:08.230922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:51.368 Running I/O for 10 seconds... 00:24:51.940 20:42:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:51.940 20:42:10 -- common/autotest_common.sh@852 -- # return 0 00:24:51.940 20:42:10 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:51.940 20:42:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:51.940 20:42:10 -- common/autotest_common.sh@10 -- # set +x 00:24:51.940 20:42:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:51.940 20:42:10 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:51.940 20:42:10 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:24:51.940 20:42:10 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:24:51.940 20:42:10 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:24:51.940 20:42:10 -- target/shutdown.sh@57 -- # local ret=1 00:24:51.940 20:42:10 -- target/shutdown.sh@58 -- # local i 00:24:51.940 20:42:10 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:24:51.940 20:42:10 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:51.940 20:42:10 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:51.940 20:42:10 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:51.940 20:42:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:51.940 20:42:10 -- common/autotest_common.sh@10 -- # set +x 00:24:51.940 20:42:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:51.940 20:42:10 -- target/shutdown.sh@60 -- # read_io_count=254 00:24:51.940 20:42:10 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:24:51.940 20:42:10 -- target/shutdown.sh@64 -- # ret=0 00:24:51.940 20:42:10 -- target/shutdown.sh@65 -- # break 00:24:51.940 20:42:10 -- target/shutdown.sh@69 -- # return 0 00:24:51.940 20:42:10 -- target/shutdown.sh@134 -- # killprocess 4158175 00:24:51.940 20:42:10 -- common/autotest_common.sh@926 -- # '[' -z 4158175 ']' 00:24:51.940 20:42:10 -- common/autotest_common.sh@930 -- # kill -0 4158175 00:24:51.940 20:42:10 -- common/autotest_common.sh@931 -- # uname 00:24:51.940 20:42:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:51.940 20:42:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4158175 00:24:52.226 20:42:10 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:24:52.226 20:42:10 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:24:52.226 20:42:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4158175' 00:24:52.226 killing process with pid 4158175 00:24:52.226 20:42:10 -- common/autotest_common.sh@945 -- # kill 4158175 00:24:52.226 20:42:10 -- common/autotest_common.sh@950 -- # wait 4158175 00:24:52.226 [2024-04-26 20:42:10.310509] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310552] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310558] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310563] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310567] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310572] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310576] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310581] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310585] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310590] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310595] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310599] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310604] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310608] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310613] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310617] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310622] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310626] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310631] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310635] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310640] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310644] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310649] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310654] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310658] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310668] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310672] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310677] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310682] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310686] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310690] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310695] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310700] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310709] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310713] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310718] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310722] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310726] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310731] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310735] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310739] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310744] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310748] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310753] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310758] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310762] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310766] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310770] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310775] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310779] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310783] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310789] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310793] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310798] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310802] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310806] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310811] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310815] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.310820] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5070 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312125] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312152] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312160] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312167] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312174] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312180] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312187] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312194] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312200] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312207] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312213] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312226] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312232] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312239] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312252] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312258] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312264] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312275] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312286] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312293] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312299] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312306] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312312] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312319] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312325] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312331] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312338] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312344] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312351] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312357] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312364] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312370] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312376] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312383] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312389] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312395] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312402] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312409] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312416] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312422] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.226 [2024-04-26 20:42:10.312428] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312435] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312441] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312447] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312454] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312462] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312469] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312475] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312481] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312487] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312494] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312501] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312507] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312513] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312520] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312526] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312533] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312539] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312545] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312552] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.312559] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf78f0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.313963] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.313981] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.313989] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.313995] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314002] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314009] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314016] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314022] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314029] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314035] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314042] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314052] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314058] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314065] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314071] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314078] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314085] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314091] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314098] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314104] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314110] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314117] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314123] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314130] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314136] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314143] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314149] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314156] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314162] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314168] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314175] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314181] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314188] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314194] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314200] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314208] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314214] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314221] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314229] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314236] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314242] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314248] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314255] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314261] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314268] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314274] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314285] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314292] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314298] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314305] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314312] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314319] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314325] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314331] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314338] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314345] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314351] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314357] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314364] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314371] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314378] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314384] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.314391] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5520 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.316436] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.227 [2024-04-26 20:42:10.316477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316493] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.227 [2024-04-26 20:42:10.316511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316524] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.227 [2024-04-26 20:42:10.316537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316550] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.227 [2024-04-26 20:42:10.316561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x96b940 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.316663] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.227 [2024-04-26 20:42:10.316678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316692] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.227 [2024-04-26 20:42:10.316704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316718] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.227 [2024-04-26 20:42:10.316730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316742] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.227 [2024-04-26 20:42:10.316754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ab7c0 is same with the state(5) to be set 00:24:52.227 [2024-04-26 20:42:10.316857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.316871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.316894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.316911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.316927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.316944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.316964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.316981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.316990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.316997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.227 [2024-04-26 20:42:10.317319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.227 [2024-04-26 20:42:10.317328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.228 [2024-04-26 20:42:10.317927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.228 [2024-04-26 20:42:10.317983] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x87c1d0 was disconnected and freed. reset controller. 00:24:52.228 [2024-04-26 20:42:10.319233] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319255] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319261] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319265] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319270] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319275] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319283] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319292] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319297] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319301] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319306] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319310] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319315] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319319] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319324] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319333] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319338] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319342] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319347] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319351] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319356] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319361] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319365] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319370] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319374] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319379] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319384] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319388] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319393] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319397] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319402] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319407] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319414] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319420] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319425] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319429] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319434] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319439] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319443] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319448] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319452] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319457] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319461] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319465] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319470] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319474] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319479] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319483] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319488] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319492] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319496] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319501] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319505] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319510] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319514] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.228 [2024-04-26 20:42:10.319519] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.319523] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.319528] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.319532] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.319536] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.319545] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.319550] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf59d0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320701] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320727] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320735] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320742] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320748] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320755] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320761] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320768] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320775] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320781] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320787] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320794] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320800] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320806] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320813] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320819] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320825] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320832] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320838] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320845] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320851] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320858] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320864] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320870] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320877] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320883] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320894] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320900] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320907] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320913] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320919] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320926] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320932] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320939] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320945] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320952] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320958] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320964] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320971] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320977] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320984] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.320997] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321003] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321009] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321016] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321022] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321028] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321035] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321041] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321048] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321054] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321061] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321068] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321075] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321081] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321087] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321094] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321100] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321110] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321116] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321123] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321129] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf5e60 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321926] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6310 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321942] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6310 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321947] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6310 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321951] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6310 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321956] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6310 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321961] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6310 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321965] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6310 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321970] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6310 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321974] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6310 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321979] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6310 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.321983] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6310 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322578] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322595] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322602] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322609] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322615] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322622] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322632] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322638] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322645] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322652] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322658] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322665] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322671] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322677] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322684] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322690] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322697] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322703] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322710] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322716] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322722] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322728] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322735] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322742] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322749] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322755] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322761] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322768] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322774] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322780] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322787] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322793] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322799] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322806] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322814] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322820] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322827] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322833] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322840] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322846] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322853] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322859] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322865] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322871] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322878] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322884] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322890] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322897] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322903] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322909] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322916] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322922] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322928] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322934] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322941] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322947] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322953] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322960] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322966] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322972] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.322979] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf67c0 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324014] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324028] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324033] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324038] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324043] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324047] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324052] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324056] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324061] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324065] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324070] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324074] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324079] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324083] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324088] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324092] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.229 [2024-04-26 20:42:10.324097] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324102] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324106] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324111] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324115] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324119] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324124] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324129] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324133] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324138] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324142] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324150] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324155] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324159] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324164] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324168] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324173] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324177] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324182] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324186] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324190] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324195] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324200] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324204] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324209] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324213] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324217] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324222] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324227] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324231] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324235] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324240] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324244] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324249] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324253] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324259] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324263] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324268] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324274] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324282] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324287] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324291] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324295] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324300] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324304] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324309] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324314] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6c70 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324937] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324952] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324959] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324965] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324972] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324978] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324985] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324991] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.324998] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.325004] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.325011] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.325017] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.325024] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.325030] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.325036] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.325044] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.325050] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.325056] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.326948] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:52.230 [2024-04-26 20:42:10.326992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8ab7c0 (9): Bad file descriptor 00:24:52.230 [2024-04-26 20:42:10.327028] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327056] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327080] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327106] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa71590 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.327155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x96b940 (9): Bad file descriptor 00:24:52.230 [2024-04-26 20:42:10.327193] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327219] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327244] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327269] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ae520 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.327336] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327361] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327376] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327394] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8cf060 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.327430] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327447] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327461] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327476] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8a6160 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.327512] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327528] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327542] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327557] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327571] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x984cd0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.327593] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327609] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327629] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327644] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa72020 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.327681] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327697] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327712] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327727] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.230 [2024-04-26 20:42:10.327734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x96c5f0 is same with the state(5) to be set 00:24:52.230 [2024-04-26 20:42:10.327845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.230 [2024-04-26 20:42:10.327856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.230 [2024-04-26 20:42:10.327875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.230 [2024-04-26 20:42:10.327892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.230 [2024-04-26 20:42:10.327908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.230 [2024-04-26 20:42:10.327925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.230 [2024-04-26 20:42:10.327944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.230 [2024-04-26 20:42:10.327960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.230 [2024-04-26 20:42:10.327977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.327986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.230 [2024-04-26 20:42:10.327993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.328002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.230 [2024-04-26 20:42:10.328009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.328018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.230 [2024-04-26 20:42:10.328025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.328035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.230 [2024-04-26 20:42:10.328042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.328052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.230 [2024-04-26 20:42:10.328059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.230 [2024-04-26 20:42:10.328068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.328898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.328948] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xa48a90 was disconnected and freed. reset controller. 00:24:52.231 [2024-04-26 20:42:10.329014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.231 [2024-04-26 20:42:10.329264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.231 [2024-04-26 20:42:10.329271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.329694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.232 [2024-04-26 20:42:10.329703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.232 [2024-04-26 20:42:10.333902] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.333927] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.333936] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.333943] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.333950] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.333957] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.333963] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.333969] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.333976] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.333982] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.333989] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.333995] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334002] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334008] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334015] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334021] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334028] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334034] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334040] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334046] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334053] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334060] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334066] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334072] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334078] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334085] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334096] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334103] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334109] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334115] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334122] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334128] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334135] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334141] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334147] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334154] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334162] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334168] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334175] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334181] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334188] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334194] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334201] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334207] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334213] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf6fd0 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334830] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334842] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334847] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334851] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334856] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334860] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334865] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334869] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334876] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334881] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334885] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334890] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334894] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334899] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334903] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334907] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334912] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334916] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334920] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334925] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334929] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334934] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334938] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334942] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334947] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334951] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334955] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334960] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334964] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334968] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334973] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334977] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334981] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334986] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.334995] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335000] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335005] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335009] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335014] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335018] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335023] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335027] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335032] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335036] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335041] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335045] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335050] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335054] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335058] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335062] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335067] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335071] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335076] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335080] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335084] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335089] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335093] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335098] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335102] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.232 [2024-04-26 20:42:10.335106] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.233 [2024-04-26 20:42:10.335111] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.233 [2024-04-26 20:42:10.335115] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaf7460 is same with the state(5) to be set 00:24:52.233 [2024-04-26 20:42:10.340863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.340893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.340903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.340911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.340921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.340928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.340937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.340945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.340954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.340962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.340971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.340980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.340990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.340997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.341258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341331] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x894250 was disconnected and freed. reset controller. 00:24:52.233 [2024-04-26 20:42:10.341576] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:52.233 [2024-04-26 20:42:10.341655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa71590 (9): Bad file descriptor 00:24:52.233 [2024-04-26 20:42:10.341693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8ae520 (9): Bad file descriptor 00:24:52.233 [2024-04-26 20:42:10.341713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8cf060 (9): Bad file descriptor 00:24:52.233 [2024-04-26 20:42:10.341737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8a6160 (9): Bad file descriptor 00:24:52.233 [2024-04-26 20:42:10.341762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x984cd0 (9): Bad file descriptor 00:24:52.233 [2024-04-26 20:42:10.341792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa72020 (9): Bad file descriptor 00:24:52.233 [2024-04-26 20:42:10.341813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x96c5f0 (9): Bad file descriptor 00:24:52.233 [2024-04-26 20:42:10.341843] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.233 [2024-04-26 20:42:10.341853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341861] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.233 [2024-04-26 20:42:10.341869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341876] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.233 [2024-04-26 20:42:10.341886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341899] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:52.233 [2024-04-26 20:42:10.341911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.341923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8d6d70 is same with the state(5) to be set 00:24:52.233 [2024-04-26 20:42:10.344975] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:24:52.233 [2024-04-26 20:42:10.344998] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:24:52.233 [2024-04-26 20:42:10.345546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.233 [2024-04-26 20:42:10.346107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.233 [2024-04-26 20:42:10.346123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8ab7c0 with addr=10.0.0.2, port=4420 00:24:52.233 [2024-04-26 20:42:10.346133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ab7c0 is same with the state(5) to be set 00:24:52.233 [2024-04-26 20:42:10.346205] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:52.233 [2024-04-26 20:42:10.346426] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:52.233 [2024-04-26 20:42:10.346466] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:52.233 [2024-04-26 20:42:10.346587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.346988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.346999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.233 [2024-04-26 20:42:10.347380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.233 [2024-04-26 20:42:10.347388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.347897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.347905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x89af70 is same with the state(5) to be set 00:24:52.234 [2024-04-26 20:42:10.349930] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:24:52.234 [2024-04-26 20:42:10.350445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.234 [2024-04-26 20:42:10.350704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.234 [2024-04-26 20:42:10.350715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8ae520 with addr=10.0.0.2, port=4420 00:24:52.234 [2024-04-26 20:42:10.350724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ae520 is same with the state(5) to be set 00:24:52.234 [2024-04-26 20:42:10.351258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.234 [2024-04-26 20:42:10.351763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.234 [2024-04-26 20:42:10.351773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa71590 with addr=10.0.0.2, port=4420 00:24:52.234 [2024-04-26 20:42:10.351780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa71590 is same with the state(5) to be set 00:24:52.234 [2024-04-26 20:42:10.351791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8ab7c0 (9): Bad file descriptor 00:24:52.234 [2024-04-26 20:42:10.352247] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:52.234 [2024-04-26 20:42:10.352554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.352983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.352993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.234 [2024-04-26 20:42:10.353235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.234 [2024-04-26 20:42:10.353244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.353649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.353657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x895830 is same with the state(5) to be set 00:24:52.235 [2024-04-26 20:42:10.353718] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x895830 was disconnected and freed. reset controller. 00:24:52.235 [2024-04-26 20:42:10.354320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.235 [2024-04-26 20:42:10.354679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.235 [2024-04-26 20:42:10.354689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x96b940 with addr=10.0.0.2, port=4420 00:24:52.235 [2024-04-26 20:42:10.354697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x96b940 is same with the state(5) to be set 00:24:52.235 [2024-04-26 20:42:10.354709] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8ae520 (9): Bad file descriptor 00:24:52.235 [2024-04-26 20:42:10.354718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa71590 (9): Bad file descriptor 00:24:52.235 [2024-04-26 20:42:10.354727] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:52.235 [2024-04-26 20:42:10.354734] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:52.235 [2024-04-26 20:42:10.354743] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:52.235 [2024-04-26 20:42:10.354778] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.235 [2024-04-26 20:42:10.354802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8d6d70 (9): Bad file descriptor 00:24:52.235 [2024-04-26 20:42:10.354820] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.235 [2024-04-26 20:42:10.354868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.354878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.354889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.354898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.354907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.354915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.354928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.354935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.354945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.354952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.354962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.354969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.354978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.354985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.354995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.235 [2024-04-26 20:42:10.355483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.235 [2024-04-26 20:42:10.355492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.355954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.355962] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x892c70 is same with the state(5) to be set 00:24:52.236 [2024-04-26 20:42:10.356017] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x892c70 was disconnected and freed. reset controller. 00:24:52.236 [2024-04-26 20:42:10.356024] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.236 [2024-04-26 20:42:10.357266] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:52.236 [2024-04-26 20:42:10.357324] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:52.236 [2024-04-26 20:42:10.357604] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.236 [2024-04-26 20:42:10.357629] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:24:52.236 [2024-04-26 20:42:10.357649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x96b940 (9): Bad file descriptor 00:24:52.236 [2024-04-26 20:42:10.357659] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:24:52.236 [2024-04-26 20:42:10.357665] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:24:52.236 [2024-04-26 20:42:10.357672] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:24:52.236 [2024-04-26 20:42:10.357684] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:24:52.236 [2024-04-26 20:42:10.357691] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:24:52.236 [2024-04-26 20:42:10.357697] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:24:52.236 [2024-04-26 20:42:10.357723] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.236 [2024-04-26 20:42:10.357735] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.236 [2024-04-26 20:42:10.357772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.357780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.357792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.357799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.357809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.357816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.357826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.357833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.357842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.357850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.357859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.357866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.357876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.357884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.357893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.357904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.357914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.357921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.357930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.357937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.357947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.357954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.357963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.357971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.357980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.357987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.357997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.236 [2024-04-26 20:42:10.358468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.236 [2024-04-26 20:42:10.358475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.358864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.358872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa3c610 is same with the state(5) to be set 00:24:52.237 [2024-04-26 20:42:10.361309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.361990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.361997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.362006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.362014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.362023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.362031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.362040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.362047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.362058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.362066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.362075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.362082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.362092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.362099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.362109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.362116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.362126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.362133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.362143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.362150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.362159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.362167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.237 [2024-04-26 20:42:10.362176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.237 [2024-04-26 20:42:10.362184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.362201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.362218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.362235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.362252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.362270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.362290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.362307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.362323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.362339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.362356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.362372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.362389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.362405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.362413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x896e10 is same with the state(5) to be set 00:24:52.238 [2024-04-26 20:42:10.363645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.363984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.363993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.238 [2024-04-26 20:42:10.364543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.238 [2024-04-26 20:42:10.364553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.364560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.364572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.364579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.364589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.364596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.364606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.364613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.364622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.364630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.364639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.364646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.364656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.364663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.364672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.364680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.364689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.364697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.364706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.364714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.364723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.364731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.364740] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8983f0 is same with the state(5) to be set 00:24:52.239 [2024-04-26 20:42:10.365972] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.239 [2024-04-26 20:42:10.365986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.239 [2024-04-26 20:42:10.365994] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:24:52.239 [2024-04-26 20:42:10.366005] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:24:52.239 [2024-04-26 20:42:10.366017] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:24:52.239 [2024-04-26 20:42:10.366510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.239 [2024-04-26 20:42:10.367028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.239 [2024-04-26 20:42:10.367038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x984cd0 with addr=10.0.0.2, port=4420 00:24:52.239 [2024-04-26 20:42:10.367046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x984cd0 is same with the state(5) to be set 00:24:52.239 [2024-04-26 20:42:10.367054] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:24:52.239 [2024-04-26 20:42:10.367060] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:24:52.239 [2024-04-26 20:42:10.367067] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:24:52.239 [2024-04-26 20:42:10.367081] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.239 [2024-04-26 20:42:10.367108] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.239 [2024-04-26 20:42:10.367449] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:24:52.239 [2024-04-26 20:42:10.367462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.239 [2024-04-26 20:42:10.367932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.239 [2024-04-26 20:42:10.368410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.239 [2024-04-26 20:42:10.368420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa72020 with addr=10.0.0.2, port=4420 00:24:52.239 [2024-04-26 20:42:10.368428] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa72020 is same with the state(5) to be set 00:24:52.239 [2024-04-26 20:42:10.368914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.239 [2024-04-26 20:42:10.369399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.239 [2024-04-26 20:42:10.369409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8cf060 with addr=10.0.0.2, port=4420 00:24:52.239 [2024-04-26 20:42:10.369416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8cf060 is same with the state(5) to be set 00:24:52.239 [2024-04-26 20:42:10.369665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.239 [2024-04-26 20:42:10.370148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.239 [2024-04-26 20:42:10.370158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8a6160 with addr=10.0.0.2, port=4420 00:24:52.239 [2024-04-26 20:42:10.370165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8a6160 is same with the state(5) to be set 00:24:52.239 [2024-04-26 20:42:10.370175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x984cd0 (9): Bad file descriptor 00:24:52.239 [2024-04-26 20:42:10.371264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.371982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.371990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.372000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.372008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.372017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.372024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.372034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.372041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.372050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.372058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.372067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.372075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.372084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.372091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.372101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.372108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.372117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.372125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.239 [2024-04-26 20:42:10.372134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.239 [2024-04-26 20:42:10.372141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.240 [2024-04-26 20:42:10.372157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.240 [2024-04-26 20:42:10.372174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.240 [2024-04-26 20:42:10.372192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.240 [2024-04-26 20:42:10.372210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.240 [2024-04-26 20:42:10.372226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.240 [2024-04-26 20:42:10.372244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.240 [2024-04-26 20:42:10.372261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.240 [2024-04-26 20:42:10.372283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.240 [2024-04-26 20:42:10.372300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.240 [2024-04-26 20:42:10.372317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.240 [2024-04-26 20:42:10.372333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.240 [2024-04-26 20:42:10.372350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:52.240 [2024-04-26 20:42:10.372366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:52.240 [2024-04-26 20:42:10.372375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x899990 is same with the state(5) to be set 00:24:52.240 [2024-04-26 20:42:10.374083] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:52.240 task offset: 40320 on job bdev=Nvme1n1 fails 00:24:52.240 00:24:52.240 Latency(us) 00:24:52.240 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:52.240 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:52.240 Job: Nvme1n1 ended in about 0.74 seconds with error 00:24:52.240 Verification LBA range: start 0x0 length 0x400 00:24:52.240 Nvme1n1 : 0.74 392.23 24.51 86.26 0.00 132759.32 19879.25 112721.92 00:24:52.240 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:52.240 Job: Nvme2n1 ended in about 0.78 seconds with error 00:24:52.240 Verification LBA range: start 0x0 length 0x400 00:24:52.240 Nvme2n1 : 0.78 327.54 20.47 82.53 0.00 153426.03 24029.87 125829.12 00:24:52.240 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:52.240 Job: Nvme3n1 ended in about 0.76 seconds with error 00:24:52.240 Verification LBA range: start 0x0 length 0x400 00:24:52.240 Nvme3n1 : 0.76 330.72 20.67 84.33 0.00 149902.68 28398.93 150295.89 00:24:52.240 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:52.240 Job: Nvme4n1 ended in about 0.78 seconds with error 00:24:52.240 Verification LBA range: start 0x0 length 0x400 00:24:52.240 Nvme4n1 : 0.78 323.17 20.20 82.40 0.00 151865.98 93061.12 125829.12 00:24:52.240 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:52.240 Job: Nvme5n1 ended in about 0.76 seconds with error 00:24:52.240 Verification LBA range: start 0x0 length 0x400 00:24:52.240 Nvme5n1 : 0.76 331.51 20.72 84.19 0.00 146404.69 18786.99 149422.08 00:24:52.240 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:52.240 Job: Nvme6n1 ended in about 0.77 seconds with error 00:24:52.240 Verification LBA range: start 0x0 length 0x400 00:24:52.240 Nvme6n1 : 0.77 328.73 20.55 82.83 0.00 146378.50 40195.41 124955.31 00:24:52.240 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:52.240 Job: Nvme7n1 ended in about 0.78 seconds with error 00:24:52.240 Verification LBA range: start 0x0 length 0x400 00:24:52.240 Nvme7n1 : 0.78 373.55 23.35 82.16 0.00 130794.47 55050.24 107042.13 00:24:52.240 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:52.240 Job: Nvme8n1 ended in about 0.78 seconds with error 00:24:52.240 Verification LBA range: start 0x0 length 0x400 00:24:52.240 Nvme8n1 : 0.78 323.81 20.24 81.91 0.00 145259.75 55924.05 114469.55 00:24:52.240 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:52.240 Job: Nvme9n1 ended in about 0.79 seconds with error 00:24:52.240 Verification LBA range: start 0x0 length 0x400 00:24:52.240 Nvme9n1 : 0.79 318.14 19.88 81.12 0.00 146099.51 77332.48 119712.43 00:24:52.240 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:52.240 Job: Nvme10n1 ended in about 0.76 seconds with error 00:24:52.240 Verification LBA range: start 0x0 length 0x400 00:24:52.240 Nvme10n1 : 0.76 328.30 20.52 83.71 0.00 139552.50 51554.99 125829.12 00:24:52.240 =================================================================================================================== 00:24:52.240 Total : 3377.70 211.11 831.44 0.00 143948.19 18786.99 150295.89 00:24:52.240 [2024-04-26 20:42:10.401934] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:24:52.240 [2024-04-26 20:42:10.401980] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:24:52.240 [2024-04-26 20:42:10.402394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.402869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.402880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x96c5f0 with addr=10.0.0.2, port=4420 00:24:52.240 [2024-04-26 20:42:10.402890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x96c5f0 is same with the state(5) to be set 00:24:52.240 [2024-04-26 20:42:10.402903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa72020 (9): Bad file descriptor 00:24:52.240 [2024-04-26 20:42:10.402922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8cf060 (9): Bad file descriptor 00:24:52.240 [2024-04-26 20:42:10.402931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8a6160 (9): Bad file descriptor 00:24:52.240 [2024-04-26 20:42:10.402940] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:24:52.240 [2024-04-26 20:42:10.402946] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:24:52.240 [2024-04-26 20:42:10.402955] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:24:52.240 [2024-04-26 20:42:10.402989] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.240 [2024-04-26 20:42:10.403110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.240 [2024-04-26 20:42:10.403602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.403846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.403855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8ab7c0 with addr=10.0.0.2, port=4420 00:24:52.240 [2024-04-26 20:42:10.403864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ab7c0 is same with the state(5) to be set 00:24:52.240 [2024-04-26 20:42:10.404111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.404585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.404595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8d6d70 with addr=10.0.0.2, port=4420 00:24:52.240 [2024-04-26 20:42:10.404602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8d6d70 is same with the state(5) to be set 00:24:52.240 [2024-04-26 20:42:10.404611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x96c5f0 (9): Bad file descriptor 00:24:52.240 [2024-04-26 20:42:10.404619] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:24:52.240 [2024-04-26 20:42:10.404625] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:24:52.240 [2024-04-26 20:42:10.404632] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:24:52.240 [2024-04-26 20:42:10.404642] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:24:52.240 [2024-04-26 20:42:10.404649] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:24:52.240 [2024-04-26 20:42:10.404655] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:24:52.240 [2024-04-26 20:42:10.404665] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:24:52.240 [2024-04-26 20:42:10.404671] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:24:52.240 [2024-04-26 20:42:10.404678] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:24:52.240 [2024-04-26 20:42:10.404702] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.240 [2024-04-26 20:42:10.404712] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.240 [2024-04-26 20:42:10.404723] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.240 [2024-04-26 20:42:10.404733] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.240 [2024-04-26 20:42:10.404750] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.240 [2024-04-26 20:42:10.404764] bdev_nvme.c:2861:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:52.240 [2024-04-26 20:42:10.405083] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:24:52.240 [2024-04-26 20:42:10.405095] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:24:52.240 [2024-04-26 20:42:10.405115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.240 [2024-04-26 20:42:10.405122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.240 [2024-04-26 20:42:10.405128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.240 [2024-04-26 20:42:10.405153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8ab7c0 (9): Bad file descriptor 00:24:52.240 [2024-04-26 20:42:10.405163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8d6d70 (9): Bad file descriptor 00:24:52.240 [2024-04-26 20:42:10.405171] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:24:52.240 [2024-04-26 20:42:10.405177] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:24:52.240 [2024-04-26 20:42:10.405184] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:24:52.240 [2024-04-26 20:42:10.405223] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:24:52.240 [2024-04-26 20:42:10.405232] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:24:52.240 [2024-04-26 20:42:10.405240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.240 [2024-04-26 20:42:10.405727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.406075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.406084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa71590 with addr=10.0.0.2, port=4420 00:24:52.240 [2024-04-26 20:42:10.406091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa71590 is same with the state(5) to be set 00:24:52.240 [2024-04-26 20:42:10.406390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.406807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.406816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x8ae520 with addr=10.0.0.2, port=4420 00:24:52.240 [2024-04-26 20:42:10.406823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8ae520 is same with the state(5) to be set 00:24:52.240 [2024-04-26 20:42:10.406830] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:52.240 [2024-04-26 20:42:10.406836] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:52.240 [2024-04-26 20:42:10.406843] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:52.240 [2024-04-26 20:42:10.406852] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:24:52.240 [2024-04-26 20:42:10.406858] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:24:52.240 [2024-04-26 20:42:10.406865] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:24:52.240 [2024-04-26 20:42:10.406898] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.240 [2024-04-26 20:42:10.406905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.240 [2024-04-26 20:42:10.407148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.407590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.407603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x96b940 with addr=10.0.0.2, port=4420 00:24:52.240 [2024-04-26 20:42:10.407611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x96b940 is same with the state(5) to be set 00:24:52.240 [2024-04-26 20:42:10.408079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.408543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:52.240 [2024-04-26 20:42:10.408552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x984cd0 with addr=10.0.0.2, port=4420 00:24:52.240 [2024-04-26 20:42:10.408559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x984cd0 is same with the state(5) to be set 00:24:52.240 [2024-04-26 20:42:10.408568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa71590 (9): Bad file descriptor 00:24:52.240 [2024-04-26 20:42:10.408577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8ae520 (9): Bad file descriptor 00:24:52.240 [2024-04-26 20:42:10.408605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x96b940 (9): Bad file descriptor 00:24:52.240 [2024-04-26 20:42:10.408615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x984cd0 (9): Bad file descriptor 00:24:52.240 [2024-04-26 20:42:10.408623] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:24:52.240 [2024-04-26 20:42:10.408629] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:24:52.240 [2024-04-26 20:42:10.408635] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:24:52.240 [2024-04-26 20:42:10.408645] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:24:52.240 [2024-04-26 20:42:10.408651] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:24:52.240 [2024-04-26 20:42:10.408658] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:24:52.240 [2024-04-26 20:42:10.408692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.240 [2024-04-26 20:42:10.408699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.240 [2024-04-26 20:42:10.408706] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:24:52.240 [2024-04-26 20:42:10.408712] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:24:52.240 [2024-04-26 20:42:10.408718] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:24:52.240 [2024-04-26 20:42:10.408727] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:24:52.240 [2024-04-26 20:42:10.408733] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:24:52.240 [2024-04-26 20:42:10.408740] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:24:52.240 [2024-04-26 20:42:10.408770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.240 [2024-04-26 20:42:10.408777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:52.501 20:42:10 -- target/shutdown.sh@135 -- # nvmfpid= 00:24:52.501 20:42:10 -- target/shutdown.sh@138 -- # sleep 1 00:24:53.447 20:42:11 -- target/shutdown.sh@141 -- # kill -9 4158561 00:24:53.447 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (4158561) - No such process 00:24:53.447 20:42:11 -- target/shutdown.sh@141 -- # true 00:24:53.447 20:42:11 -- target/shutdown.sh@143 -- # stoptarget 00:24:53.447 20:42:11 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:53.447 20:42:11 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:53.447 20:42:11 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:53.447 20:42:11 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:53.447 20:42:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:53.447 20:42:11 -- nvmf/common.sh@116 -- # sync 00:24:53.447 20:42:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:53.447 20:42:11 -- nvmf/common.sh@119 -- # set +e 00:24:53.447 20:42:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:53.447 20:42:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:53.447 rmmod nvme_tcp 00:24:53.447 rmmod nvme_fabrics 00:24:53.447 rmmod nvme_keyring 00:24:53.447 20:42:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:53.447 20:42:11 -- nvmf/common.sh@123 -- # set -e 00:24:53.447 20:42:11 -- nvmf/common.sh@124 -- # return 0 00:24:53.447 20:42:11 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:24:53.447 20:42:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:53.447 20:42:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:53.447 20:42:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:53.447 20:42:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:53.447 20:42:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:53.447 20:42:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:53.447 20:42:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:53.447 20:42:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:55.996 20:42:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:55.996 00:24:55.996 real 0m7.387s 00:24:55.996 user 0m17.490s 00:24:55.996 sys 0m1.164s 00:24:55.996 20:42:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:55.996 20:42:13 -- common/autotest_common.sh@10 -- # set +x 00:24:55.996 ************************************ 00:24:55.996 END TEST nvmf_shutdown_tc3 00:24:55.996 ************************************ 00:24:55.996 20:42:13 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:24:55.996 00:24:55.996 real 0m31.087s 00:24:55.996 user 1m11.947s 00:24:55.996 sys 0m8.927s 00:24:55.996 20:42:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:55.996 20:42:13 -- common/autotest_common.sh@10 -- # set +x 00:24:55.996 ************************************ 00:24:55.996 END TEST nvmf_shutdown 00:24:55.996 ************************************ 00:24:55.996 20:42:13 -- nvmf/nvmf.sh@85 -- # timing_exit target 00:24:55.996 20:42:13 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:55.996 20:42:13 -- common/autotest_common.sh@10 -- # set +x 00:24:55.996 20:42:13 -- nvmf/nvmf.sh@87 -- # timing_enter host 00:24:55.996 20:42:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:55.996 20:42:13 -- common/autotest_common.sh@10 -- # set +x 00:24:55.996 20:42:13 -- nvmf/nvmf.sh@89 -- # [[ 0 -eq 0 ]] 00:24:55.996 20:42:13 -- nvmf/nvmf.sh@90 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:24:55.996 20:42:13 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:55.996 20:42:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:55.996 20:42:13 -- common/autotest_common.sh@10 -- # set +x 00:24:55.996 ************************************ 00:24:55.996 START TEST nvmf_multicontroller 00:24:55.996 ************************************ 00:24:55.996 20:42:13 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:24:55.996 * Looking for test storage... 00:24:55.996 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:55.996 20:42:14 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:55.996 20:42:14 -- nvmf/common.sh@7 -- # uname -s 00:24:55.996 20:42:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:55.996 20:42:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:55.996 20:42:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:55.996 20:42:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:55.996 20:42:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:55.996 20:42:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:55.996 20:42:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:55.996 20:42:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:55.996 20:42:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:55.996 20:42:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:55.996 20:42:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:24:55.996 20:42:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:24:55.996 20:42:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:55.996 20:42:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:55.996 20:42:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:55.996 20:42:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:55.996 20:42:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:55.996 20:42:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:55.996 20:42:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:55.996 20:42:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:55.996 20:42:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:55.996 20:42:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:55.996 20:42:14 -- paths/export.sh@5 -- # export PATH 00:24:55.996 20:42:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:55.996 20:42:14 -- nvmf/common.sh@46 -- # : 0 00:24:55.996 20:42:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:55.996 20:42:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:55.996 20:42:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:55.996 20:42:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:55.996 20:42:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:55.996 20:42:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:55.996 20:42:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:55.996 20:42:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:55.996 20:42:14 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:55.996 20:42:14 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:55.996 20:42:14 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:24:55.996 20:42:14 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:24:55.996 20:42:14 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:24:55.996 20:42:14 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:24:55.996 20:42:14 -- host/multicontroller.sh@23 -- # nvmftestinit 00:24:55.996 20:42:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:55.996 20:42:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:55.996 20:42:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:55.996 20:42:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:55.996 20:42:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:55.996 20:42:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:55.996 20:42:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:55.996 20:42:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:55.996 20:42:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:55.996 20:42:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:55.996 20:42:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:55.996 20:42:14 -- common/autotest_common.sh@10 -- # set +x 00:25:02.586 20:42:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:02.586 20:42:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:02.586 20:42:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:02.586 20:42:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:02.586 20:42:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:02.586 20:42:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:02.586 20:42:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:02.586 20:42:20 -- nvmf/common.sh@294 -- # net_devs=() 00:25:02.586 20:42:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:02.586 20:42:20 -- nvmf/common.sh@295 -- # e810=() 00:25:02.586 20:42:20 -- nvmf/common.sh@295 -- # local -ga e810 00:25:02.586 20:42:20 -- nvmf/common.sh@296 -- # x722=() 00:25:02.586 20:42:20 -- nvmf/common.sh@296 -- # local -ga x722 00:25:02.586 20:42:20 -- nvmf/common.sh@297 -- # mlx=() 00:25:02.586 20:42:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:02.586 20:42:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:02.586 20:42:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:02.586 20:42:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:02.586 20:42:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:02.586 20:42:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:02.586 20:42:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:02.586 20:42:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:02.586 20:42:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:02.586 20:42:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:02.586 20:42:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:02.586 20:42:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:02.586 20:42:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:02.586 20:42:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:02.586 20:42:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:02.586 20:42:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:02.586 20:42:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:25:02.586 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:25:02.586 20:42:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:02.586 20:42:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:25:02.586 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:25:02.586 20:42:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:02.586 20:42:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:02.586 20:42:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:02.586 20:42:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:02.586 20:42:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:02.586 20:42:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:25:02.586 Found net devices under 0000:4b:00.0: cvl_0_0 00:25:02.586 20:42:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:02.586 20:42:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:02.586 20:42:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:02.586 20:42:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:02.586 20:42:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:02.586 20:42:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:25:02.586 Found net devices under 0000:4b:00.1: cvl_0_1 00:25:02.586 20:42:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:02.586 20:42:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:02.586 20:42:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:02.586 20:42:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:02.586 20:42:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:02.586 20:42:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:02.586 20:42:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:02.586 20:42:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:02.586 20:42:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:02.586 20:42:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:02.586 20:42:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:02.586 20:42:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:02.586 20:42:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:02.586 20:42:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:02.586 20:42:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:02.586 20:42:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:02.586 20:42:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:02.586 20:42:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:02.586 20:42:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:02.586 20:42:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:02.586 20:42:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:02.586 20:42:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:02.858 20:42:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:02.858 20:42:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:02.858 20:42:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:02.858 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:02.858 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.441 ms 00:25:02.858 00:25:02.858 --- 10.0.0.2 ping statistics --- 00:25:02.858 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:02.858 rtt min/avg/max/mdev = 0.441/0.441/0.441/0.000 ms 00:25:02.858 20:42:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:02.858 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:02.858 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.429 ms 00:25:02.858 00:25:02.858 --- 10.0.0.1 ping statistics --- 00:25:02.858 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:02.858 rtt min/avg/max/mdev = 0.429/0.429/0.429/0.000 ms 00:25:02.858 20:42:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:02.858 20:42:21 -- nvmf/common.sh@410 -- # return 0 00:25:02.858 20:42:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:02.858 20:42:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:02.858 20:42:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:02.858 20:42:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:02.858 20:42:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:02.858 20:42:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:02.858 20:42:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:02.858 20:42:21 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:02.858 20:42:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:02.858 20:42:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:02.858 20:42:21 -- common/autotest_common.sh@10 -- # set +x 00:25:02.858 20:42:21 -- nvmf/common.sh@469 -- # nvmfpid=4163778 00:25:02.858 20:42:21 -- nvmf/common.sh@470 -- # waitforlisten 4163778 00:25:02.858 20:42:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:02.858 20:42:21 -- common/autotest_common.sh@819 -- # '[' -z 4163778 ']' 00:25:02.858 20:42:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:02.858 20:42:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:02.858 20:42:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:02.858 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:02.858 20:42:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:02.858 20:42:21 -- common/autotest_common.sh@10 -- # set +x 00:25:02.858 [2024-04-26 20:42:21.126312] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:02.858 [2024-04-26 20:42:21.126359] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:02.858 EAL: No free 2048 kB hugepages reported on node 1 00:25:02.858 [2024-04-26 20:42:21.192656] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:03.118 [2024-04-26 20:42:21.254681] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:03.118 [2024-04-26 20:42:21.254807] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:03.118 [2024-04-26 20:42:21.254816] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:03.118 [2024-04-26 20:42:21.254823] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:03.118 [2024-04-26 20:42:21.254946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:03.118 [2024-04-26 20:42:21.255069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:03.118 [2024-04-26 20:42:21.255072] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:03.689 20:42:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:03.689 20:42:21 -- common/autotest_common.sh@852 -- # return 0 00:25:03.689 20:42:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:03.689 20:42:21 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:03.689 20:42:21 -- common/autotest_common.sh@10 -- # set +x 00:25:03.689 20:42:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:03.689 20:42:21 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:03.689 20:42:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:03.689 20:42:21 -- common/autotest_common.sh@10 -- # set +x 00:25:03.689 [2024-04-26 20:42:21.942634] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:03.689 20:42:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:03.689 20:42:21 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:03.689 20:42:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:03.689 20:42:21 -- common/autotest_common.sh@10 -- # set +x 00:25:03.689 Malloc0 00:25:03.689 20:42:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:03.689 20:42:21 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:03.689 20:42:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:03.689 20:42:21 -- common/autotest_common.sh@10 -- # set +x 00:25:03.689 20:42:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:03.689 20:42:21 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:03.689 20:42:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:03.689 20:42:21 -- common/autotest_common.sh@10 -- # set +x 00:25:03.689 20:42:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:03.689 20:42:21 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:03.689 20:42:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:03.689 20:42:21 -- common/autotest_common.sh@10 -- # set +x 00:25:03.689 [2024-04-26 20:42:22.007749] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:03.689 20:42:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:03.689 20:42:22 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:03.689 20:42:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:03.689 20:42:22 -- common/autotest_common.sh@10 -- # set +x 00:25:03.689 [2024-04-26 20:42:22.019704] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:03.689 20:42:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:03.689 20:42:22 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:03.689 20:42:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:03.689 20:42:22 -- common/autotest_common.sh@10 -- # set +x 00:25:03.949 Malloc1 00:25:03.949 20:42:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:03.949 20:42:22 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:03.949 20:42:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:03.949 20:42:22 -- common/autotest_common.sh@10 -- # set +x 00:25:03.949 20:42:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:03.949 20:42:22 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:03.949 20:42:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:03.949 20:42:22 -- common/autotest_common.sh@10 -- # set +x 00:25:03.949 20:42:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:03.949 20:42:22 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:03.949 20:42:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:03.949 20:42:22 -- common/autotest_common.sh@10 -- # set +x 00:25:03.949 20:42:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:03.949 20:42:22 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:03.949 20:42:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:03.949 20:42:22 -- common/autotest_common.sh@10 -- # set +x 00:25:03.949 20:42:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:03.949 20:42:22 -- host/multicontroller.sh@44 -- # bdevperf_pid=4164128 00:25:03.949 20:42:22 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:03.949 20:42:22 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:03.949 20:42:22 -- host/multicontroller.sh@47 -- # waitforlisten 4164128 /var/tmp/bdevperf.sock 00:25:03.949 20:42:22 -- common/autotest_common.sh@819 -- # '[' -z 4164128 ']' 00:25:03.949 20:42:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:03.949 20:42:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:03.949 20:42:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:03.949 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:03.949 20:42:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:03.949 20:42:22 -- common/autotest_common.sh@10 -- # set +x 00:25:04.583 20:42:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:04.583 20:42:22 -- common/autotest_common.sh@852 -- # return 0 00:25:04.583 20:42:22 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:04.583 20:42:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:04.583 20:42:22 -- common/autotest_common.sh@10 -- # set +x 00:25:04.843 NVMe0n1 00:25:04.843 20:42:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:04.843 20:42:22 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:04.843 20:42:22 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:04.843 20:42:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:04.843 20:42:22 -- common/autotest_common.sh@10 -- # set +x 00:25:04.843 20:42:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:04.843 1 00:25:04.843 20:42:22 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:04.843 20:42:22 -- common/autotest_common.sh@640 -- # local es=0 00:25:04.843 20:42:22 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:04.843 20:42:22 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:04.843 20:42:22 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:04.843 20:42:22 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:04.843 20:42:22 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:04.843 20:42:23 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:04.843 20:42:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:04.843 20:42:23 -- common/autotest_common.sh@10 -- # set +x 00:25:04.843 request: 00:25:04.843 { 00:25:04.843 "name": "NVMe0", 00:25:04.843 "trtype": "tcp", 00:25:04.843 "traddr": "10.0.0.2", 00:25:04.843 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:04.843 "hostaddr": "10.0.0.2", 00:25:04.843 "hostsvcid": "60000", 00:25:04.843 "adrfam": "ipv4", 00:25:04.843 "trsvcid": "4420", 00:25:04.843 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:04.843 "method": "bdev_nvme_attach_controller", 00:25:04.843 "req_id": 1 00:25:04.843 } 00:25:04.843 Got JSON-RPC error response 00:25:04.843 response: 00:25:04.843 { 00:25:04.843 "code": -114, 00:25:04.843 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:04.843 } 00:25:04.843 20:42:23 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:04.843 20:42:23 -- common/autotest_common.sh@643 -- # es=1 00:25:04.843 20:42:23 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:04.843 20:42:23 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:04.843 20:42:23 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:04.843 20:42:23 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:04.843 20:42:23 -- common/autotest_common.sh@640 -- # local es=0 00:25:04.843 20:42:23 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:04.843 20:42:23 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:04.843 20:42:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:04.843 20:42:23 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:04.843 20:42:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:04.843 20:42:23 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:04.843 20:42:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:04.843 20:42:23 -- common/autotest_common.sh@10 -- # set +x 00:25:04.843 request: 00:25:04.843 { 00:25:04.843 "name": "NVMe0", 00:25:04.843 "trtype": "tcp", 00:25:04.843 "traddr": "10.0.0.2", 00:25:04.843 "hostaddr": "10.0.0.2", 00:25:04.843 "hostsvcid": "60000", 00:25:04.843 "adrfam": "ipv4", 00:25:04.843 "trsvcid": "4420", 00:25:04.843 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:04.843 "method": "bdev_nvme_attach_controller", 00:25:04.843 "req_id": 1 00:25:04.843 } 00:25:04.843 Got JSON-RPC error response 00:25:04.843 response: 00:25:04.843 { 00:25:04.843 "code": -114, 00:25:04.843 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:04.843 } 00:25:04.843 20:42:23 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:04.843 20:42:23 -- common/autotest_common.sh@643 -- # es=1 00:25:04.843 20:42:23 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:04.843 20:42:23 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:04.843 20:42:23 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:04.843 20:42:23 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:04.843 20:42:23 -- common/autotest_common.sh@640 -- # local es=0 00:25:04.843 20:42:23 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:04.843 20:42:23 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:04.843 20:42:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:04.843 20:42:23 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:04.843 20:42:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:04.843 20:42:23 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:04.843 20:42:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:04.843 20:42:23 -- common/autotest_common.sh@10 -- # set +x 00:25:04.843 request: 00:25:04.843 { 00:25:04.843 "name": "NVMe0", 00:25:04.843 "trtype": "tcp", 00:25:04.843 "traddr": "10.0.0.2", 00:25:04.843 "hostaddr": "10.0.0.2", 00:25:04.843 "hostsvcid": "60000", 00:25:04.843 "adrfam": "ipv4", 00:25:04.843 "trsvcid": "4420", 00:25:04.843 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:04.843 "multipath": "disable", 00:25:04.843 "method": "bdev_nvme_attach_controller", 00:25:04.843 "req_id": 1 00:25:04.843 } 00:25:04.843 Got JSON-RPC error response 00:25:04.843 response: 00:25:04.843 { 00:25:04.843 "code": -114, 00:25:04.843 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:04.843 } 00:25:04.843 20:42:23 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:04.843 20:42:23 -- common/autotest_common.sh@643 -- # es=1 00:25:04.843 20:42:23 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:04.843 20:42:23 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:04.843 20:42:23 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:04.843 20:42:23 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:04.843 20:42:23 -- common/autotest_common.sh@640 -- # local es=0 00:25:04.843 20:42:23 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:04.843 20:42:23 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:04.843 20:42:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:04.843 20:42:23 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:04.843 20:42:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:04.844 20:42:23 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:04.844 20:42:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:04.844 20:42:23 -- common/autotest_common.sh@10 -- # set +x 00:25:04.844 request: 00:25:04.844 { 00:25:04.844 "name": "NVMe0", 00:25:04.844 "trtype": "tcp", 00:25:04.844 "traddr": "10.0.0.2", 00:25:04.844 "hostaddr": "10.0.0.2", 00:25:04.844 "hostsvcid": "60000", 00:25:04.844 "adrfam": "ipv4", 00:25:04.844 "trsvcid": "4420", 00:25:04.844 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:04.844 "multipath": "failover", 00:25:04.844 "method": "bdev_nvme_attach_controller", 00:25:04.844 "req_id": 1 00:25:04.844 } 00:25:04.844 Got JSON-RPC error response 00:25:04.844 response: 00:25:04.844 { 00:25:04.844 "code": -114, 00:25:04.844 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:04.844 } 00:25:04.844 20:42:23 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:04.844 20:42:23 -- common/autotest_common.sh@643 -- # es=1 00:25:04.844 20:42:23 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:04.844 20:42:23 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:04.844 20:42:23 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:04.844 20:42:23 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:04.844 20:42:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:04.844 20:42:23 -- common/autotest_common.sh@10 -- # set +x 00:25:05.108 00:25:05.108 20:42:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:05.108 20:42:23 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:05.108 20:42:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:05.108 20:42:23 -- common/autotest_common.sh@10 -- # set +x 00:25:05.108 20:42:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:05.108 20:42:23 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:05.108 20:42:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:05.108 20:42:23 -- common/autotest_common.sh@10 -- # set +x 00:25:05.108 00:25:05.108 20:42:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:05.108 20:42:23 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:05.108 20:42:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:05.108 20:42:23 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:05.108 20:42:23 -- common/autotest_common.sh@10 -- # set +x 00:25:05.369 20:42:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:05.369 20:42:23 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:05.369 20:42:23 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:06.324 0 00:25:06.324 20:42:24 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:06.324 20:42:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:06.324 20:42:24 -- common/autotest_common.sh@10 -- # set +x 00:25:06.324 20:42:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:06.324 20:42:24 -- host/multicontroller.sh@100 -- # killprocess 4164128 00:25:06.324 20:42:24 -- common/autotest_common.sh@926 -- # '[' -z 4164128 ']' 00:25:06.324 20:42:24 -- common/autotest_common.sh@930 -- # kill -0 4164128 00:25:06.324 20:42:24 -- common/autotest_common.sh@931 -- # uname 00:25:06.324 20:42:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:06.324 20:42:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4164128 00:25:06.324 20:42:24 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:06.324 20:42:24 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:06.324 20:42:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4164128' 00:25:06.324 killing process with pid 4164128 00:25:06.324 20:42:24 -- common/autotest_common.sh@945 -- # kill 4164128 00:25:06.324 20:42:24 -- common/autotest_common.sh@950 -- # wait 4164128 00:25:06.625 20:42:24 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:06.625 20:42:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:06.625 20:42:24 -- common/autotest_common.sh@10 -- # set +x 00:25:06.625 20:42:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:06.625 20:42:24 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:06.625 20:42:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:06.625 20:42:24 -- common/autotest_common.sh@10 -- # set +x 00:25:06.625 20:42:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:06.625 20:42:24 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:06.625 20:42:24 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:06.625 20:42:24 -- common/autotest_common.sh@1597 -- # read -r file 00:25:06.625 20:42:24 -- common/autotest_common.sh@1596 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:06.625 20:42:24 -- common/autotest_common.sh@1596 -- # sort -u 00:25:06.625 20:42:24 -- common/autotest_common.sh@1598 -- # cat 00:25:06.625 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:06.625 [2024-04-26 20:42:22.131666] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:06.625 [2024-04-26 20:42:22.131723] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4164128 ] 00:25:06.625 EAL: No free 2048 kB hugepages reported on node 1 00:25:06.625 [2024-04-26 20:42:22.190196] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:06.625 [2024-04-26 20:42:22.253508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:06.625 [2024-04-26 20:42:23.431982] bdev.c:4548:bdev_name_add: *ERROR*: Bdev name 646d9d96-e981-4645-a4bb-34eab9dd1461 already exists 00:25:06.625 [2024-04-26 20:42:23.432012] bdev.c:7598:bdev_register: *ERROR*: Unable to add uuid:646d9d96-e981-4645-a4bb-34eab9dd1461 alias for bdev NVMe1n1 00:25:06.625 [2024-04-26 20:42:23.432021] bdev_nvme.c:4230:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:06.625 Running I/O for 1 seconds... 00:25:06.625 00:25:06.625 Latency(us) 00:25:06.625 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:06.625 Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:06.625 NVMe0n1 : 1.00 20726.17 80.96 0.00 0.00 6159.74 4041.39 15947.09 00:25:06.625 =================================================================================================================== 00:25:06.625 Total : 20726.17 80.96 0.00 0.00 6159.74 4041.39 15947.09 00:25:06.625 Received shutdown signal, test time was about 1.000000 seconds 00:25:06.625 00:25:06.625 Latency(us) 00:25:06.625 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:06.625 =================================================================================================================== 00:25:06.625 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:06.625 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:06.625 20:42:24 -- common/autotest_common.sh@1603 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:06.625 20:42:24 -- common/autotest_common.sh@1597 -- # read -r file 00:25:06.625 20:42:24 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:06.625 20:42:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:06.625 20:42:24 -- nvmf/common.sh@116 -- # sync 00:25:06.625 20:42:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:06.625 20:42:24 -- nvmf/common.sh@119 -- # set +e 00:25:06.625 20:42:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:06.625 20:42:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:06.625 rmmod nvme_tcp 00:25:06.625 rmmod nvme_fabrics 00:25:06.625 rmmod nvme_keyring 00:25:06.625 20:42:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:06.625 20:42:24 -- nvmf/common.sh@123 -- # set -e 00:25:06.625 20:42:24 -- nvmf/common.sh@124 -- # return 0 00:25:06.625 20:42:24 -- nvmf/common.sh@477 -- # '[' -n 4163778 ']' 00:25:06.625 20:42:24 -- nvmf/common.sh@478 -- # killprocess 4163778 00:25:06.625 20:42:24 -- common/autotest_common.sh@926 -- # '[' -z 4163778 ']' 00:25:06.625 20:42:24 -- common/autotest_common.sh@930 -- # kill -0 4163778 00:25:06.625 20:42:24 -- common/autotest_common.sh@931 -- # uname 00:25:06.625 20:42:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:06.625 20:42:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4163778 00:25:06.625 20:42:24 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:06.625 20:42:24 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:06.625 20:42:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4163778' 00:25:06.625 killing process with pid 4163778 00:25:06.625 20:42:24 -- common/autotest_common.sh@945 -- # kill 4163778 00:25:06.625 20:42:24 -- common/autotest_common.sh@950 -- # wait 4163778 00:25:06.910 20:42:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:06.910 20:42:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:06.910 20:42:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:06.910 20:42:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:06.910 20:42:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:06.910 20:42:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:06.910 20:42:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:06.910 20:42:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:08.829 20:42:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:08.829 00:25:08.829 real 0m13.259s 00:25:08.829 user 0m16.502s 00:25:08.829 sys 0m5.860s 00:25:08.829 20:42:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:08.829 20:42:27 -- common/autotest_common.sh@10 -- # set +x 00:25:08.829 ************************************ 00:25:08.829 END TEST nvmf_multicontroller 00:25:08.829 ************************************ 00:25:09.091 20:42:27 -- nvmf/nvmf.sh@91 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:09.091 20:42:27 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:09.091 20:42:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:09.091 20:42:27 -- common/autotest_common.sh@10 -- # set +x 00:25:09.091 ************************************ 00:25:09.091 START TEST nvmf_aer 00:25:09.091 ************************************ 00:25:09.091 20:42:27 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:09.091 * Looking for test storage... 00:25:09.091 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:09.091 20:42:27 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:09.091 20:42:27 -- nvmf/common.sh@7 -- # uname -s 00:25:09.091 20:42:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:09.091 20:42:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:09.091 20:42:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:09.091 20:42:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:09.091 20:42:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:09.091 20:42:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:09.091 20:42:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:09.091 20:42:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:09.091 20:42:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:09.091 20:42:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:09.091 20:42:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:09.091 20:42:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:09.091 20:42:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:09.091 20:42:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:09.091 20:42:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:09.091 20:42:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:09.091 20:42:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:09.091 20:42:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:09.091 20:42:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:09.091 20:42:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:09.091 20:42:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:09.091 20:42:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:09.091 20:42:27 -- paths/export.sh@5 -- # export PATH 00:25:09.091 20:42:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:09.091 20:42:27 -- nvmf/common.sh@46 -- # : 0 00:25:09.091 20:42:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:09.091 20:42:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:09.091 20:42:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:09.091 20:42:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:09.091 20:42:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:09.091 20:42:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:09.091 20:42:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:09.091 20:42:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:09.091 20:42:27 -- host/aer.sh@11 -- # nvmftestinit 00:25:09.092 20:42:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:09.092 20:42:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:09.092 20:42:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:09.092 20:42:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:09.092 20:42:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:09.092 20:42:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:09.092 20:42:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:09.092 20:42:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:09.092 20:42:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:09.092 20:42:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:09.092 20:42:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:09.092 20:42:27 -- common/autotest_common.sh@10 -- # set +x 00:25:15.685 20:42:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:15.685 20:42:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:15.685 20:42:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:15.685 20:42:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:15.685 20:42:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:15.685 20:42:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:15.685 20:42:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:15.685 20:42:33 -- nvmf/common.sh@294 -- # net_devs=() 00:25:15.685 20:42:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:15.685 20:42:33 -- nvmf/common.sh@295 -- # e810=() 00:25:15.685 20:42:33 -- nvmf/common.sh@295 -- # local -ga e810 00:25:15.685 20:42:33 -- nvmf/common.sh@296 -- # x722=() 00:25:15.685 20:42:33 -- nvmf/common.sh@296 -- # local -ga x722 00:25:15.685 20:42:33 -- nvmf/common.sh@297 -- # mlx=() 00:25:15.685 20:42:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:15.685 20:42:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:15.685 20:42:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:15.685 20:42:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:15.685 20:42:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:15.685 20:42:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:15.685 20:42:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:15.685 20:42:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:15.685 20:42:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:15.685 20:42:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:15.685 20:42:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:15.685 20:42:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:15.685 20:42:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:15.685 20:42:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:15.685 20:42:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:15.685 20:42:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:15.685 20:42:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:25:15.685 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:25:15.685 20:42:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:15.685 20:42:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:25:15.685 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:25:15.685 20:42:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:15.685 20:42:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:15.685 20:42:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:15.685 20:42:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:15.685 20:42:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:15.685 20:42:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:25:15.685 Found net devices under 0000:4b:00.0: cvl_0_0 00:25:15.685 20:42:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:15.685 20:42:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:15.685 20:42:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:15.685 20:42:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:15.685 20:42:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:15.685 20:42:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:25:15.685 Found net devices under 0000:4b:00.1: cvl_0_1 00:25:15.685 20:42:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:15.685 20:42:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:15.685 20:42:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:15.685 20:42:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:15.685 20:42:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:15.685 20:42:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:15.685 20:42:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:15.685 20:42:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:15.685 20:42:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:15.685 20:42:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:15.685 20:42:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:15.685 20:42:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:15.685 20:42:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:15.685 20:42:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:15.685 20:42:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:15.685 20:42:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:15.685 20:42:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:15.685 20:42:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:15.947 20:42:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:15.947 20:42:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:15.947 20:42:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:15.947 20:42:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:15.947 20:42:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:15.947 20:42:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:15.947 20:42:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:15.947 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:15.947 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.517 ms 00:25:15.947 00:25:15.947 --- 10.0.0.2 ping statistics --- 00:25:15.947 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:15.947 rtt min/avg/max/mdev = 0.517/0.517/0.517/0.000 ms 00:25:15.947 20:42:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:15.947 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:15.947 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.295 ms 00:25:15.947 00:25:15.947 --- 10.0.0.1 ping statistics --- 00:25:15.947 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:15.947 rtt min/avg/max/mdev = 0.295/0.295/0.295/0.000 ms 00:25:15.947 20:42:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:15.947 20:42:34 -- nvmf/common.sh@410 -- # return 0 00:25:15.947 20:42:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:15.947 20:42:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:15.947 20:42:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:15.947 20:42:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:15.947 20:42:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:15.947 20:42:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:15.947 20:42:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:15.947 20:42:34 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:15.947 20:42:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:15.947 20:42:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:15.947 20:42:34 -- common/autotest_common.sh@10 -- # set +x 00:25:15.947 20:42:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:15.947 20:42:34 -- nvmf/common.sh@469 -- # nvmfpid=4168722 00:25:15.947 20:42:34 -- nvmf/common.sh@470 -- # waitforlisten 4168722 00:25:15.947 20:42:34 -- common/autotest_common.sh@819 -- # '[' -z 4168722 ']' 00:25:15.947 20:42:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:15.947 20:42:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:15.947 20:42:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:15.947 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:15.947 20:42:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:15.947 20:42:34 -- common/autotest_common.sh@10 -- # set +x 00:25:15.947 [2024-04-26 20:42:34.284632] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:15.947 [2024-04-26 20:42:34.284693] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:16.208 EAL: No free 2048 kB hugepages reported on node 1 00:25:16.208 [2024-04-26 20:42:34.352723] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:16.208 [2024-04-26 20:42:34.418929] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:16.208 [2024-04-26 20:42:34.419044] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:16.208 [2024-04-26 20:42:34.419052] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:16.208 [2024-04-26 20:42:34.419059] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:16.208 [2024-04-26 20:42:34.419183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:16.208 [2024-04-26 20:42:34.419363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:16.208 [2024-04-26 20:42:34.419608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:16.208 [2024-04-26 20:42:34.419612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:16.778 20:42:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:16.778 20:42:35 -- common/autotest_common.sh@852 -- # return 0 00:25:16.778 20:42:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:16.778 20:42:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:16.778 20:42:35 -- common/autotest_common.sh@10 -- # set +x 00:25:16.778 20:42:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:16.778 20:42:35 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:16.778 20:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.778 20:42:35 -- common/autotest_common.sh@10 -- # set +x 00:25:17.039 [2024-04-26 20:42:35.126568] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:17.039 20:42:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.039 20:42:35 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:17.039 20:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.039 20:42:35 -- common/autotest_common.sh@10 -- # set +x 00:25:17.039 Malloc0 00:25:17.039 20:42:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.039 20:42:35 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:17.039 20:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.039 20:42:35 -- common/autotest_common.sh@10 -- # set +x 00:25:17.039 20:42:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.039 20:42:35 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:17.039 20:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.039 20:42:35 -- common/autotest_common.sh@10 -- # set +x 00:25:17.039 20:42:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.039 20:42:35 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:17.039 20:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.039 20:42:35 -- common/autotest_common.sh@10 -- # set +x 00:25:17.039 [2024-04-26 20:42:35.185924] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:17.039 20:42:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.039 20:42:35 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:17.039 20:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.039 20:42:35 -- common/autotest_common.sh@10 -- # set +x 00:25:17.039 [2024-04-26 20:42:35.197738] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:17.039 [ 00:25:17.039 { 00:25:17.039 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:17.039 "subtype": "Discovery", 00:25:17.039 "listen_addresses": [], 00:25:17.039 "allow_any_host": true, 00:25:17.039 "hosts": [] 00:25:17.039 }, 00:25:17.039 { 00:25:17.039 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:17.039 "subtype": "NVMe", 00:25:17.039 "listen_addresses": [ 00:25:17.039 { 00:25:17.039 "transport": "TCP", 00:25:17.039 "trtype": "TCP", 00:25:17.039 "adrfam": "IPv4", 00:25:17.039 "traddr": "10.0.0.2", 00:25:17.039 "trsvcid": "4420" 00:25:17.039 } 00:25:17.039 ], 00:25:17.039 "allow_any_host": true, 00:25:17.039 "hosts": [], 00:25:17.039 "serial_number": "SPDK00000000000001", 00:25:17.039 "model_number": "SPDK bdev Controller", 00:25:17.039 "max_namespaces": 2, 00:25:17.039 "min_cntlid": 1, 00:25:17.039 "max_cntlid": 65519, 00:25:17.039 "namespaces": [ 00:25:17.039 { 00:25:17.039 "nsid": 1, 00:25:17.039 "bdev_name": "Malloc0", 00:25:17.039 "name": "Malloc0", 00:25:17.039 "nguid": "8C2B6A4542934E0685C4BDD3B1771393", 00:25:17.039 "uuid": "8c2b6a45-4293-4e06-85c4-bdd3b1771393" 00:25:17.039 } 00:25:17.039 ] 00:25:17.039 } 00:25:17.039 ] 00:25:17.039 20:42:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.039 20:42:35 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:17.039 20:42:35 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:17.039 20:42:35 -- host/aer.sh@33 -- # aerpid=4168866 00:25:17.039 20:42:35 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:17.039 20:42:35 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:17.039 20:42:35 -- common/autotest_common.sh@1244 -- # local i=0 00:25:17.039 20:42:35 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:17.039 20:42:35 -- common/autotest_common.sh@1246 -- # '[' 0 -lt 200 ']' 00:25:17.039 20:42:35 -- common/autotest_common.sh@1247 -- # i=1 00:25:17.039 20:42:35 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:25:17.039 EAL: No free 2048 kB hugepages reported on node 1 00:25:17.039 20:42:35 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:17.039 20:42:35 -- common/autotest_common.sh@1246 -- # '[' 1 -lt 200 ']' 00:25:17.039 20:42:35 -- common/autotest_common.sh@1247 -- # i=2 00:25:17.039 20:42:35 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:25:17.301 20:42:35 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:17.301 20:42:35 -- common/autotest_common.sh@1246 -- # '[' 2 -lt 200 ']' 00:25:17.301 20:42:35 -- common/autotest_common.sh@1247 -- # i=3 00:25:17.301 20:42:35 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:25:17.301 20:42:35 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:17.301 20:42:35 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:17.301 20:42:35 -- common/autotest_common.sh@1255 -- # return 0 00:25:17.301 20:42:35 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:17.301 20:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.301 20:42:35 -- common/autotest_common.sh@10 -- # set +x 00:25:17.301 Malloc1 00:25:17.301 20:42:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.301 20:42:35 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:17.301 20:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.301 20:42:35 -- common/autotest_common.sh@10 -- # set +x 00:25:17.301 20:42:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.301 20:42:35 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:17.301 20:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.301 20:42:35 -- common/autotest_common.sh@10 -- # set +x 00:25:17.301 Asynchronous Event Request test 00:25:17.301 Attaching to 10.0.0.2 00:25:17.301 Attached to 10.0.0.2 00:25:17.301 Registering asynchronous event callbacks... 00:25:17.301 Starting namespace attribute notice tests for all controllers... 00:25:17.301 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:17.301 aer_cb - Changed Namespace 00:25:17.301 Cleaning up... 00:25:17.301 [ 00:25:17.301 { 00:25:17.301 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:17.301 "subtype": "Discovery", 00:25:17.301 "listen_addresses": [], 00:25:17.301 "allow_any_host": true, 00:25:17.301 "hosts": [] 00:25:17.301 }, 00:25:17.301 { 00:25:17.301 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:17.301 "subtype": "NVMe", 00:25:17.301 "listen_addresses": [ 00:25:17.301 { 00:25:17.301 "transport": "TCP", 00:25:17.301 "trtype": "TCP", 00:25:17.301 "adrfam": "IPv4", 00:25:17.301 "traddr": "10.0.0.2", 00:25:17.301 "trsvcid": "4420" 00:25:17.301 } 00:25:17.301 ], 00:25:17.301 "allow_any_host": true, 00:25:17.301 "hosts": [], 00:25:17.301 "serial_number": "SPDK00000000000001", 00:25:17.301 "model_number": "SPDK bdev Controller", 00:25:17.301 "max_namespaces": 2, 00:25:17.301 "min_cntlid": 1, 00:25:17.301 "max_cntlid": 65519, 00:25:17.301 "namespaces": [ 00:25:17.301 { 00:25:17.301 "nsid": 1, 00:25:17.301 "bdev_name": "Malloc0", 00:25:17.301 "name": "Malloc0", 00:25:17.301 "nguid": "8C2B6A4542934E0685C4BDD3B1771393", 00:25:17.301 "uuid": "8c2b6a45-4293-4e06-85c4-bdd3b1771393" 00:25:17.301 }, 00:25:17.301 { 00:25:17.301 "nsid": 2, 00:25:17.301 "bdev_name": "Malloc1", 00:25:17.301 "name": "Malloc1", 00:25:17.301 "nguid": "1581610A297940C8BCA34BD9267C220B", 00:25:17.301 "uuid": "1581610a-2979-40c8-bca3-4bd9267c220b" 00:25:17.301 } 00:25:17.301 ] 00:25:17.301 } 00:25:17.301 ] 00:25:17.301 20:42:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.301 20:42:35 -- host/aer.sh@43 -- # wait 4168866 00:25:17.301 20:42:35 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:17.301 20:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.301 20:42:35 -- common/autotest_common.sh@10 -- # set +x 00:25:17.301 20:42:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.301 20:42:35 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:17.301 20:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.301 20:42:35 -- common/autotest_common.sh@10 -- # set +x 00:25:17.301 20:42:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.301 20:42:35 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:17.301 20:42:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.301 20:42:35 -- common/autotest_common.sh@10 -- # set +x 00:25:17.563 20:42:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.563 20:42:35 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:17.563 20:42:35 -- host/aer.sh@51 -- # nvmftestfini 00:25:17.563 20:42:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:17.563 20:42:35 -- nvmf/common.sh@116 -- # sync 00:25:17.563 20:42:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:17.563 20:42:35 -- nvmf/common.sh@119 -- # set +e 00:25:17.563 20:42:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:17.563 20:42:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:17.563 rmmod nvme_tcp 00:25:17.563 rmmod nvme_fabrics 00:25:17.563 rmmod nvme_keyring 00:25:17.563 20:42:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:17.563 20:42:35 -- nvmf/common.sh@123 -- # set -e 00:25:17.563 20:42:35 -- nvmf/common.sh@124 -- # return 0 00:25:17.563 20:42:35 -- nvmf/common.sh@477 -- # '[' -n 4168722 ']' 00:25:17.563 20:42:35 -- nvmf/common.sh@478 -- # killprocess 4168722 00:25:17.563 20:42:35 -- common/autotest_common.sh@926 -- # '[' -z 4168722 ']' 00:25:17.563 20:42:35 -- common/autotest_common.sh@930 -- # kill -0 4168722 00:25:17.563 20:42:35 -- common/autotest_common.sh@931 -- # uname 00:25:17.563 20:42:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:17.563 20:42:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4168722 00:25:17.563 20:42:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:17.563 20:42:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:17.563 20:42:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4168722' 00:25:17.563 killing process with pid 4168722 00:25:17.563 20:42:35 -- common/autotest_common.sh@945 -- # kill 4168722 00:25:17.563 [2024-04-26 20:42:35.769293] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:17.563 20:42:35 -- common/autotest_common.sh@950 -- # wait 4168722 00:25:17.563 20:42:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:17.563 20:42:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:17.563 20:42:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:17.563 20:42:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:17.563 20:42:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:17.563 20:42:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:17.563 20:42:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:17.563 20:42:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:20.114 20:42:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:20.114 00:25:20.114 real 0m10.752s 00:25:20.114 user 0m7.841s 00:25:20.114 sys 0m5.587s 00:25:20.114 20:42:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:20.114 20:42:37 -- common/autotest_common.sh@10 -- # set +x 00:25:20.114 ************************************ 00:25:20.114 END TEST nvmf_aer 00:25:20.114 ************************************ 00:25:20.114 20:42:38 -- nvmf/nvmf.sh@92 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:20.114 20:42:38 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:20.114 20:42:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:20.114 20:42:38 -- common/autotest_common.sh@10 -- # set +x 00:25:20.114 ************************************ 00:25:20.114 START TEST nvmf_async_init 00:25:20.114 ************************************ 00:25:20.114 20:42:38 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:20.114 * Looking for test storage... 00:25:20.114 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:20.114 20:42:38 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:20.114 20:42:38 -- nvmf/common.sh@7 -- # uname -s 00:25:20.114 20:42:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:20.114 20:42:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:20.114 20:42:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:20.114 20:42:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:20.114 20:42:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:20.114 20:42:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:20.114 20:42:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:20.114 20:42:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:20.114 20:42:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:20.114 20:42:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:20.114 20:42:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:20.114 20:42:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:20.114 20:42:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:20.114 20:42:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:20.114 20:42:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:20.114 20:42:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:20.114 20:42:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:20.114 20:42:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:20.114 20:42:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:20.114 20:42:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.114 20:42:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.114 20:42:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.114 20:42:38 -- paths/export.sh@5 -- # export PATH 00:25:20.114 20:42:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.114 20:42:38 -- nvmf/common.sh@46 -- # : 0 00:25:20.114 20:42:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:20.114 20:42:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:20.114 20:42:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:20.114 20:42:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:20.114 20:42:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:20.114 20:42:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:20.114 20:42:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:20.114 20:42:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:20.114 20:42:38 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:20.114 20:42:38 -- host/async_init.sh@14 -- # null_block_size=512 00:25:20.114 20:42:38 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:20.114 20:42:38 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:20.114 20:42:38 -- host/async_init.sh@20 -- # uuidgen 00:25:20.114 20:42:38 -- host/async_init.sh@20 -- # tr -d - 00:25:20.114 20:42:38 -- host/async_init.sh@20 -- # nguid=98328d11b9a241df89bf95dafebb697d 00:25:20.114 20:42:38 -- host/async_init.sh@22 -- # nvmftestinit 00:25:20.114 20:42:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:20.114 20:42:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:20.114 20:42:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:20.114 20:42:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:20.114 20:42:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:20.114 20:42:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:20.114 20:42:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:20.114 20:42:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:20.114 20:42:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:20.114 20:42:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:20.114 20:42:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:20.114 20:42:38 -- common/autotest_common.sh@10 -- # set +x 00:25:28.268 20:42:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:28.268 20:42:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:28.268 20:42:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:28.268 20:42:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:28.268 20:42:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:28.268 20:42:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:28.268 20:42:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:28.268 20:42:45 -- nvmf/common.sh@294 -- # net_devs=() 00:25:28.268 20:42:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:28.268 20:42:45 -- nvmf/common.sh@295 -- # e810=() 00:25:28.268 20:42:45 -- nvmf/common.sh@295 -- # local -ga e810 00:25:28.268 20:42:45 -- nvmf/common.sh@296 -- # x722=() 00:25:28.268 20:42:45 -- nvmf/common.sh@296 -- # local -ga x722 00:25:28.268 20:42:45 -- nvmf/common.sh@297 -- # mlx=() 00:25:28.268 20:42:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:28.268 20:42:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:28.268 20:42:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:28.268 20:42:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:28.268 20:42:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:28.268 20:42:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:28.268 20:42:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:28.268 20:42:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:28.268 20:42:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:28.268 20:42:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:28.268 20:42:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:28.268 20:42:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:28.268 20:42:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:28.268 20:42:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:28.268 20:42:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:28.268 20:42:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:28.268 20:42:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:25:28.268 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:25:28.268 20:42:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:28.268 20:42:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:25:28.268 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:25:28.268 20:42:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:28.268 20:42:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:28.268 20:42:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:28.268 20:42:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:28.268 20:42:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:28.268 20:42:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:25:28.268 Found net devices under 0000:4b:00.0: cvl_0_0 00:25:28.268 20:42:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:28.268 20:42:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:28.268 20:42:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:28.268 20:42:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:28.268 20:42:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:28.268 20:42:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:25:28.268 Found net devices under 0000:4b:00.1: cvl_0_1 00:25:28.268 20:42:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:28.268 20:42:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:28.268 20:42:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:28.268 20:42:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:28.268 20:42:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:28.268 20:42:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:28.268 20:42:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:28.268 20:42:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:28.268 20:42:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:28.268 20:42:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:28.268 20:42:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:28.268 20:42:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:28.268 20:42:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:28.268 20:42:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:28.268 20:42:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:28.268 20:42:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:28.268 20:42:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:28.268 20:42:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:28.268 20:42:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:28.268 20:42:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:28.268 20:42:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:28.268 20:42:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:28.268 20:42:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:28.268 20:42:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:28.268 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:28.268 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.562 ms 00:25:28.268 00:25:28.268 --- 10.0.0.2 ping statistics --- 00:25:28.268 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:28.268 rtt min/avg/max/mdev = 0.562/0.562/0.562/0.000 ms 00:25:28.268 20:42:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:28.268 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:28.268 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.336 ms 00:25:28.268 00:25:28.268 --- 10.0.0.1 ping statistics --- 00:25:28.268 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:28.268 rtt min/avg/max/mdev = 0.336/0.336/0.336/0.000 ms 00:25:28.268 20:42:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:28.268 20:42:45 -- nvmf/common.sh@410 -- # return 0 00:25:28.268 20:42:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:28.268 20:42:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:28.268 20:42:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:28.268 20:42:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:28.268 20:42:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:28.268 20:42:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:28.268 20:42:45 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:28.268 20:42:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:28.268 20:42:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:28.268 20:42:45 -- common/autotest_common.sh@10 -- # set +x 00:25:28.268 20:42:45 -- nvmf/common.sh@469 -- # nvmfpid=4173205 00:25:28.268 20:42:45 -- nvmf/common.sh@470 -- # waitforlisten 4173205 00:25:28.268 20:42:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:28.268 20:42:45 -- common/autotest_common.sh@819 -- # '[' -z 4173205 ']' 00:25:28.268 20:42:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:28.268 20:42:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:28.268 20:42:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:28.268 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:28.268 20:42:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:28.268 20:42:45 -- common/autotest_common.sh@10 -- # set +x 00:25:28.268 [2024-04-26 20:42:45.515824] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:28.268 [2024-04-26 20:42:45.515888] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:28.268 EAL: No free 2048 kB hugepages reported on node 1 00:25:28.268 [2024-04-26 20:42:45.585467] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:28.268 [2024-04-26 20:42:45.657533] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:28.268 [2024-04-26 20:42:45.657653] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:28.268 [2024-04-26 20:42:45.657661] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:28.268 [2024-04-26 20:42:45.657668] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:28.268 [2024-04-26 20:42:45.657685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:28.268 20:42:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:28.268 20:42:46 -- common/autotest_common.sh@852 -- # return 0 00:25:28.268 20:42:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:28.268 20:42:46 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:28.268 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.268 20:42:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:28.268 20:42:46 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:25:28.268 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.268 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.268 [2024-04-26 20:42:46.324373] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:28.268 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.268 20:42:46 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:25:28.268 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.268 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.268 null0 00:25:28.268 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.268 20:42:46 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:25:28.268 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.268 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.268 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.268 20:42:46 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:25:28.268 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.268 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.268 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.268 20:42:46 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 98328d11b9a241df89bf95dafebb697d 00:25:28.268 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.268 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.268 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.268 20:42:46 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:28.268 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.268 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.268 [2024-04-26 20:42:46.380619] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:28.268 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.268 20:42:46 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:25:28.268 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.268 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.529 nvme0n1 00:25:28.529 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.529 20:42:46 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:28.529 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.529 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.529 [ 00:25:28.529 { 00:25:28.529 "name": "nvme0n1", 00:25:28.529 "aliases": [ 00:25:28.529 "98328d11-b9a2-41df-89bf-95dafebb697d" 00:25:28.529 ], 00:25:28.529 "product_name": "NVMe disk", 00:25:28.529 "block_size": 512, 00:25:28.529 "num_blocks": 2097152, 00:25:28.529 "uuid": "98328d11-b9a2-41df-89bf-95dafebb697d", 00:25:28.529 "assigned_rate_limits": { 00:25:28.529 "rw_ios_per_sec": 0, 00:25:28.529 "rw_mbytes_per_sec": 0, 00:25:28.529 "r_mbytes_per_sec": 0, 00:25:28.529 "w_mbytes_per_sec": 0 00:25:28.529 }, 00:25:28.529 "claimed": false, 00:25:28.529 "zoned": false, 00:25:28.529 "supported_io_types": { 00:25:28.529 "read": true, 00:25:28.529 "write": true, 00:25:28.529 "unmap": false, 00:25:28.529 "write_zeroes": true, 00:25:28.529 "flush": true, 00:25:28.529 "reset": true, 00:25:28.529 "compare": true, 00:25:28.529 "compare_and_write": true, 00:25:28.529 "abort": true, 00:25:28.529 "nvme_admin": true, 00:25:28.529 "nvme_io": true 00:25:28.529 }, 00:25:28.529 "driver_specific": { 00:25:28.529 "nvme": [ 00:25:28.529 { 00:25:28.529 "trid": { 00:25:28.529 "trtype": "TCP", 00:25:28.529 "adrfam": "IPv4", 00:25:28.529 "traddr": "10.0.0.2", 00:25:28.529 "trsvcid": "4420", 00:25:28.529 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:28.529 }, 00:25:28.529 "ctrlr_data": { 00:25:28.529 "cntlid": 1, 00:25:28.530 "vendor_id": "0x8086", 00:25:28.530 "model_number": "SPDK bdev Controller", 00:25:28.530 "serial_number": "00000000000000000000", 00:25:28.530 "firmware_revision": "24.01.1", 00:25:28.530 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:28.530 "oacs": { 00:25:28.530 "security": 0, 00:25:28.530 "format": 0, 00:25:28.530 "firmware": 0, 00:25:28.530 "ns_manage": 0 00:25:28.530 }, 00:25:28.530 "multi_ctrlr": true, 00:25:28.530 "ana_reporting": false 00:25:28.530 }, 00:25:28.530 "vs": { 00:25:28.530 "nvme_version": "1.3" 00:25:28.530 }, 00:25:28.530 "ns_data": { 00:25:28.530 "id": 1, 00:25:28.530 "can_share": true 00:25:28.530 } 00:25:28.530 } 00:25:28.530 ], 00:25:28.530 "mp_policy": "active_passive" 00:25:28.530 } 00:25:28.530 } 00:25:28.530 ] 00:25:28.530 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.530 20:42:46 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:25:28.530 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.530 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.530 [2024-04-26 20:42:46.645175] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:28.530 [2024-04-26 20:42:46.645236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x88bdb0 (9): Bad file descriptor 00:25:28.530 [2024-04-26 20:42:46.777371] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:28.530 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.530 20:42:46 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:28.530 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.530 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.530 [ 00:25:28.530 { 00:25:28.530 "name": "nvme0n1", 00:25:28.530 "aliases": [ 00:25:28.530 "98328d11-b9a2-41df-89bf-95dafebb697d" 00:25:28.530 ], 00:25:28.530 "product_name": "NVMe disk", 00:25:28.530 "block_size": 512, 00:25:28.530 "num_blocks": 2097152, 00:25:28.530 "uuid": "98328d11-b9a2-41df-89bf-95dafebb697d", 00:25:28.530 "assigned_rate_limits": { 00:25:28.530 "rw_ios_per_sec": 0, 00:25:28.530 "rw_mbytes_per_sec": 0, 00:25:28.530 "r_mbytes_per_sec": 0, 00:25:28.530 "w_mbytes_per_sec": 0 00:25:28.530 }, 00:25:28.530 "claimed": false, 00:25:28.530 "zoned": false, 00:25:28.530 "supported_io_types": { 00:25:28.530 "read": true, 00:25:28.530 "write": true, 00:25:28.530 "unmap": false, 00:25:28.530 "write_zeroes": true, 00:25:28.530 "flush": true, 00:25:28.530 "reset": true, 00:25:28.530 "compare": true, 00:25:28.530 "compare_and_write": true, 00:25:28.530 "abort": true, 00:25:28.530 "nvme_admin": true, 00:25:28.530 "nvme_io": true 00:25:28.530 }, 00:25:28.530 "driver_specific": { 00:25:28.530 "nvme": [ 00:25:28.530 { 00:25:28.530 "trid": { 00:25:28.530 "trtype": "TCP", 00:25:28.530 "adrfam": "IPv4", 00:25:28.530 "traddr": "10.0.0.2", 00:25:28.530 "trsvcid": "4420", 00:25:28.530 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:28.530 }, 00:25:28.530 "ctrlr_data": { 00:25:28.530 "cntlid": 2, 00:25:28.530 "vendor_id": "0x8086", 00:25:28.530 "model_number": "SPDK bdev Controller", 00:25:28.530 "serial_number": "00000000000000000000", 00:25:28.530 "firmware_revision": "24.01.1", 00:25:28.530 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:28.530 "oacs": { 00:25:28.530 "security": 0, 00:25:28.530 "format": 0, 00:25:28.530 "firmware": 0, 00:25:28.530 "ns_manage": 0 00:25:28.530 }, 00:25:28.530 "multi_ctrlr": true, 00:25:28.530 "ana_reporting": false 00:25:28.530 }, 00:25:28.530 "vs": { 00:25:28.530 "nvme_version": "1.3" 00:25:28.530 }, 00:25:28.530 "ns_data": { 00:25:28.530 "id": 1, 00:25:28.530 "can_share": true 00:25:28.530 } 00:25:28.530 } 00:25:28.530 ], 00:25:28.530 "mp_policy": "active_passive" 00:25:28.530 } 00:25:28.530 } 00:25:28.530 ] 00:25:28.530 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.530 20:42:46 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:28.530 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.530 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.530 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.530 20:42:46 -- host/async_init.sh@53 -- # mktemp 00:25:28.530 20:42:46 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.HtVM9xaaVO 00:25:28.530 20:42:46 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:25:28.530 20:42:46 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.HtVM9xaaVO 00:25:28.530 20:42:46 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:25:28.530 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.530 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.530 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.530 20:42:46 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:25:28.530 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.530 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.530 [2024-04-26 20:42:46.841790] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:25:28.530 [2024-04-26 20:42:46.841902] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:28.530 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.530 20:42:46 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.HtVM9xaaVO 00:25:28.530 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.530 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.530 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.530 20:42:46 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.HtVM9xaaVO 00:25:28.530 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.530 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.530 [2024-04-26 20:42:46.865856] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:25:28.791 nvme0n1 00:25:28.791 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.791 20:42:46 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:28.791 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.791 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.791 [ 00:25:28.791 { 00:25:28.791 "name": "nvme0n1", 00:25:28.791 "aliases": [ 00:25:28.791 "98328d11-b9a2-41df-89bf-95dafebb697d" 00:25:28.791 ], 00:25:28.791 "product_name": "NVMe disk", 00:25:28.791 "block_size": 512, 00:25:28.791 "num_blocks": 2097152, 00:25:28.791 "uuid": "98328d11-b9a2-41df-89bf-95dafebb697d", 00:25:28.791 "assigned_rate_limits": { 00:25:28.791 "rw_ios_per_sec": 0, 00:25:28.791 "rw_mbytes_per_sec": 0, 00:25:28.791 "r_mbytes_per_sec": 0, 00:25:28.791 "w_mbytes_per_sec": 0 00:25:28.791 }, 00:25:28.791 "claimed": false, 00:25:28.791 "zoned": false, 00:25:28.791 "supported_io_types": { 00:25:28.791 "read": true, 00:25:28.791 "write": true, 00:25:28.791 "unmap": false, 00:25:28.791 "write_zeroes": true, 00:25:28.791 "flush": true, 00:25:28.791 "reset": true, 00:25:28.791 "compare": true, 00:25:28.791 "compare_and_write": true, 00:25:28.791 "abort": true, 00:25:28.791 "nvme_admin": true, 00:25:28.791 "nvme_io": true 00:25:28.791 }, 00:25:28.791 "driver_specific": { 00:25:28.791 "nvme": [ 00:25:28.791 { 00:25:28.791 "trid": { 00:25:28.791 "trtype": "TCP", 00:25:28.791 "adrfam": "IPv4", 00:25:28.791 "traddr": "10.0.0.2", 00:25:28.791 "trsvcid": "4421", 00:25:28.791 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:28.791 }, 00:25:28.791 "ctrlr_data": { 00:25:28.791 "cntlid": 3, 00:25:28.791 "vendor_id": "0x8086", 00:25:28.791 "model_number": "SPDK bdev Controller", 00:25:28.791 "serial_number": "00000000000000000000", 00:25:28.791 "firmware_revision": "24.01.1", 00:25:28.791 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:28.791 "oacs": { 00:25:28.791 "security": 0, 00:25:28.791 "format": 0, 00:25:28.791 "firmware": 0, 00:25:28.791 "ns_manage": 0 00:25:28.791 }, 00:25:28.791 "multi_ctrlr": true, 00:25:28.791 "ana_reporting": false 00:25:28.791 }, 00:25:28.791 "vs": { 00:25:28.791 "nvme_version": "1.3" 00:25:28.791 }, 00:25:28.791 "ns_data": { 00:25:28.791 "id": 1, 00:25:28.791 "can_share": true 00:25:28.791 } 00:25:28.791 } 00:25:28.791 ], 00:25:28.791 "mp_policy": "active_passive" 00:25:28.791 } 00:25:28.791 } 00:25:28.791 ] 00:25:28.791 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.791 20:42:46 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:28.791 20:42:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:28.791 20:42:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.791 20:42:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:28.791 20:42:46 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.HtVM9xaaVO 00:25:28.791 20:42:46 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:25:28.791 20:42:46 -- host/async_init.sh@78 -- # nvmftestfini 00:25:28.791 20:42:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:28.791 20:42:46 -- nvmf/common.sh@116 -- # sync 00:25:28.791 20:42:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:28.791 20:42:46 -- nvmf/common.sh@119 -- # set +e 00:25:28.791 20:42:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:28.791 20:42:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:28.791 rmmod nvme_tcp 00:25:28.791 rmmod nvme_fabrics 00:25:28.791 rmmod nvme_keyring 00:25:28.791 20:42:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:28.791 20:42:47 -- nvmf/common.sh@123 -- # set -e 00:25:28.791 20:42:47 -- nvmf/common.sh@124 -- # return 0 00:25:28.791 20:42:47 -- nvmf/common.sh@477 -- # '[' -n 4173205 ']' 00:25:28.791 20:42:47 -- nvmf/common.sh@478 -- # killprocess 4173205 00:25:28.791 20:42:47 -- common/autotest_common.sh@926 -- # '[' -z 4173205 ']' 00:25:28.791 20:42:47 -- common/autotest_common.sh@930 -- # kill -0 4173205 00:25:28.791 20:42:47 -- common/autotest_common.sh@931 -- # uname 00:25:28.791 20:42:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:28.791 20:42:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4173205 00:25:28.791 20:42:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:28.791 20:42:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:28.791 20:42:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4173205' 00:25:28.791 killing process with pid 4173205 00:25:28.791 20:42:47 -- common/autotest_common.sh@945 -- # kill 4173205 00:25:28.791 20:42:47 -- common/autotest_common.sh@950 -- # wait 4173205 00:25:29.052 20:42:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:29.052 20:42:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:29.052 20:42:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:29.052 20:42:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:29.052 20:42:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:29.052 20:42:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:29.052 20:42:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:29.052 20:42:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:30.969 20:42:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:30.969 00:25:30.969 real 0m11.268s 00:25:30.969 user 0m3.943s 00:25:30.969 sys 0m5.777s 00:25:30.969 20:42:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:30.969 20:42:49 -- common/autotest_common.sh@10 -- # set +x 00:25:30.969 ************************************ 00:25:30.969 END TEST nvmf_async_init 00:25:30.969 ************************************ 00:25:31.230 20:42:49 -- nvmf/nvmf.sh@93 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:31.230 20:42:49 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:31.230 20:42:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:31.230 20:42:49 -- common/autotest_common.sh@10 -- # set +x 00:25:31.230 ************************************ 00:25:31.230 START TEST dma 00:25:31.230 ************************************ 00:25:31.230 20:42:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:31.230 * Looking for test storage... 00:25:31.230 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:31.230 20:42:49 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:31.230 20:42:49 -- nvmf/common.sh@7 -- # uname -s 00:25:31.230 20:42:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:31.230 20:42:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:31.230 20:42:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:31.230 20:42:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:31.230 20:42:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:31.230 20:42:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:31.230 20:42:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:31.230 20:42:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:31.230 20:42:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:31.230 20:42:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:31.230 20:42:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:31.230 20:42:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:31.230 20:42:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:31.231 20:42:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:31.231 20:42:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:31.231 20:42:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:31.231 20:42:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:31.231 20:42:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:31.231 20:42:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:31.231 20:42:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:31.231 20:42:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:31.231 20:42:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:31.231 20:42:49 -- paths/export.sh@5 -- # export PATH 00:25:31.231 20:42:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:31.231 20:42:49 -- nvmf/common.sh@46 -- # : 0 00:25:31.231 20:42:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:31.231 20:42:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:31.231 20:42:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:31.231 20:42:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:31.231 20:42:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:31.231 20:42:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:31.231 20:42:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:31.231 20:42:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:31.231 20:42:49 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:25:31.231 20:42:49 -- host/dma.sh@13 -- # exit 0 00:25:31.231 00:25:31.231 real 0m0.127s 00:25:31.231 user 0m0.072s 00:25:31.231 sys 0m0.064s 00:25:31.231 20:42:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:31.231 20:42:49 -- common/autotest_common.sh@10 -- # set +x 00:25:31.231 ************************************ 00:25:31.231 END TEST dma 00:25:31.231 ************************************ 00:25:31.231 20:42:49 -- nvmf/nvmf.sh@96 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:31.231 20:42:49 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:31.231 20:42:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:31.231 20:42:49 -- common/autotest_common.sh@10 -- # set +x 00:25:31.231 ************************************ 00:25:31.231 START TEST nvmf_identify 00:25:31.231 ************************************ 00:25:31.231 20:42:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:31.493 * Looking for test storage... 00:25:31.493 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:31.493 20:42:49 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:31.493 20:42:49 -- nvmf/common.sh@7 -- # uname -s 00:25:31.493 20:42:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:31.493 20:42:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:31.493 20:42:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:31.493 20:42:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:31.493 20:42:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:31.493 20:42:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:31.493 20:42:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:31.493 20:42:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:31.493 20:42:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:31.493 20:42:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:31.493 20:42:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:31.493 20:42:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:31.493 20:42:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:31.493 20:42:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:31.493 20:42:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:31.493 20:42:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:31.493 20:42:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:31.493 20:42:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:31.493 20:42:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:31.493 20:42:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:31.493 20:42:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:31.493 20:42:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:31.493 20:42:49 -- paths/export.sh@5 -- # export PATH 00:25:31.493 20:42:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:31.493 20:42:49 -- nvmf/common.sh@46 -- # : 0 00:25:31.493 20:42:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:31.493 20:42:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:31.493 20:42:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:31.493 20:42:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:31.493 20:42:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:31.493 20:42:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:31.493 20:42:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:31.493 20:42:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:31.493 20:42:49 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:31.493 20:42:49 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:31.493 20:42:49 -- host/identify.sh@14 -- # nvmftestinit 00:25:31.493 20:42:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:31.493 20:42:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:31.493 20:42:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:31.493 20:42:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:31.493 20:42:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:31.493 20:42:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:31.493 20:42:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:31.493 20:42:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:31.493 20:42:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:31.493 20:42:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:31.493 20:42:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:31.493 20:42:49 -- common/autotest_common.sh@10 -- # set +x 00:25:38.094 20:42:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:38.094 20:42:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:38.094 20:42:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:38.094 20:42:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:38.094 20:42:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:38.094 20:42:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:38.094 20:42:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:38.094 20:42:56 -- nvmf/common.sh@294 -- # net_devs=() 00:25:38.094 20:42:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:38.094 20:42:56 -- nvmf/common.sh@295 -- # e810=() 00:25:38.094 20:42:56 -- nvmf/common.sh@295 -- # local -ga e810 00:25:38.094 20:42:56 -- nvmf/common.sh@296 -- # x722=() 00:25:38.094 20:42:56 -- nvmf/common.sh@296 -- # local -ga x722 00:25:38.094 20:42:56 -- nvmf/common.sh@297 -- # mlx=() 00:25:38.094 20:42:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:38.094 20:42:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:38.094 20:42:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:38.094 20:42:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:38.094 20:42:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:38.094 20:42:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:38.094 20:42:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:38.094 20:42:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:38.094 20:42:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:38.095 20:42:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:38.095 20:42:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:38.095 20:42:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:38.095 20:42:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:38.095 20:42:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:38.095 20:42:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:38.095 20:42:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:38.095 20:42:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:25:38.095 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:25:38.095 20:42:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:38.095 20:42:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:25:38.095 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:25:38.095 20:42:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:38.095 20:42:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:38.095 20:42:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:38.095 20:42:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:38.095 20:42:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:38.095 20:42:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:25:38.095 Found net devices under 0000:4b:00.0: cvl_0_0 00:25:38.095 20:42:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:38.095 20:42:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:38.095 20:42:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:38.095 20:42:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:38.095 20:42:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:38.095 20:42:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:25:38.095 Found net devices under 0000:4b:00.1: cvl_0_1 00:25:38.095 20:42:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:38.095 20:42:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:38.095 20:42:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:38.095 20:42:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:38.095 20:42:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:38.095 20:42:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:38.095 20:42:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:38.095 20:42:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:38.095 20:42:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:38.095 20:42:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:38.095 20:42:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:38.095 20:42:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:38.095 20:42:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:38.095 20:42:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:38.095 20:42:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:38.095 20:42:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:38.095 20:42:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:38.095 20:42:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:38.356 20:42:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:38.356 20:42:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:38.356 20:42:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:38.356 20:42:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:38.356 20:42:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:38.356 20:42:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:38.356 20:42:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:38.356 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:38.356 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.480 ms 00:25:38.356 00:25:38.356 --- 10.0.0.2 ping statistics --- 00:25:38.356 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:38.356 rtt min/avg/max/mdev = 0.480/0.480/0.480/0.000 ms 00:25:38.356 20:42:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:38.356 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:38.356 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.258 ms 00:25:38.356 00:25:38.356 --- 10.0.0.1 ping statistics --- 00:25:38.356 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:38.356 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:25:38.356 20:42:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:38.356 20:42:56 -- nvmf/common.sh@410 -- # return 0 00:25:38.356 20:42:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:38.356 20:42:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:38.356 20:42:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:38.356 20:42:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:38.356 20:42:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:38.356 20:42:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:38.356 20:42:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:38.356 20:42:56 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:25:38.356 20:42:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:38.356 20:42:56 -- common/autotest_common.sh@10 -- # set +x 00:25:38.356 20:42:56 -- host/identify.sh@19 -- # nvmfpid=4177614 00:25:38.356 20:42:56 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:38.356 20:42:56 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:38.356 20:42:56 -- host/identify.sh@23 -- # waitforlisten 4177614 00:25:38.356 20:42:56 -- common/autotest_common.sh@819 -- # '[' -z 4177614 ']' 00:25:38.356 20:42:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:38.356 20:42:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:38.356 20:42:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:38.356 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:38.356 20:42:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:38.356 20:42:56 -- common/autotest_common.sh@10 -- # set +x 00:25:38.617 [2024-04-26 20:42:56.741474] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:38.617 [2024-04-26 20:42:56.741540] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:38.617 EAL: No free 2048 kB hugepages reported on node 1 00:25:38.617 [2024-04-26 20:42:56.813462] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:38.617 [2024-04-26 20:42:56.889069] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:38.617 [2024-04-26 20:42:56.889206] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:38.617 [2024-04-26 20:42:56.889216] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:38.617 [2024-04-26 20:42:56.889224] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:38.617 [2024-04-26 20:42:56.889349] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:38.617 [2024-04-26 20:42:56.889387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:38.617 [2024-04-26 20:42:56.889524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:38.617 [2024-04-26 20:42:56.889527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:39.189 20:42:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:39.189 20:42:57 -- common/autotest_common.sh@852 -- # return 0 00:25:39.189 20:42:57 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:39.189 20:42:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.189 20:42:57 -- common/autotest_common.sh@10 -- # set +x 00:25:39.189 [2024-04-26 20:42:57.526333] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:39.452 20:42:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.452 20:42:57 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:25:39.452 20:42:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:39.452 20:42:57 -- common/autotest_common.sh@10 -- # set +x 00:25:39.452 20:42:57 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:39.452 20:42:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.452 20:42:57 -- common/autotest_common.sh@10 -- # set +x 00:25:39.452 Malloc0 00:25:39.452 20:42:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.452 20:42:57 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:39.452 20:42:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.452 20:42:57 -- common/autotest_common.sh@10 -- # set +x 00:25:39.452 20:42:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.452 20:42:57 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:25:39.452 20:42:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.452 20:42:57 -- common/autotest_common.sh@10 -- # set +x 00:25:39.452 20:42:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.452 20:42:57 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:39.452 20:42:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.452 20:42:57 -- common/autotest_common.sh@10 -- # set +x 00:25:39.452 [2024-04-26 20:42:57.625786] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:39.452 20:42:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.452 20:42:57 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:39.453 20:42:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.453 20:42:57 -- common/autotest_common.sh@10 -- # set +x 00:25:39.453 20:42:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.453 20:42:57 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:25:39.453 20:42:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.453 20:42:57 -- common/autotest_common.sh@10 -- # set +x 00:25:39.453 [2024-04-26 20:42:57.649655] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:39.453 [ 00:25:39.453 { 00:25:39.453 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:39.453 "subtype": "Discovery", 00:25:39.453 "listen_addresses": [ 00:25:39.453 { 00:25:39.453 "transport": "TCP", 00:25:39.453 "trtype": "TCP", 00:25:39.453 "adrfam": "IPv4", 00:25:39.453 "traddr": "10.0.0.2", 00:25:39.453 "trsvcid": "4420" 00:25:39.453 } 00:25:39.453 ], 00:25:39.453 "allow_any_host": true, 00:25:39.453 "hosts": [] 00:25:39.453 }, 00:25:39.453 { 00:25:39.453 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:39.453 "subtype": "NVMe", 00:25:39.453 "listen_addresses": [ 00:25:39.453 { 00:25:39.453 "transport": "TCP", 00:25:39.453 "trtype": "TCP", 00:25:39.453 "adrfam": "IPv4", 00:25:39.453 "traddr": "10.0.0.2", 00:25:39.453 "trsvcid": "4420" 00:25:39.453 } 00:25:39.453 ], 00:25:39.453 "allow_any_host": true, 00:25:39.453 "hosts": [], 00:25:39.453 "serial_number": "SPDK00000000000001", 00:25:39.453 "model_number": "SPDK bdev Controller", 00:25:39.453 "max_namespaces": 32, 00:25:39.453 "min_cntlid": 1, 00:25:39.453 "max_cntlid": 65519, 00:25:39.453 "namespaces": [ 00:25:39.453 { 00:25:39.453 "nsid": 1, 00:25:39.453 "bdev_name": "Malloc0", 00:25:39.453 "name": "Malloc0", 00:25:39.453 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:25:39.453 "eui64": "ABCDEF0123456789", 00:25:39.453 "uuid": "6d99fb22-b4e4-4632-a7d6-67c172d64d5f" 00:25:39.453 } 00:25:39.453 ] 00:25:39.453 } 00:25:39.453 ] 00:25:39.453 20:42:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.453 20:42:57 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:25:39.453 [2024-04-26 20:42:57.686920] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:39.453 [2024-04-26 20:42:57.686961] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4177967 ] 00:25:39.453 EAL: No free 2048 kB hugepages reported on node 1 00:25:39.453 [2024-04-26 20:42:57.719906] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:25:39.453 [2024-04-26 20:42:57.719954] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:39.453 [2024-04-26 20:42:57.719959] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:39.453 [2024-04-26 20:42:57.719969] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:39.453 [2024-04-26 20:42:57.719977] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:39.453 [2024-04-26 20:42:57.722346] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:25:39.453 [2024-04-26 20:42:57.722379] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x20ea9e0 0 00:25:39.453 [2024-04-26 20:42:57.731285] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:39.453 [2024-04-26 20:42:57.731300] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:39.453 [2024-04-26 20:42:57.731305] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:39.453 [2024-04-26 20:42:57.731309] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:39.453 [2024-04-26 20:42:57.731346] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.731352] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.731356] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20ea9e0) 00:25:39.453 [2024-04-26 20:42:57.731370] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:39.453 [2024-04-26 20:42:57.731387] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152730, cid 0, qid 0 00:25:39.453 [2024-04-26 20:42:57.739286] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.453 [2024-04-26 20:42:57.739296] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.453 [2024-04-26 20:42:57.739299] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.739304] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152730) on tqpair=0x20ea9e0 00:25:39.453 [2024-04-26 20:42:57.739314] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:39.453 [2024-04-26 20:42:57.739320] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:25:39.453 [2024-04-26 20:42:57.739325] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:25:39.453 [2024-04-26 20:42:57.739339] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.739343] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.739347] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20ea9e0) 00:25:39.453 [2024-04-26 20:42:57.739354] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.453 [2024-04-26 20:42:57.739367] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152730, cid 0, qid 0 00:25:39.453 [2024-04-26 20:42:57.739493] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.453 [2024-04-26 20:42:57.739501] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.453 [2024-04-26 20:42:57.739504] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.739508] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152730) on tqpair=0x20ea9e0 00:25:39.453 [2024-04-26 20:42:57.739518] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:25:39.453 [2024-04-26 20:42:57.739525] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:25:39.453 [2024-04-26 20:42:57.739532] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.739536] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.739539] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20ea9e0) 00:25:39.453 [2024-04-26 20:42:57.739546] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.453 [2024-04-26 20:42:57.739558] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152730, cid 0, qid 0 00:25:39.453 [2024-04-26 20:42:57.739672] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.453 [2024-04-26 20:42:57.739679] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.453 [2024-04-26 20:42:57.739683] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.739689] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152730) on tqpair=0x20ea9e0 00:25:39.453 [2024-04-26 20:42:57.739696] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:25:39.453 [2024-04-26 20:42:57.739704] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:25:39.453 [2024-04-26 20:42:57.739710] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.739714] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.739718] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20ea9e0) 00:25:39.453 [2024-04-26 20:42:57.739725] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.453 [2024-04-26 20:42:57.739736] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152730, cid 0, qid 0 00:25:39.453 [2024-04-26 20:42:57.739846] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.453 [2024-04-26 20:42:57.739853] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.453 [2024-04-26 20:42:57.739857] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.739860] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152730) on tqpair=0x20ea9e0 00:25:39.453 [2024-04-26 20:42:57.739867] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:39.453 [2024-04-26 20:42:57.739876] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.739879] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.739883] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20ea9e0) 00:25:39.453 [2024-04-26 20:42:57.739890] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.453 [2024-04-26 20:42:57.739901] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152730, cid 0, qid 0 00:25:39.453 [2024-04-26 20:42:57.740007] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.453 [2024-04-26 20:42:57.740014] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.453 [2024-04-26 20:42:57.740017] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.740021] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152730) on tqpair=0x20ea9e0 00:25:39.453 [2024-04-26 20:42:57.740027] nvme_ctrlr.c:3736:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:25:39.453 [2024-04-26 20:42:57.740031] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:25:39.453 [2024-04-26 20:42:57.740039] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:39.453 [2024-04-26 20:42:57.740144] nvme_ctrlr.c:3929:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:25:39.453 [2024-04-26 20:42:57.740149] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:39.453 [2024-04-26 20:42:57.740157] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.740161] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.453 [2024-04-26 20:42:57.740164] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20ea9e0) 00:25:39.454 [2024-04-26 20:42:57.740171] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.454 [2024-04-26 20:42:57.740182] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152730, cid 0, qid 0 00:25:39.454 [2024-04-26 20:42:57.740301] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.454 [2024-04-26 20:42:57.740309] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.454 [2024-04-26 20:42:57.740312] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.740316] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152730) on tqpair=0x20ea9e0 00:25:39.454 [2024-04-26 20:42:57.740322] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:39.454 [2024-04-26 20:42:57.740331] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.740334] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.740338] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20ea9e0) 00:25:39.454 [2024-04-26 20:42:57.740345] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.454 [2024-04-26 20:42:57.740356] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152730, cid 0, qid 0 00:25:39.454 [2024-04-26 20:42:57.740472] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.454 [2024-04-26 20:42:57.740479] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.454 [2024-04-26 20:42:57.740482] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.740486] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152730) on tqpair=0x20ea9e0 00:25:39.454 [2024-04-26 20:42:57.740491] nvme_ctrlr.c:3771:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:39.454 [2024-04-26 20:42:57.740496] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:25:39.454 [2024-04-26 20:42:57.740503] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:25:39.454 [2024-04-26 20:42:57.740516] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:25:39.454 [2024-04-26 20:42:57.740525] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.740528] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.740532] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20ea9e0) 00:25:39.454 [2024-04-26 20:42:57.740539] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.454 [2024-04-26 20:42:57.740551] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152730, cid 0, qid 0 00:25:39.454 [2024-04-26 20:42:57.740685] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.454 [2024-04-26 20:42:57.740692] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.454 [2024-04-26 20:42:57.740695] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.740699] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x20ea9e0): datao=0, datal=4096, cccid=0 00:25:39.454 [2024-04-26 20:42:57.740704] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2152730) on tqpair(0x20ea9e0): expected_datao=0, payload_size=4096 00:25:39.454 [2024-04-26 20:42:57.740771] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.740777] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.740855] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.454 [2024-04-26 20:42:57.740861] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.454 [2024-04-26 20:42:57.740865] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.740868] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152730) on tqpair=0x20ea9e0 00:25:39.454 [2024-04-26 20:42:57.740893] nvme_ctrlr.c:1971:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:25:39.454 [2024-04-26 20:42:57.740901] nvme_ctrlr.c:1975:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:25:39.454 [2024-04-26 20:42:57.740905] nvme_ctrlr.c:1978:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:25:39.454 [2024-04-26 20:42:57.740911] nvme_ctrlr.c:2002:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:25:39.454 [2024-04-26 20:42:57.740915] nvme_ctrlr.c:2017:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:25:39.454 [2024-04-26 20:42:57.740920] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:25:39.454 [2024-04-26 20:42:57.740927] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:25:39.454 [2024-04-26 20:42:57.740934] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.740938] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.740942] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20ea9e0) 00:25:39.454 [2024-04-26 20:42:57.740949] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:39.454 [2024-04-26 20:42:57.740961] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152730, cid 0, qid 0 00:25:39.454 [2024-04-26 20:42:57.741080] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.454 [2024-04-26 20:42:57.741086] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.454 [2024-04-26 20:42:57.741090] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741094] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152730) on tqpair=0x20ea9e0 00:25:39.454 [2024-04-26 20:42:57.741101] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741105] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741109] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x20ea9e0) 00:25:39.454 [2024-04-26 20:42:57.741115] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.454 [2024-04-26 20:42:57.741121] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741125] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741128] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x20ea9e0) 00:25:39.454 [2024-04-26 20:42:57.741134] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.454 [2024-04-26 20:42:57.741140] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741143] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741147] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x20ea9e0) 00:25:39.454 [2024-04-26 20:42:57.741152] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.454 [2024-04-26 20:42:57.741158] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741162] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741165] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20ea9e0) 00:25:39.454 [2024-04-26 20:42:57.741171] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.454 [2024-04-26 20:42:57.741176] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:25:39.454 [2024-04-26 20:42:57.741189] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:39.454 [2024-04-26 20:42:57.741195] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741199] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741202] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x20ea9e0) 00:25:39.454 [2024-04-26 20:42:57.741209] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.454 [2024-04-26 20:42:57.741221] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152730, cid 0, qid 0 00:25:39.454 [2024-04-26 20:42:57.741228] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152890, cid 1, qid 0 00:25:39.454 [2024-04-26 20:42:57.741235] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x21529f0, cid 2, qid 0 00:25:39.454 [2024-04-26 20:42:57.741243] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152b50, cid 3, qid 0 00:25:39.454 [2024-04-26 20:42:57.741247] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152cb0, cid 4, qid 0 00:25:39.454 [2024-04-26 20:42:57.741406] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.454 [2024-04-26 20:42:57.741413] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.454 [2024-04-26 20:42:57.741416] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741420] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152cb0) on tqpair=0x20ea9e0 00:25:39.454 [2024-04-26 20:42:57.741426] nvme_ctrlr.c:2889:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:25:39.454 [2024-04-26 20:42:57.741431] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:25:39.454 [2024-04-26 20:42:57.741442] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741446] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741449] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x20ea9e0) 00:25:39.454 [2024-04-26 20:42:57.741456] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.454 [2024-04-26 20:42:57.741467] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152cb0, cid 4, qid 0 00:25:39.454 [2024-04-26 20:42:57.741582] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.454 [2024-04-26 20:42:57.741589] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.454 [2024-04-26 20:42:57.741592] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741596] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x20ea9e0): datao=0, datal=4096, cccid=4 00:25:39.454 [2024-04-26 20:42:57.741600] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2152cb0) on tqpair(0x20ea9e0): expected_datao=0, payload_size=4096 00:25:39.454 [2024-04-26 20:42:57.741664] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741669] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.454 [2024-04-26 20:42:57.741747] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.454 [2024-04-26 20:42:57.741754] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.454 [2024-04-26 20:42:57.741757] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.741761] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152cb0) on tqpair=0x20ea9e0 00:25:39.455 [2024-04-26 20:42:57.741774] nvme_ctrlr.c:4023:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:25:39.455 [2024-04-26 20:42:57.741794] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.741799] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.741802] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x20ea9e0) 00:25:39.455 [2024-04-26 20:42:57.741809] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.455 [2024-04-26 20:42:57.741816] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.741819] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.741823] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x20ea9e0) 00:25:39.455 [2024-04-26 20:42:57.741829] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.455 [2024-04-26 20:42:57.741847] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152cb0, cid 4, qid 0 00:25:39.455 [2024-04-26 20:42:57.741853] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152e10, cid 5, qid 0 00:25:39.455 [2024-04-26 20:42:57.742003] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.455 [2024-04-26 20:42:57.742009] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.455 [2024-04-26 20:42:57.742013] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.742017] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x20ea9e0): datao=0, datal=1024, cccid=4 00:25:39.455 [2024-04-26 20:42:57.742021] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2152cb0) on tqpair(0x20ea9e0): expected_datao=0, payload_size=1024 00:25:39.455 [2024-04-26 20:42:57.742028] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.742032] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.742037] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.455 [2024-04-26 20:42:57.742043] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.455 [2024-04-26 20:42:57.742046] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.742050] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152e10) on tqpair=0x20ea9e0 00:25:39.455 [2024-04-26 20:42:57.787284] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.455 [2024-04-26 20:42:57.787294] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.455 [2024-04-26 20:42:57.787298] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.787302] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152cb0) on tqpair=0x20ea9e0 00:25:39.455 [2024-04-26 20:42:57.787315] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.787319] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.787322] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x20ea9e0) 00:25:39.455 [2024-04-26 20:42:57.787329] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.455 [2024-04-26 20:42:57.787346] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152cb0, cid 4, qid 0 00:25:39.455 [2024-04-26 20:42:57.787527] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.455 [2024-04-26 20:42:57.787535] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.455 [2024-04-26 20:42:57.787539] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.787542] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x20ea9e0): datao=0, datal=3072, cccid=4 00:25:39.455 [2024-04-26 20:42:57.787547] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2152cb0) on tqpair(0x20ea9e0): expected_datao=0, payload_size=3072 00:25:39.455 [2024-04-26 20:42:57.787554] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.455 [2024-04-26 20:42:57.787561] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.721 [2024-04-26 20:42:57.828377] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.721 [2024-04-26 20:42:57.828393] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.721 [2024-04-26 20:42:57.828398] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.721 [2024-04-26 20:42:57.828402] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152cb0) on tqpair=0x20ea9e0 00:25:39.721 [2024-04-26 20:42:57.828413] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.721 [2024-04-26 20:42:57.828417] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.721 [2024-04-26 20:42:57.828421] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x20ea9e0) 00:25:39.721 [2024-04-26 20:42:57.828428] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.721 [2024-04-26 20:42:57.828444] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152cb0, cid 4, qid 0 00:25:39.721 [2024-04-26 20:42:57.828563] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.721 [2024-04-26 20:42:57.828569] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.721 [2024-04-26 20:42:57.828573] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.721 [2024-04-26 20:42:57.828576] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x20ea9e0): datao=0, datal=8, cccid=4 00:25:39.721 [2024-04-26 20:42:57.828581] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2152cb0) on tqpair(0x20ea9e0): expected_datao=0, payload_size=8 00:25:39.721 [2024-04-26 20:42:57.828588] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.721 [2024-04-26 20:42:57.828591] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.721 [2024-04-26 20:42:57.869378] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.721 [2024-04-26 20:42:57.869394] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.721 [2024-04-26 20:42:57.869398] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.721 [2024-04-26 20:42:57.869401] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152cb0) on tqpair=0x20ea9e0 00:25:39.721 ===================================================== 00:25:39.721 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:25:39.721 ===================================================== 00:25:39.721 Controller Capabilities/Features 00:25:39.721 ================================ 00:25:39.721 Vendor ID: 0000 00:25:39.721 Subsystem Vendor ID: 0000 00:25:39.721 Serial Number: .................... 00:25:39.721 Model Number: ........................................ 00:25:39.721 Firmware Version: 24.01.1 00:25:39.721 Recommended Arb Burst: 0 00:25:39.721 IEEE OUI Identifier: 00 00 00 00:25:39.721 Multi-path I/O 00:25:39.721 May have multiple subsystem ports: No 00:25:39.721 May have multiple controllers: No 00:25:39.721 Associated with SR-IOV VF: No 00:25:39.721 Max Data Transfer Size: 131072 00:25:39.721 Max Number of Namespaces: 0 00:25:39.721 Max Number of I/O Queues: 1024 00:25:39.721 NVMe Specification Version (VS): 1.3 00:25:39.721 NVMe Specification Version (Identify): 1.3 00:25:39.721 Maximum Queue Entries: 128 00:25:39.721 Contiguous Queues Required: Yes 00:25:39.721 Arbitration Mechanisms Supported 00:25:39.721 Weighted Round Robin: Not Supported 00:25:39.721 Vendor Specific: Not Supported 00:25:39.721 Reset Timeout: 15000 ms 00:25:39.721 Doorbell Stride: 4 bytes 00:25:39.721 NVM Subsystem Reset: Not Supported 00:25:39.721 Command Sets Supported 00:25:39.721 NVM Command Set: Supported 00:25:39.721 Boot Partition: Not Supported 00:25:39.721 Memory Page Size Minimum: 4096 bytes 00:25:39.721 Memory Page Size Maximum: 4096 bytes 00:25:39.721 Persistent Memory Region: Not Supported 00:25:39.721 Optional Asynchronous Events Supported 00:25:39.721 Namespace Attribute Notices: Not Supported 00:25:39.721 Firmware Activation Notices: Not Supported 00:25:39.721 ANA Change Notices: Not Supported 00:25:39.721 PLE Aggregate Log Change Notices: Not Supported 00:25:39.721 LBA Status Info Alert Notices: Not Supported 00:25:39.721 EGE Aggregate Log Change Notices: Not Supported 00:25:39.721 Normal NVM Subsystem Shutdown event: Not Supported 00:25:39.721 Zone Descriptor Change Notices: Not Supported 00:25:39.721 Discovery Log Change Notices: Supported 00:25:39.721 Controller Attributes 00:25:39.721 128-bit Host Identifier: Not Supported 00:25:39.721 Non-Operational Permissive Mode: Not Supported 00:25:39.721 NVM Sets: Not Supported 00:25:39.721 Read Recovery Levels: Not Supported 00:25:39.721 Endurance Groups: Not Supported 00:25:39.721 Predictable Latency Mode: Not Supported 00:25:39.721 Traffic Based Keep ALive: Not Supported 00:25:39.721 Namespace Granularity: Not Supported 00:25:39.721 SQ Associations: Not Supported 00:25:39.721 UUID List: Not Supported 00:25:39.721 Multi-Domain Subsystem: Not Supported 00:25:39.721 Fixed Capacity Management: Not Supported 00:25:39.721 Variable Capacity Management: Not Supported 00:25:39.721 Delete Endurance Group: Not Supported 00:25:39.721 Delete NVM Set: Not Supported 00:25:39.721 Extended LBA Formats Supported: Not Supported 00:25:39.721 Flexible Data Placement Supported: Not Supported 00:25:39.721 00:25:39.721 Controller Memory Buffer Support 00:25:39.721 ================================ 00:25:39.721 Supported: No 00:25:39.721 00:25:39.721 Persistent Memory Region Support 00:25:39.721 ================================ 00:25:39.721 Supported: No 00:25:39.721 00:25:39.721 Admin Command Set Attributes 00:25:39.721 ============================ 00:25:39.721 Security Send/Receive: Not Supported 00:25:39.721 Format NVM: Not Supported 00:25:39.721 Firmware Activate/Download: Not Supported 00:25:39.721 Namespace Management: Not Supported 00:25:39.721 Device Self-Test: Not Supported 00:25:39.721 Directives: Not Supported 00:25:39.721 NVMe-MI: Not Supported 00:25:39.721 Virtualization Management: Not Supported 00:25:39.721 Doorbell Buffer Config: Not Supported 00:25:39.721 Get LBA Status Capability: Not Supported 00:25:39.721 Command & Feature Lockdown Capability: Not Supported 00:25:39.721 Abort Command Limit: 1 00:25:39.721 Async Event Request Limit: 4 00:25:39.721 Number of Firmware Slots: N/A 00:25:39.721 Firmware Slot 1 Read-Only: N/A 00:25:39.721 Firmware Activation Without Reset: N/A 00:25:39.721 Multiple Update Detection Support: N/A 00:25:39.721 Firmware Update Granularity: No Information Provided 00:25:39.721 Per-Namespace SMART Log: No 00:25:39.721 Asymmetric Namespace Access Log Page: Not Supported 00:25:39.721 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:25:39.721 Command Effects Log Page: Not Supported 00:25:39.721 Get Log Page Extended Data: Supported 00:25:39.721 Telemetry Log Pages: Not Supported 00:25:39.721 Persistent Event Log Pages: Not Supported 00:25:39.721 Supported Log Pages Log Page: May Support 00:25:39.721 Commands Supported & Effects Log Page: Not Supported 00:25:39.721 Feature Identifiers & Effects Log Page:May Support 00:25:39.721 NVMe-MI Commands & Effects Log Page: May Support 00:25:39.721 Data Area 4 for Telemetry Log: Not Supported 00:25:39.721 Error Log Page Entries Supported: 128 00:25:39.721 Keep Alive: Not Supported 00:25:39.721 00:25:39.721 NVM Command Set Attributes 00:25:39.721 ========================== 00:25:39.721 Submission Queue Entry Size 00:25:39.721 Max: 1 00:25:39.721 Min: 1 00:25:39.721 Completion Queue Entry Size 00:25:39.721 Max: 1 00:25:39.721 Min: 1 00:25:39.721 Number of Namespaces: 0 00:25:39.721 Compare Command: Not Supported 00:25:39.721 Write Uncorrectable Command: Not Supported 00:25:39.721 Dataset Management Command: Not Supported 00:25:39.721 Write Zeroes Command: Not Supported 00:25:39.721 Set Features Save Field: Not Supported 00:25:39.721 Reservations: Not Supported 00:25:39.721 Timestamp: Not Supported 00:25:39.721 Copy: Not Supported 00:25:39.721 Volatile Write Cache: Not Present 00:25:39.721 Atomic Write Unit (Normal): 1 00:25:39.721 Atomic Write Unit (PFail): 1 00:25:39.721 Atomic Compare & Write Unit: 1 00:25:39.721 Fused Compare & Write: Supported 00:25:39.721 Scatter-Gather List 00:25:39.721 SGL Command Set: Supported 00:25:39.721 SGL Keyed: Supported 00:25:39.721 SGL Bit Bucket Descriptor: Not Supported 00:25:39.721 SGL Metadata Pointer: Not Supported 00:25:39.721 Oversized SGL: Not Supported 00:25:39.721 SGL Metadata Address: Not Supported 00:25:39.721 SGL Offset: Supported 00:25:39.721 Transport SGL Data Block: Not Supported 00:25:39.721 Replay Protected Memory Block: Not Supported 00:25:39.721 00:25:39.721 Firmware Slot Information 00:25:39.721 ========================= 00:25:39.721 Active slot: 0 00:25:39.721 00:25:39.721 00:25:39.721 Error Log 00:25:39.721 ========= 00:25:39.721 00:25:39.721 Active Namespaces 00:25:39.721 ================= 00:25:39.721 Discovery Log Page 00:25:39.721 ================== 00:25:39.721 Generation Counter: 2 00:25:39.721 Number of Records: 2 00:25:39.721 Record Format: 0 00:25:39.721 00:25:39.721 Discovery Log Entry 0 00:25:39.721 ---------------------- 00:25:39.721 Transport Type: 3 (TCP) 00:25:39.721 Address Family: 1 (IPv4) 00:25:39.721 Subsystem Type: 3 (Current Discovery Subsystem) 00:25:39.721 Entry Flags: 00:25:39.721 Duplicate Returned Information: 1 00:25:39.721 Explicit Persistent Connection Support for Discovery: 1 00:25:39.721 Transport Requirements: 00:25:39.721 Secure Channel: Not Required 00:25:39.721 Port ID: 0 (0x0000) 00:25:39.721 Controller ID: 65535 (0xffff) 00:25:39.721 Admin Max SQ Size: 128 00:25:39.721 Transport Service Identifier: 4420 00:25:39.721 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:25:39.721 Transport Address: 10.0.0.2 00:25:39.721 Discovery Log Entry 1 00:25:39.721 ---------------------- 00:25:39.721 Transport Type: 3 (TCP) 00:25:39.721 Address Family: 1 (IPv4) 00:25:39.721 Subsystem Type: 2 (NVM Subsystem) 00:25:39.721 Entry Flags: 00:25:39.721 Duplicate Returned Information: 0 00:25:39.721 Explicit Persistent Connection Support for Discovery: 0 00:25:39.721 Transport Requirements: 00:25:39.721 Secure Channel: Not Required 00:25:39.721 Port ID: 0 (0x0000) 00:25:39.721 Controller ID: 65535 (0xffff) 00:25:39.721 Admin Max SQ Size: 128 00:25:39.721 Transport Service Identifier: 4420 00:25:39.721 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:25:39.721 Transport Address: 10.0.0.2 [2024-04-26 20:42:57.869492] nvme_ctrlr.c:4206:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:25:39.721 [2024-04-26 20:42:57.869505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.721 [2024-04-26 20:42:57.869512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.722 [2024-04-26 20:42:57.869518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.722 [2024-04-26 20:42:57.869524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.722 [2024-04-26 20:42:57.869534] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.869538] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.869542] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20ea9e0) 00:25:39.722 [2024-04-26 20:42:57.869549] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.869563] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152b50, cid 3, qid 0 00:25:39.722 [2024-04-26 20:42:57.869680] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.869688] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.869691] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.869695] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152b50) on tqpair=0x20ea9e0 00:25:39.722 [2024-04-26 20:42:57.869705] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.869709] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.869712] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20ea9e0) 00:25:39.722 [2024-04-26 20:42:57.869719] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.869734] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152b50, cid 3, qid 0 00:25:39.722 [2024-04-26 20:42:57.869887] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.869893] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.869896] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.869900] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152b50) on tqpair=0x20ea9e0 00:25:39.722 [2024-04-26 20:42:57.869906] nvme_ctrlr.c:1069:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:25:39.722 [2024-04-26 20:42:57.869910] nvme_ctrlr.c:1072:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:25:39.722 [2024-04-26 20:42:57.869919] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.869923] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.869927] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20ea9e0) 00:25:39.722 [2024-04-26 20:42:57.869933] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.869944] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152b50, cid 3, qid 0 00:25:39.722 [2024-04-26 20:42:57.870091] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.870097] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.870100] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870104] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152b50) on tqpair=0x20ea9e0 00:25:39.722 [2024-04-26 20:42:57.870115] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870118] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870122] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20ea9e0) 00:25:39.722 [2024-04-26 20:42:57.870128] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.870139] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152b50, cid 3, qid 0 00:25:39.722 [2024-04-26 20:42:57.870249] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.870256] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.870259] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870263] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152b50) on tqpair=0x20ea9e0 00:25:39.722 [2024-04-26 20:42:57.870273] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870283] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870287] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20ea9e0) 00:25:39.722 [2024-04-26 20:42:57.870293] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.870304] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152b50, cid 3, qid 0 00:25:39.722 [2024-04-26 20:42:57.870445] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.870452] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.870458] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870462] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152b50) on tqpair=0x20ea9e0 00:25:39.722 [2024-04-26 20:42:57.870472] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870476] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870479] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20ea9e0) 00:25:39.722 [2024-04-26 20:42:57.870486] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.870496] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152b50, cid 3, qid 0 00:25:39.722 [2024-04-26 20:42:57.870649] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.870656] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.870659] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870663] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152b50) on tqpair=0x20ea9e0 00:25:39.722 [2024-04-26 20:42:57.870673] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870676] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870680] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20ea9e0) 00:25:39.722 [2024-04-26 20:42:57.870686] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.870697] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152b50, cid 3, qid 0 00:25:39.722 [2024-04-26 20:42:57.870854] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.870860] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.870863] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870867] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152b50) on tqpair=0x20ea9e0 00:25:39.722 [2024-04-26 20:42:57.870877] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870881] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.870884] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20ea9e0) 00:25:39.722 [2024-04-26 20:42:57.870891] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.870901] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152b50, cid 3, qid 0 00:25:39.722 [2024-04-26 20:42:57.871012] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.871018] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.871022] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.871025] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152b50) on tqpair=0x20ea9e0 00:25:39.722 [2024-04-26 20:42:57.871035] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.871039] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.871042] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20ea9e0) 00:25:39.722 [2024-04-26 20:42:57.871049] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.871059] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152b50, cid 3, qid 0 00:25:39.722 [2024-04-26 20:42:57.871206] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.871212] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.871215] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.871221] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152b50) on tqpair=0x20ea9e0 00:25:39.722 [2024-04-26 20:42:57.871231] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.871235] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.871239] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20ea9e0) 00:25:39.722 [2024-04-26 20:42:57.871245] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.871256] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152b50, cid 3, qid 0 00:25:39.722 [2024-04-26 20:42:57.875284] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.875293] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.875296] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.875300] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152b50) on tqpair=0x20ea9e0 00:25:39.722 [2024-04-26 20:42:57.875311] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.875314] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.875318] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x20ea9e0) 00:25:39.722 [2024-04-26 20:42:57.875325] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.875336] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2152b50, cid 3, qid 0 00:25:39.722 [2024-04-26 20:42:57.875465] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.875472] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.875476] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.875479] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2152b50) on tqpair=0x20ea9e0 00:25:39.722 [2024-04-26 20:42:57.875487] nvme_ctrlr.c:1191:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 5 milliseconds 00:25:39.722 00:25:39.722 20:42:57 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:25:39.722 [2024-04-26 20:42:57.912102] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:39.722 [2024-04-26 20:42:57.912141] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4177969 ] 00:25:39.722 EAL: No free 2048 kB hugepages reported on node 1 00:25:39.722 [2024-04-26 20:42:57.945808] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:25:39.722 [2024-04-26 20:42:57.945851] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:39.722 [2024-04-26 20:42:57.945856] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:39.722 [2024-04-26 20:42:57.945867] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:39.722 [2024-04-26 20:42:57.945873] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:39.722 [2024-04-26 20:42:57.946418] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:25:39.722 [2024-04-26 20:42:57.946441] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1f6b9e0 0 00:25:39.722 [2024-04-26 20:42:57.957286] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:39.722 [2024-04-26 20:42:57.957300] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:39.722 [2024-04-26 20:42:57.957304] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:39.722 [2024-04-26 20:42:57.957307] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:39.722 [2024-04-26 20:42:57.957341] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.957346] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.957350] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f6b9e0) 00:25:39.722 [2024-04-26 20:42:57.957362] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:39.722 [2024-04-26 20:42:57.957378] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3730, cid 0, qid 0 00:25:39.722 [2024-04-26 20:42:57.968288] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.968298] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.968301] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.968306] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3730) on tqpair=0x1f6b9e0 00:25:39.722 [2024-04-26 20:42:57.968315] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:39.722 [2024-04-26 20:42:57.968321] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:25:39.722 [2024-04-26 20:42:57.968326] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:25:39.722 [2024-04-26 20:42:57.968339] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.968343] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.968346] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f6b9e0) 00:25:39.722 [2024-04-26 20:42:57.968354] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.968367] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3730, cid 0, qid 0 00:25:39.722 [2024-04-26 20:42:57.968570] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.968579] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.968582] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.968586] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3730) on tqpair=0x1f6b9e0 00:25:39.722 [2024-04-26 20:42:57.968595] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:25:39.722 [2024-04-26 20:42:57.968603] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:25:39.722 [2024-04-26 20:42:57.968610] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.968613] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.968617] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f6b9e0) 00:25:39.722 [2024-04-26 20:42:57.968624] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.968636] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3730, cid 0, qid 0 00:25:39.722 [2024-04-26 20:42:57.968865] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.968871] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.968875] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.968879] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3730) on tqpair=0x1f6b9e0 00:25:39.722 [2024-04-26 20:42:57.968887] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:25:39.722 [2024-04-26 20:42:57.968896] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:25:39.722 [2024-04-26 20:42:57.968902] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.968906] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.968909] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f6b9e0) 00:25:39.722 [2024-04-26 20:42:57.968916] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.968927] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3730, cid 0, qid 0 00:25:39.722 [2024-04-26 20:42:57.969142] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.969148] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.969152] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.969155] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3730) on tqpair=0x1f6b9e0 00:25:39.722 [2024-04-26 20:42:57.969161] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:39.722 [2024-04-26 20:42:57.969170] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.969174] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.969177] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f6b9e0) 00:25:39.722 [2024-04-26 20:42:57.969184] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.969194] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3730, cid 0, qid 0 00:25:39.722 [2024-04-26 20:42:57.969398] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.969405] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.969408] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.969412] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3730) on tqpair=0x1f6b9e0 00:25:39.722 [2024-04-26 20:42:57.969417] nvme_ctrlr.c:3736:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:25:39.722 [2024-04-26 20:42:57.969422] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:25:39.722 [2024-04-26 20:42:57.969429] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:39.722 [2024-04-26 20:42:57.969534] nvme_ctrlr.c:3929:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:25:39.722 [2024-04-26 20:42:57.969538] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:39.722 [2024-04-26 20:42:57.969546] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.969550] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.969553] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f6b9e0) 00:25:39.722 [2024-04-26 20:42:57.969560] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.722 [2024-04-26 20:42:57.969571] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3730, cid 0, qid 0 00:25:39.722 [2024-04-26 20:42:57.969807] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.722 [2024-04-26 20:42:57.969814] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.722 [2024-04-26 20:42:57.969819] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.722 [2024-04-26 20:42:57.969823] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3730) on tqpair=0x1f6b9e0 00:25:39.722 [2024-04-26 20:42:57.969829] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:39.722 [2024-04-26 20:42:57.969838] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:57.969842] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:57.969845] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:57.969852] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.723 [2024-04-26 20:42:57.969862] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3730, cid 0, qid 0 00:25:39.723 [2024-04-26 20:42:57.970073] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.723 [2024-04-26 20:42:57.970079] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.723 [2024-04-26 20:42:57.970083] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:57.970086] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3730) on tqpair=0x1f6b9e0 00:25:39.723 [2024-04-26 20:42:57.970092] nvme_ctrlr.c:3771:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:39.723 [2024-04-26 20:42:57.970096] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:57.970104] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:25:39.723 [2024-04-26 20:42:57.970112] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:57.970121] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:57.970125] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:57.970128] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:57.970135] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.723 [2024-04-26 20:42:57.970145] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3730, cid 0, qid 0 00:25:39.723 [2024-04-26 20:42:57.970417] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.723 [2024-04-26 20:42:57.970424] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.723 [2024-04-26 20:42:57.970428] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:57.970432] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f6b9e0): datao=0, datal=4096, cccid=0 00:25:39.723 [2024-04-26 20:42:57.970436] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fd3730) on tqpair(0x1f6b9e0): expected_datao=0, payload_size=4096 00:25:39.723 [2024-04-26 20:42:57.970500] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:57.970504] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016285] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.723 [2024-04-26 20:42:58.016295] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.723 [2024-04-26 20:42:58.016299] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016303] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3730) on tqpair=0x1f6b9e0 00:25:39.723 [2024-04-26 20:42:58.016311] nvme_ctrlr.c:1971:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:25:39.723 [2024-04-26 20:42:58.016319] nvme_ctrlr.c:1975:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:25:39.723 [2024-04-26 20:42:58.016326] nvme_ctrlr.c:1978:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:25:39.723 [2024-04-26 20:42:58.016330] nvme_ctrlr.c:2002:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:25:39.723 [2024-04-26 20:42:58.016334] nvme_ctrlr.c:2017:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:25:39.723 [2024-04-26 20:42:58.016339] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.016347] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.016354] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016358] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016361] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:58.016369] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:39.723 [2024-04-26 20:42:58.016382] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3730, cid 0, qid 0 00:25:39.723 [2024-04-26 20:42:58.016596] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.723 [2024-04-26 20:42:58.016602] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.723 [2024-04-26 20:42:58.016606] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016610] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3730) on tqpair=0x1f6b9e0 00:25:39.723 [2024-04-26 20:42:58.016617] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016621] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016625] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:58.016631] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.723 [2024-04-26 20:42:58.016637] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016641] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016644] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:58.016650] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.723 [2024-04-26 20:42:58.016655] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016659] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016662] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:58.016668] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.723 [2024-04-26 20:42:58.016673] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016677] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016680] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:58.016686] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.723 [2024-04-26 20:42:58.016691] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.016702] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.016708] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016713] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.016717] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:58.016724] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.723 [2024-04-26 20:42:58.016736] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3730, cid 0, qid 0 00:25:39.723 [2024-04-26 20:42:58.016741] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3890, cid 1, qid 0 00:25:39.723 [2024-04-26 20:42:58.016746] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd39f0, cid 2, qid 0 00:25:39.723 [2024-04-26 20:42:58.016751] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3b50, cid 3, qid 0 00:25:39.723 [2024-04-26 20:42:58.016755] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3cb0, cid 4, qid 0 00:25:39.723 [2024-04-26 20:42:58.016986] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.723 [2024-04-26 20:42:58.016992] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.723 [2024-04-26 20:42:58.016996] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.017000] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3cb0) on tqpair=0x1f6b9e0 00:25:39.723 [2024-04-26 20:42:58.017005] nvme_ctrlr.c:2889:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:25:39.723 [2024-04-26 20:42:58.017010] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.017018] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.017023] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.017029] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.017033] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.017037] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:58.017043] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:39.723 [2024-04-26 20:42:58.017053] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3cb0, cid 4, qid 0 00:25:39.723 [2024-04-26 20:42:58.021292] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.723 [2024-04-26 20:42:58.021310] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.723 [2024-04-26 20:42:58.021314] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.021318] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3cb0) on tqpair=0x1f6b9e0 00:25:39.723 [2024-04-26 20:42:58.021371] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.021382] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.021389] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.021393] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.021396] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:58.021403] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.723 [2024-04-26 20:42:58.021416] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3cb0, cid 4, qid 0 00:25:39.723 [2024-04-26 20:42:58.021622] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.723 [2024-04-26 20:42:58.021630] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.723 [2024-04-26 20:42:58.021633] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.021637] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f6b9e0): datao=0, datal=4096, cccid=4 00:25:39.723 [2024-04-26 20:42:58.021641] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fd3cb0) on tqpair(0x1f6b9e0): expected_datao=0, payload_size=4096 00:25:39.723 [2024-04-26 20:42:58.021649] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.021652] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.021848] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.723 [2024-04-26 20:42:58.021855] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.723 [2024-04-26 20:42:58.021858] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.021862] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3cb0) on tqpair=0x1f6b9e0 00:25:39.723 [2024-04-26 20:42:58.021871] nvme_ctrlr.c:4542:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:25:39.723 [2024-04-26 20:42:58.021888] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.021897] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.021904] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.021907] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.021911] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:58.021917] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.723 [2024-04-26 20:42:58.021929] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3cb0, cid 4, qid 0 00:25:39.723 [2024-04-26 20:42:58.022171] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.723 [2024-04-26 20:42:58.022177] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.723 [2024-04-26 20:42:58.022181] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022184] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f6b9e0): datao=0, datal=4096, cccid=4 00:25:39.723 [2024-04-26 20:42:58.022189] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fd3cb0) on tqpair(0x1f6b9e0): expected_datao=0, payload_size=4096 00:25:39.723 [2024-04-26 20:42:58.022196] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022199] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022374] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.723 [2024-04-26 20:42:58.022381] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.723 [2024-04-26 20:42:58.022384] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022388] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3cb0) on tqpair=0x1f6b9e0 00:25:39.723 [2024-04-26 20:42:58.022402] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.022411] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.022419] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022422] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022426] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:58.022434] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.723 [2024-04-26 20:42:58.022446] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3cb0, cid 4, qid 0 00:25:39.723 [2024-04-26 20:42:58.022673] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.723 [2024-04-26 20:42:58.022680] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.723 [2024-04-26 20:42:58.022683] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022687] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f6b9e0): datao=0, datal=4096, cccid=4 00:25:39.723 [2024-04-26 20:42:58.022691] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fd3cb0) on tqpair(0x1f6b9e0): expected_datao=0, payload_size=4096 00:25:39.723 [2024-04-26 20:42:58.022698] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022702] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022881] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.723 [2024-04-26 20:42:58.022887] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.723 [2024-04-26 20:42:58.022890] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022894] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3cb0) on tqpair=0x1f6b9e0 00:25:39.723 [2024-04-26 20:42:58.022902] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.022910] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.022919] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.022925] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.022930] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.022935] nvme_ctrlr.c:2977:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:25:39.723 [2024-04-26 20:42:58.022939] nvme_ctrlr.c:1471:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:25:39.723 [2024-04-26 20:42:58.022944] nvme_ctrlr.c:1477:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:25:39.723 [2024-04-26 20:42:58.022958] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022962] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022966] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:58.022972] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.723 [2024-04-26 20:42:58.022979] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022982] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.022986] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1f6b9e0) 00:25:39.723 [2024-04-26 20:42:58.022992] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:39.723 [2024-04-26 20:42:58.023005] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3cb0, cid 4, qid 0 00:25:39.723 [2024-04-26 20:42:58.023010] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3e10, cid 5, qid 0 00:25:39.723 [2024-04-26 20:42:58.023253] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.723 [2024-04-26 20:42:58.023261] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.723 [2024-04-26 20:42:58.023265] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.723 [2024-04-26 20:42:58.023269] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3cb0) on tqpair=0x1f6b9e0 00:25:39.723 [2024-04-26 20:42:58.023282] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.724 [2024-04-26 20:42:58.023288] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.724 [2024-04-26 20:42:58.023292] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.023295] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3e10) on tqpair=0x1f6b9e0 00:25:39.724 [2024-04-26 20:42:58.023305] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.023309] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.023313] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1f6b9e0) 00:25:39.724 [2024-04-26 20:42:58.023319] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.724 [2024-04-26 20:42:58.023329] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3e10, cid 5, qid 0 00:25:39.724 [2024-04-26 20:42:58.023538] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.724 [2024-04-26 20:42:58.023544] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.724 [2024-04-26 20:42:58.023548] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.023551] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3e10) on tqpair=0x1f6b9e0 00:25:39.724 [2024-04-26 20:42:58.023561] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.023565] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.023568] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1f6b9e0) 00:25:39.724 [2024-04-26 20:42:58.023574] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.724 [2024-04-26 20:42:58.023584] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3e10, cid 5, qid 0 00:25:39.724 [2024-04-26 20:42:58.023814] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.724 [2024-04-26 20:42:58.023821] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.724 [2024-04-26 20:42:58.023824] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.023828] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3e10) on tqpair=0x1f6b9e0 00:25:39.724 [2024-04-26 20:42:58.023838] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.023842] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.023845] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1f6b9e0) 00:25:39.724 [2024-04-26 20:42:58.023852] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.724 [2024-04-26 20:42:58.023861] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3e10, cid 5, qid 0 00:25:39.724 [2024-04-26 20:42:58.024204] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.724 [2024-04-26 20:42:58.024210] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.724 [2024-04-26 20:42:58.024213] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024217] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3e10) on tqpair=0x1f6b9e0 00:25:39.724 [2024-04-26 20:42:58.024229] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024233] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024237] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1f6b9e0) 00:25:39.724 [2024-04-26 20:42:58.024246] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.724 [2024-04-26 20:42:58.024253] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024256] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024260] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1f6b9e0) 00:25:39.724 [2024-04-26 20:42:58.024266] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.724 [2024-04-26 20:42:58.024273] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024280] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024284] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x1f6b9e0) 00:25:39.724 [2024-04-26 20:42:58.024290] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.724 [2024-04-26 20:42:58.024297] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024301] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024304] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1f6b9e0) 00:25:39.724 [2024-04-26 20:42:58.024310] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.724 [2024-04-26 20:42:58.024321] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3e10, cid 5, qid 0 00:25:39.724 [2024-04-26 20:42:58.024326] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3cb0, cid 4, qid 0 00:25:39.724 [2024-04-26 20:42:58.024331] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3f70, cid 6, qid 0 00:25:39.724 [2024-04-26 20:42:58.024335] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd40d0, cid 7, qid 0 00:25:39.724 [2024-04-26 20:42:58.024657] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.724 [2024-04-26 20:42:58.024665] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.724 [2024-04-26 20:42:58.024668] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024672] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f6b9e0): datao=0, datal=8192, cccid=5 00:25:39.724 [2024-04-26 20:42:58.024676] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fd3e10) on tqpair(0x1f6b9e0): expected_datao=0, payload_size=8192 00:25:39.724 [2024-04-26 20:42:58.024744] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024748] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024754] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.724 [2024-04-26 20:42:58.024760] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.724 [2024-04-26 20:42:58.024763] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024766] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f6b9e0): datao=0, datal=512, cccid=4 00:25:39.724 [2024-04-26 20:42:58.024771] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fd3cb0) on tqpair(0x1f6b9e0): expected_datao=0, payload_size=512 00:25:39.724 [2024-04-26 20:42:58.024778] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024781] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024787] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.724 [2024-04-26 20:42:58.024793] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.724 [2024-04-26 20:42:58.024796] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024799] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f6b9e0): datao=0, datal=512, cccid=6 00:25:39.724 [2024-04-26 20:42:58.024806] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fd3f70) on tqpair(0x1f6b9e0): expected_datao=0, payload_size=512 00:25:39.724 [2024-04-26 20:42:58.024813] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024817] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024822] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:39.724 [2024-04-26 20:42:58.024828] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:39.724 [2024-04-26 20:42:58.024831] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024835] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1f6b9e0): datao=0, datal=4096, cccid=7 00:25:39.724 [2024-04-26 20:42:58.024839] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1fd40d0) on tqpair(0x1f6b9e0): expected_datao=0, payload_size=4096 00:25:39.724 [2024-04-26 20:42:58.024846] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024850] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.024988] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.724 [2024-04-26 20:42:58.024994] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.724 [2024-04-26 20:42:58.024997] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.025001] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3e10) on tqpair=0x1f6b9e0 00:25:39.724 [2024-04-26 20:42:58.025015] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.724 [2024-04-26 20:42:58.025021] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.724 [2024-04-26 20:42:58.025024] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.025028] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3cb0) on tqpair=0x1f6b9e0 00:25:39.724 [2024-04-26 20:42:58.025037] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.724 [2024-04-26 20:42:58.025043] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.724 [2024-04-26 20:42:58.025046] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.025050] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3f70) on tqpair=0x1f6b9e0 00:25:39.724 [2024-04-26 20:42:58.025058] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.724 [2024-04-26 20:42:58.025063] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.724 [2024-04-26 20:42:58.025067] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.724 [2024-04-26 20:42:58.025070] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd40d0) on tqpair=0x1f6b9e0 00:25:39.724 ===================================================== 00:25:39.724 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:39.724 ===================================================== 00:25:39.724 Controller Capabilities/Features 00:25:39.724 ================================ 00:25:39.724 Vendor ID: 8086 00:25:39.724 Subsystem Vendor ID: 8086 00:25:39.724 Serial Number: SPDK00000000000001 00:25:39.724 Model Number: SPDK bdev Controller 00:25:39.724 Firmware Version: 24.01.1 00:25:39.724 Recommended Arb Burst: 6 00:25:39.724 IEEE OUI Identifier: e4 d2 5c 00:25:39.724 Multi-path I/O 00:25:39.724 May have multiple subsystem ports: Yes 00:25:39.724 May have multiple controllers: Yes 00:25:39.724 Associated with SR-IOV VF: No 00:25:39.724 Max Data Transfer Size: 131072 00:25:39.724 Max Number of Namespaces: 32 00:25:39.724 Max Number of I/O Queues: 127 00:25:39.724 NVMe Specification Version (VS): 1.3 00:25:39.724 NVMe Specification Version (Identify): 1.3 00:25:39.724 Maximum Queue Entries: 128 00:25:39.724 Contiguous Queues Required: Yes 00:25:39.724 Arbitration Mechanisms Supported 00:25:39.724 Weighted Round Robin: Not Supported 00:25:39.724 Vendor Specific: Not Supported 00:25:39.724 Reset Timeout: 15000 ms 00:25:39.724 Doorbell Stride: 4 bytes 00:25:39.724 NVM Subsystem Reset: Not Supported 00:25:39.724 Command Sets Supported 00:25:39.724 NVM Command Set: Supported 00:25:39.724 Boot Partition: Not Supported 00:25:39.724 Memory Page Size Minimum: 4096 bytes 00:25:39.724 Memory Page Size Maximum: 4096 bytes 00:25:39.724 Persistent Memory Region: Not Supported 00:25:39.724 Optional Asynchronous Events Supported 00:25:39.724 Namespace Attribute Notices: Supported 00:25:39.724 Firmware Activation Notices: Not Supported 00:25:39.724 ANA Change Notices: Not Supported 00:25:39.724 PLE Aggregate Log Change Notices: Not Supported 00:25:39.724 LBA Status Info Alert Notices: Not Supported 00:25:39.724 EGE Aggregate Log Change Notices: Not Supported 00:25:39.724 Normal NVM Subsystem Shutdown event: Not Supported 00:25:39.724 Zone Descriptor Change Notices: Not Supported 00:25:39.724 Discovery Log Change Notices: Not Supported 00:25:39.724 Controller Attributes 00:25:39.724 128-bit Host Identifier: Supported 00:25:39.724 Non-Operational Permissive Mode: Not Supported 00:25:39.724 NVM Sets: Not Supported 00:25:39.724 Read Recovery Levels: Not Supported 00:25:39.724 Endurance Groups: Not Supported 00:25:39.724 Predictable Latency Mode: Not Supported 00:25:39.724 Traffic Based Keep ALive: Not Supported 00:25:39.724 Namespace Granularity: Not Supported 00:25:39.724 SQ Associations: Not Supported 00:25:39.724 UUID List: Not Supported 00:25:39.724 Multi-Domain Subsystem: Not Supported 00:25:39.724 Fixed Capacity Management: Not Supported 00:25:39.724 Variable Capacity Management: Not Supported 00:25:39.724 Delete Endurance Group: Not Supported 00:25:39.724 Delete NVM Set: Not Supported 00:25:39.724 Extended LBA Formats Supported: Not Supported 00:25:39.724 Flexible Data Placement Supported: Not Supported 00:25:39.724 00:25:39.724 Controller Memory Buffer Support 00:25:39.724 ================================ 00:25:39.724 Supported: No 00:25:39.724 00:25:39.724 Persistent Memory Region Support 00:25:39.724 ================================ 00:25:39.724 Supported: No 00:25:39.724 00:25:39.724 Admin Command Set Attributes 00:25:39.724 ============================ 00:25:39.724 Security Send/Receive: Not Supported 00:25:39.724 Format NVM: Not Supported 00:25:39.724 Firmware Activate/Download: Not Supported 00:25:39.724 Namespace Management: Not Supported 00:25:39.724 Device Self-Test: Not Supported 00:25:39.724 Directives: Not Supported 00:25:39.724 NVMe-MI: Not Supported 00:25:39.724 Virtualization Management: Not Supported 00:25:39.724 Doorbell Buffer Config: Not Supported 00:25:39.724 Get LBA Status Capability: Not Supported 00:25:39.724 Command & Feature Lockdown Capability: Not Supported 00:25:39.724 Abort Command Limit: 4 00:25:39.724 Async Event Request Limit: 4 00:25:39.724 Number of Firmware Slots: N/A 00:25:39.724 Firmware Slot 1 Read-Only: N/A 00:25:39.724 Firmware Activation Without Reset: N/A 00:25:39.724 Multiple Update Detection Support: N/A 00:25:39.724 Firmware Update Granularity: No Information Provided 00:25:39.724 Per-Namespace SMART Log: No 00:25:39.724 Asymmetric Namespace Access Log Page: Not Supported 00:25:39.724 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:25:39.724 Command Effects Log Page: Supported 00:25:39.724 Get Log Page Extended Data: Supported 00:25:39.724 Telemetry Log Pages: Not Supported 00:25:39.724 Persistent Event Log Pages: Not Supported 00:25:39.724 Supported Log Pages Log Page: May Support 00:25:39.724 Commands Supported & Effects Log Page: Not Supported 00:25:39.724 Feature Identifiers & Effects Log Page:May Support 00:25:39.724 NVMe-MI Commands & Effects Log Page: May Support 00:25:39.724 Data Area 4 for Telemetry Log: Not Supported 00:25:39.724 Error Log Page Entries Supported: 128 00:25:39.724 Keep Alive: Supported 00:25:39.724 Keep Alive Granularity: 10000 ms 00:25:39.724 00:25:39.724 NVM Command Set Attributes 00:25:39.724 ========================== 00:25:39.724 Submission Queue Entry Size 00:25:39.724 Max: 64 00:25:39.724 Min: 64 00:25:39.724 Completion Queue Entry Size 00:25:39.724 Max: 16 00:25:39.724 Min: 16 00:25:39.724 Number of Namespaces: 32 00:25:39.724 Compare Command: Supported 00:25:39.724 Write Uncorrectable Command: Not Supported 00:25:39.724 Dataset Management Command: Supported 00:25:39.724 Write Zeroes Command: Supported 00:25:39.724 Set Features Save Field: Not Supported 00:25:39.724 Reservations: Supported 00:25:39.724 Timestamp: Not Supported 00:25:39.724 Copy: Supported 00:25:39.724 Volatile Write Cache: Present 00:25:39.724 Atomic Write Unit (Normal): 1 00:25:39.724 Atomic Write Unit (PFail): 1 00:25:39.724 Atomic Compare & Write Unit: 1 00:25:39.724 Fused Compare & Write: Supported 00:25:39.724 Scatter-Gather List 00:25:39.724 SGL Command Set: Supported 00:25:39.724 SGL Keyed: Supported 00:25:39.724 SGL Bit Bucket Descriptor: Not Supported 00:25:39.724 SGL Metadata Pointer: Not Supported 00:25:39.724 Oversized SGL: Not Supported 00:25:39.724 SGL Metadata Address: Not Supported 00:25:39.724 SGL Offset: Supported 00:25:39.724 Transport SGL Data Block: Not Supported 00:25:39.724 Replay Protected Memory Block: Not Supported 00:25:39.724 00:25:39.724 Firmware Slot Information 00:25:39.724 ========================= 00:25:39.724 Active slot: 1 00:25:39.724 Slot 1 Firmware Revision: 24.01.1 00:25:39.724 00:25:39.724 00:25:39.724 Commands Supported and Effects 00:25:39.724 ============================== 00:25:39.724 Admin Commands 00:25:39.724 -------------- 00:25:39.724 Get Log Page (02h): Supported 00:25:39.724 Identify (06h): Supported 00:25:39.724 Abort (08h): Supported 00:25:39.724 Set Features (09h): Supported 00:25:39.724 Get Features (0Ah): Supported 00:25:39.724 Asynchronous Event Request (0Ch): Supported 00:25:39.724 Keep Alive (18h): Supported 00:25:39.724 I/O Commands 00:25:39.724 ------------ 00:25:39.724 Flush (00h): Supported LBA-Change 00:25:39.724 Write (01h): Supported LBA-Change 00:25:39.724 Read (02h): Supported 00:25:39.724 Compare (05h): Supported 00:25:39.724 Write Zeroes (08h): Supported LBA-Change 00:25:39.724 Dataset Management (09h): Supported LBA-Change 00:25:39.724 Copy (19h): Supported LBA-Change 00:25:39.724 Unknown (79h): Supported LBA-Change 00:25:39.724 Unknown (7Ah): Supported 00:25:39.724 00:25:39.724 Error Log 00:25:39.724 ========= 00:25:39.724 00:25:39.724 Arbitration 00:25:39.724 =========== 00:25:39.724 Arbitration Burst: 1 00:25:39.724 00:25:39.724 Power Management 00:25:39.724 ================ 00:25:39.724 Number of Power States: 1 00:25:39.724 Current Power State: Power State #0 00:25:39.724 Power State #0: 00:25:39.724 Max Power: 0.00 W 00:25:39.724 Non-Operational State: Operational 00:25:39.724 Entry Latency: Not Reported 00:25:39.724 Exit Latency: Not Reported 00:25:39.724 Relative Read Throughput: 0 00:25:39.724 Relative Read Latency: 0 00:25:39.724 Relative Write Throughput: 0 00:25:39.724 Relative Write Latency: 0 00:25:39.724 Idle Power: Not Reported 00:25:39.724 Active Power: Not Reported 00:25:39.724 Non-Operational Permissive Mode: Not Supported 00:25:39.724 00:25:39.724 Health Information 00:25:39.724 ================== 00:25:39.724 Critical Warnings: 00:25:39.724 Available Spare Space: OK 00:25:39.724 Temperature: OK 00:25:39.724 Device Reliability: OK 00:25:39.724 Read Only: No 00:25:39.724 Volatile Memory Backup: OK 00:25:39.724 Current Temperature: 0 Kelvin (-273 Celsius) 00:25:39.724 Temperature Threshold: [2024-04-26 20:42:58.025173] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.025179] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.025183] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1f6b9e0) 00:25:39.725 [2024-04-26 20:42:58.025189] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.725 [2024-04-26 20:42:58.025202] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd40d0, cid 7, qid 0 00:25:39.725 [2024-04-26 20:42:58.025435] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.725 [2024-04-26 20:42:58.025443] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.725 [2024-04-26 20:42:58.025446] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.025450] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd40d0) on tqpair=0x1f6b9e0 00:25:39.725 [2024-04-26 20:42:58.025482] nvme_ctrlr.c:4206:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:25:39.725 [2024-04-26 20:42:58.025494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.725 [2024-04-26 20:42:58.025502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.725 [2024-04-26 20:42:58.025509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.725 [2024-04-26 20:42:58.025514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:39.725 [2024-04-26 20:42:58.025522] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.025526] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.025529] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f6b9e0) 00:25:39.725 [2024-04-26 20:42:58.025536] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.725 [2024-04-26 20:42:58.025549] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3b50, cid 3, qid 0 00:25:39.725 [2024-04-26 20:42:58.025764] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.725 [2024-04-26 20:42:58.025771] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.725 [2024-04-26 20:42:58.025774] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.025778] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3b50) on tqpair=0x1f6b9e0 00:25:39.725 [2024-04-26 20:42:58.025785] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.025789] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.025792] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f6b9e0) 00:25:39.725 [2024-04-26 20:42:58.025799] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.725 [2024-04-26 20:42:58.025813] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3b50, cid 3, qid 0 00:25:39.725 [2024-04-26 20:42:58.026052] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.725 [2024-04-26 20:42:58.026058] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.725 [2024-04-26 20:42:58.026062] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.026065] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3b50) on tqpair=0x1f6b9e0 00:25:39.725 [2024-04-26 20:42:58.026071] nvme_ctrlr.c:1069:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:25:39.725 [2024-04-26 20:42:58.026075] nvme_ctrlr.c:1072:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:25:39.725 [2024-04-26 20:42:58.026084] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.026088] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.026092] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f6b9e0) 00:25:39.725 [2024-04-26 20:42:58.026098] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.725 [2024-04-26 20:42:58.026108] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3b50, cid 3, qid 0 00:25:39.725 [2024-04-26 20:42:58.026348] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.725 [2024-04-26 20:42:58.026355] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.725 [2024-04-26 20:42:58.026359] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.026362] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3b50) on tqpair=0x1f6b9e0 00:25:39.725 [2024-04-26 20:42:58.026373] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.026377] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.026380] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f6b9e0) 00:25:39.725 [2024-04-26 20:42:58.026390] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.725 [2024-04-26 20:42:58.026401] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3b50, cid 3, qid 0 00:25:39.725 [2024-04-26 20:42:58.026637] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.725 [2024-04-26 20:42:58.026643] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.725 [2024-04-26 20:42:58.026647] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.026650] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3b50) on tqpair=0x1f6b9e0 00:25:39.725 [2024-04-26 20:42:58.026660] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.026664] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.026668] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f6b9e0) 00:25:39.725 [2024-04-26 20:42:58.026674] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.725 [2024-04-26 20:42:58.026684] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3b50, cid 3, qid 0 00:25:39.725 [2024-04-26 20:42:58.026914] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.725 [2024-04-26 20:42:58.026920] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.725 [2024-04-26 20:42:58.026923] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.026927] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3b50) on tqpair=0x1f6b9e0 00:25:39.725 [2024-04-26 20:42:58.026937] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.026941] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.026944] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f6b9e0) 00:25:39.725 [2024-04-26 20:42:58.026951] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.725 [2024-04-26 20:42:58.026961] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3b50, cid 3, qid 0 00:25:39.725 [2024-04-26 20:42:58.027200] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.725 [2024-04-26 20:42:58.027206] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.725 [2024-04-26 20:42:58.027210] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.027213] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3b50) on tqpair=0x1f6b9e0 00:25:39.725 [2024-04-26 20:42:58.027223] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.027227] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.027231] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1f6b9e0) 00:25:39.725 [2024-04-26 20:42:58.027237] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:39.725 [2024-04-26 20:42:58.027247] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1fd3b50, cid 3, qid 0 00:25:39.725 [2024-04-26 20:42:58.031283] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:39.725 [2024-04-26 20:42:58.031292] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:39.725 [2024-04-26 20:42:58.031295] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:39.725 [2024-04-26 20:42:58.031299] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1fd3b50) on tqpair=0x1f6b9e0 00:25:39.725 [2024-04-26 20:42:58.031307] nvme_ctrlr.c:1191:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:25:39.725 0 Kelvin (-273 Celsius) 00:25:39.725 Available Spare: 0% 00:25:39.725 Available Spare Threshold: 0% 00:25:39.725 Life Percentage Used: 0% 00:25:39.725 Data Units Read: 0 00:25:39.725 Data Units Written: 0 00:25:39.725 Host Read Commands: 0 00:25:39.725 Host Write Commands: 0 00:25:39.725 Controller Busy Time: 0 minutes 00:25:39.725 Power Cycles: 0 00:25:39.725 Power On Hours: 0 hours 00:25:39.725 Unsafe Shutdowns: 0 00:25:39.725 Unrecoverable Media Errors: 0 00:25:39.725 Lifetime Error Log Entries: 0 00:25:39.725 Warning Temperature Time: 0 minutes 00:25:39.725 Critical Temperature Time: 0 minutes 00:25:39.725 00:25:39.725 Number of Queues 00:25:39.725 ================ 00:25:39.725 Number of I/O Submission Queues: 127 00:25:39.725 Number of I/O Completion Queues: 127 00:25:39.725 00:25:39.725 Active Namespaces 00:25:39.725 ================= 00:25:39.725 Namespace ID:1 00:25:39.725 Error Recovery Timeout: Unlimited 00:25:39.725 Command Set Identifier: NVM (00h) 00:25:39.725 Deallocate: Supported 00:25:39.725 Deallocated/Unwritten Error: Not Supported 00:25:39.725 Deallocated Read Value: Unknown 00:25:39.725 Deallocate in Write Zeroes: Not Supported 00:25:39.725 Deallocated Guard Field: 0xFFFF 00:25:39.725 Flush: Supported 00:25:39.725 Reservation: Supported 00:25:39.725 Namespace Sharing Capabilities: Multiple Controllers 00:25:39.725 Size (in LBAs): 131072 (0GiB) 00:25:39.725 Capacity (in LBAs): 131072 (0GiB) 00:25:39.725 Utilization (in LBAs): 131072 (0GiB) 00:25:39.725 NGUID: ABCDEF0123456789ABCDEF0123456789 00:25:39.725 EUI64: ABCDEF0123456789 00:25:39.725 UUID: 6d99fb22-b4e4-4632-a7d6-67c172d64d5f 00:25:39.725 Thin Provisioning: Not Supported 00:25:39.725 Per-NS Atomic Units: Yes 00:25:39.725 Atomic Boundary Size (Normal): 0 00:25:39.725 Atomic Boundary Size (PFail): 0 00:25:39.725 Atomic Boundary Offset: 0 00:25:39.725 Maximum Single Source Range Length: 65535 00:25:39.725 Maximum Copy Length: 65535 00:25:39.725 Maximum Source Range Count: 1 00:25:39.725 NGUID/EUI64 Never Reused: No 00:25:39.725 Namespace Write Protected: No 00:25:39.725 Number of LBA Formats: 1 00:25:39.725 Current LBA Format: LBA Format #00 00:25:39.725 LBA Format #00: Data Size: 512 Metadata Size: 0 00:25:39.725 00:25:39.725 20:42:58 -- host/identify.sh@51 -- # sync 00:25:39.725 20:42:58 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:39.725 20:42:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.725 20:42:58 -- common/autotest_common.sh@10 -- # set +x 00:25:39.725 20:42:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.725 20:42:58 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:25:39.725 20:42:58 -- host/identify.sh@56 -- # nvmftestfini 00:25:39.725 20:42:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:39.725 20:42:58 -- nvmf/common.sh@116 -- # sync 00:25:39.987 20:42:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:39.987 20:42:58 -- nvmf/common.sh@119 -- # set +e 00:25:39.987 20:42:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:39.987 20:42:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:39.987 rmmod nvme_tcp 00:25:39.987 rmmod nvme_fabrics 00:25:39.987 rmmod nvme_keyring 00:25:39.987 20:42:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:39.987 20:42:58 -- nvmf/common.sh@123 -- # set -e 00:25:39.987 20:42:58 -- nvmf/common.sh@124 -- # return 0 00:25:39.987 20:42:58 -- nvmf/common.sh@477 -- # '[' -n 4177614 ']' 00:25:39.987 20:42:58 -- nvmf/common.sh@478 -- # killprocess 4177614 00:25:39.987 20:42:58 -- common/autotest_common.sh@926 -- # '[' -z 4177614 ']' 00:25:39.987 20:42:58 -- common/autotest_common.sh@930 -- # kill -0 4177614 00:25:39.987 20:42:58 -- common/autotest_common.sh@931 -- # uname 00:25:39.987 20:42:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:39.987 20:42:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4177614 00:25:39.987 20:42:58 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:39.987 20:42:58 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:39.987 20:42:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4177614' 00:25:39.987 killing process with pid 4177614 00:25:39.987 20:42:58 -- common/autotest_common.sh@945 -- # kill 4177614 00:25:39.987 [2024-04-26 20:42:58.187622] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:39.987 20:42:58 -- common/autotest_common.sh@950 -- # wait 4177614 00:25:39.987 20:42:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:39.987 20:42:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:40.248 20:42:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:40.248 20:42:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:40.248 20:42:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:40.248 20:42:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:40.248 20:42:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:40.248 20:42:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:42.163 20:43:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:42.163 00:25:42.163 real 0m10.883s 00:25:42.163 user 0m7.844s 00:25:42.163 sys 0m5.594s 00:25:42.163 20:43:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:42.163 20:43:00 -- common/autotest_common.sh@10 -- # set +x 00:25:42.163 ************************************ 00:25:42.163 END TEST nvmf_identify 00:25:42.163 ************************************ 00:25:42.163 20:43:00 -- nvmf/nvmf.sh@97 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:42.163 20:43:00 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:42.163 20:43:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:42.163 20:43:00 -- common/autotest_common.sh@10 -- # set +x 00:25:42.163 ************************************ 00:25:42.163 START TEST nvmf_perf 00:25:42.163 ************************************ 00:25:42.163 20:43:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:42.425 * Looking for test storage... 00:25:42.425 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:42.425 20:43:00 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:42.425 20:43:00 -- nvmf/common.sh@7 -- # uname -s 00:25:42.425 20:43:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:42.425 20:43:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:42.425 20:43:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:42.425 20:43:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:42.425 20:43:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:42.425 20:43:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:42.425 20:43:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:42.425 20:43:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:42.425 20:43:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:42.425 20:43:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:42.425 20:43:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:42.425 20:43:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:42.425 20:43:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:42.425 20:43:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:42.425 20:43:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:42.425 20:43:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:42.425 20:43:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:42.425 20:43:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:42.425 20:43:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:42.425 20:43:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:42.425 20:43:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:42.425 20:43:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:42.425 20:43:00 -- paths/export.sh@5 -- # export PATH 00:25:42.425 20:43:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:42.425 20:43:00 -- nvmf/common.sh@46 -- # : 0 00:25:42.425 20:43:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:42.425 20:43:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:42.425 20:43:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:42.425 20:43:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:42.425 20:43:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:42.426 20:43:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:42.426 20:43:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:42.426 20:43:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:42.426 20:43:00 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:25:42.426 20:43:00 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:25:42.426 20:43:00 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:42.426 20:43:00 -- host/perf.sh@17 -- # nvmftestinit 00:25:42.426 20:43:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:42.426 20:43:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:42.426 20:43:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:42.426 20:43:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:42.426 20:43:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:42.426 20:43:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:42.426 20:43:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:42.426 20:43:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:42.426 20:43:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:42.426 20:43:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:42.426 20:43:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:42.426 20:43:00 -- common/autotest_common.sh@10 -- # set +x 00:25:50.569 20:43:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:50.569 20:43:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:50.569 20:43:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:50.569 20:43:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:50.569 20:43:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:50.569 20:43:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:50.569 20:43:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:50.569 20:43:07 -- nvmf/common.sh@294 -- # net_devs=() 00:25:50.569 20:43:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:50.569 20:43:07 -- nvmf/common.sh@295 -- # e810=() 00:25:50.569 20:43:07 -- nvmf/common.sh@295 -- # local -ga e810 00:25:50.569 20:43:07 -- nvmf/common.sh@296 -- # x722=() 00:25:50.569 20:43:07 -- nvmf/common.sh@296 -- # local -ga x722 00:25:50.569 20:43:07 -- nvmf/common.sh@297 -- # mlx=() 00:25:50.569 20:43:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:50.569 20:43:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:50.569 20:43:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:50.569 20:43:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:50.569 20:43:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:50.569 20:43:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:50.569 20:43:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:50.569 20:43:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:50.569 20:43:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:50.569 20:43:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:50.570 20:43:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:50.570 20:43:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:50.570 20:43:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:50.570 20:43:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:50.570 20:43:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:50.570 20:43:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:50.570 20:43:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:25:50.570 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:25:50.570 20:43:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:50.570 20:43:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:25:50.570 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:25:50.570 20:43:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:50.570 20:43:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:50.570 20:43:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:50.570 20:43:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:50.570 20:43:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:50.570 20:43:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:25:50.570 Found net devices under 0000:4b:00.0: cvl_0_0 00:25:50.570 20:43:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:50.570 20:43:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:50.570 20:43:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:50.570 20:43:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:50.570 20:43:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:50.570 20:43:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:25:50.570 Found net devices under 0000:4b:00.1: cvl_0_1 00:25:50.570 20:43:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:50.570 20:43:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:50.570 20:43:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:50.570 20:43:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:50.570 20:43:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:50.570 20:43:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:50.570 20:43:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:50.570 20:43:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:50.570 20:43:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:50.570 20:43:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:50.570 20:43:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:50.570 20:43:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:50.570 20:43:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:50.570 20:43:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:50.570 20:43:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:50.570 20:43:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:50.570 20:43:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:50.570 20:43:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:50.570 20:43:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:50.570 20:43:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:50.570 20:43:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:50.570 20:43:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:50.570 20:43:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:50.570 20:43:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:50.570 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:50.570 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.744 ms 00:25:50.570 00:25:50.570 --- 10.0.0.2 ping statistics --- 00:25:50.570 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:50.570 rtt min/avg/max/mdev = 0.744/0.744/0.744/0.000 ms 00:25:50.570 20:43:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:50.570 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:50.570 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.407 ms 00:25:50.570 00:25:50.570 --- 10.0.0.1 ping statistics --- 00:25:50.570 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:50.570 rtt min/avg/max/mdev = 0.407/0.407/0.407/0.000 ms 00:25:50.570 20:43:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:50.570 20:43:07 -- nvmf/common.sh@410 -- # return 0 00:25:50.570 20:43:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:50.570 20:43:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:50.570 20:43:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:50.570 20:43:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:50.570 20:43:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:50.570 20:43:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:50.570 20:43:07 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:25:50.570 20:43:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:50.570 20:43:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:50.570 20:43:07 -- common/autotest_common.sh@10 -- # set +x 00:25:50.570 20:43:07 -- nvmf/common.sh@469 -- # nvmfpid=4182177 00:25:50.570 20:43:07 -- nvmf/common.sh@470 -- # waitforlisten 4182177 00:25:50.570 20:43:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:50.570 20:43:07 -- common/autotest_common.sh@819 -- # '[' -z 4182177 ']' 00:25:50.570 20:43:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:50.570 20:43:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:50.570 20:43:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:50.570 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:50.570 20:43:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:50.570 20:43:07 -- common/autotest_common.sh@10 -- # set +x 00:25:50.570 [2024-04-26 20:43:07.960482] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:25:50.570 [2024-04-26 20:43:07.960548] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:50.570 EAL: No free 2048 kB hugepages reported on node 1 00:25:50.570 [2024-04-26 20:43:08.030814] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:50.570 [2024-04-26 20:43:08.104766] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:50.570 [2024-04-26 20:43:08.104900] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:50.570 [2024-04-26 20:43:08.104910] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:50.570 [2024-04-26 20:43:08.104919] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:50.570 [2024-04-26 20:43:08.105059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:50.570 [2024-04-26 20:43:08.105177] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:50.570 [2024-04-26 20:43:08.105305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:50.570 [2024-04-26 20:43:08.105309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:50.570 20:43:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:50.570 20:43:08 -- common/autotest_common.sh@852 -- # return 0 00:25:50.570 20:43:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:50.570 20:43:08 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:50.570 20:43:08 -- common/autotest_common.sh@10 -- # set +x 00:25:50.570 20:43:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:50.570 20:43:08 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:50.570 20:43:08 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:25:51.145 20:43:09 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:25:51.145 20:43:09 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:25:51.145 20:43:09 -- host/perf.sh@30 -- # local_nvme_trid=0000:65:00.0 00:25:51.145 20:43:09 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:25:51.406 20:43:09 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:25:51.406 20:43:09 -- host/perf.sh@33 -- # '[' -n 0000:65:00.0 ']' 00:25:51.406 20:43:09 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:25:51.406 20:43:09 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:25:51.406 20:43:09 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:25:51.406 [2024-04-26 20:43:09.739455] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:51.667 20:43:09 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:51.667 20:43:09 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:51.667 20:43:09 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:51.929 20:43:10 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:51.929 20:43:10 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:25:51.929 20:43:10 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:52.189 [2024-04-26 20:43:10.402114] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:52.189 20:43:10 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:52.451 20:43:10 -- host/perf.sh@52 -- # '[' -n 0000:65:00.0 ']' 00:25:52.451 20:43:10 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:65:00.0' 00:25:52.451 20:43:10 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:25:52.451 20:43:10 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:65:00.0' 00:25:53.842 Initializing NVMe Controllers 00:25:53.842 Attached to NVMe Controller at 0000:65:00.0 [144d:a80a] 00:25:53.842 Associating PCIE (0000:65:00.0) NSID 1 with lcore 0 00:25:53.842 Initialization complete. Launching workers. 00:25:53.842 ======================================================== 00:25:53.842 Latency(us) 00:25:53.842 Device Information : IOPS MiB/s Average min max 00:25:53.842 PCIE (0000:65:00.0) NSID 1 from core 0: 80954.00 316.23 394.54 13.15 5196.23 00:25:53.842 ======================================================== 00:25:53.842 Total : 80954.00 316.23 394.54 13.15 5196.23 00:25:53.842 00:25:53.842 20:43:11 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:53.842 EAL: No free 2048 kB hugepages reported on node 1 00:25:54.838 Initializing NVMe Controllers 00:25:54.838 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:54.838 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:54.838 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:54.838 Initialization complete. Launching workers. 00:25:54.838 ======================================================== 00:25:54.838 Latency(us) 00:25:54.838 Device Information : IOPS MiB/s Average min max 00:25:54.838 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 100.00 0.39 10080.56 565.62 45458.19 00:25:54.838 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 79.00 0.31 13032.13 6978.31 47889.10 00:25:54.838 ======================================================== 00:25:54.838 Total : 179.00 0.70 11383.21 565.62 47889.10 00:25:54.838 00:25:54.838 20:43:13 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:54.838 EAL: No free 2048 kB hugepages reported on node 1 00:25:56.236 Initializing NVMe Controllers 00:25:56.236 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:56.236 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:56.236 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:56.237 Initialization complete. Launching workers. 00:25:56.237 ======================================================== 00:25:56.237 Latency(us) 00:25:56.237 Device Information : IOPS MiB/s Average min max 00:25:56.237 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7102.99 27.75 4514.61 767.64 9004.87 00:25:56.237 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3979.00 15.54 8087.29 6261.95 16169.60 00:25:56.237 ======================================================== 00:25:56.237 Total : 11081.99 43.29 5797.38 767.64 16169.60 00:25:56.237 00:25:56.237 20:43:14 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:25:56.237 20:43:14 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:25:56.237 20:43:14 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:56.237 EAL: No free 2048 kB hugepages reported on node 1 00:25:58.782 Initializing NVMe Controllers 00:25:58.782 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:58.782 Controller IO queue size 128, less than required. 00:25:58.782 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:58.782 Controller IO queue size 128, less than required. 00:25:58.782 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:58.782 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:58.782 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:58.782 Initialization complete. Launching workers. 00:25:58.782 ======================================================== 00:25:58.782 Latency(us) 00:25:58.782 Device Information : IOPS MiB/s Average min max 00:25:58.782 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 917.44 229.36 144039.09 82965.05 192191.81 00:25:58.782 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 603.97 150.99 218978.11 63465.96 331845.57 00:25:58.782 ======================================================== 00:25:58.782 Total : 1521.41 380.35 173788.50 63465.96 331845.57 00:25:58.782 00:25:58.782 20:43:16 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:25:58.782 EAL: No free 2048 kB hugepages reported on node 1 00:25:58.782 No valid NVMe controllers or AIO or URING devices found 00:25:58.782 Initializing NVMe Controllers 00:25:58.783 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:58.783 Controller IO queue size 128, less than required. 00:25:58.783 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:58.783 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:25:58.783 Controller IO queue size 128, less than required. 00:25:58.783 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:58.783 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:25:58.783 WARNING: Some requested NVMe devices were skipped 00:25:58.783 20:43:17 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:25:58.783 EAL: No free 2048 kB hugepages reported on node 1 00:26:01.330 Initializing NVMe Controllers 00:26:01.331 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:01.331 Controller IO queue size 128, less than required. 00:26:01.331 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:01.331 Controller IO queue size 128, less than required. 00:26:01.331 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:01.331 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:01.331 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:01.331 Initialization complete. Launching workers. 00:26:01.331 00:26:01.331 ==================== 00:26:01.331 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:01.331 TCP transport: 00:26:01.331 polls: 36534 00:26:01.331 idle_polls: 13085 00:26:01.331 sock_completions: 23449 00:26:01.331 nvme_completions: 3174 00:26:01.331 submitted_requests: 4916 00:26:01.331 queued_requests: 1 00:26:01.331 00:26:01.331 ==================== 00:26:01.331 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:01.331 TCP transport: 00:26:01.331 polls: 39558 00:26:01.331 idle_polls: 13563 00:26:01.331 sock_completions: 25995 00:26:01.331 nvme_completions: 4612 00:26:01.331 submitted_requests: 7116 00:26:01.331 queued_requests: 1 00:26:01.331 ======================================================== 00:26:01.331 Latency(us) 00:26:01.331 Device Information : IOPS MiB/s Average min max 00:26:01.331 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 856.74 214.19 153329.92 76658.38 266286.63 00:26:01.331 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1216.14 304.03 106583.04 46663.06 151597.34 00:26:01.331 ======================================================== 00:26:01.331 Total : 2072.88 518.22 125904.03 46663.06 266286.63 00:26:01.331 00:26:01.331 20:43:19 -- host/perf.sh@66 -- # sync 00:26:01.331 20:43:19 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:01.591 20:43:19 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:01.591 20:43:19 -- host/perf.sh@71 -- # '[' -n 0000:65:00.0 ']' 00:26:01.591 20:43:19 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:02.532 20:43:20 -- host/perf.sh@72 -- # ls_guid=c11fb8d2-176a-46cc-a08d-d3f20e76efb4 00:26:02.532 20:43:20 -- host/perf.sh@73 -- # get_lvs_free_mb c11fb8d2-176a-46cc-a08d-d3f20e76efb4 00:26:02.532 20:43:20 -- common/autotest_common.sh@1343 -- # local lvs_uuid=c11fb8d2-176a-46cc-a08d-d3f20e76efb4 00:26:02.532 20:43:20 -- common/autotest_common.sh@1344 -- # local lvs_info 00:26:02.532 20:43:20 -- common/autotest_common.sh@1345 -- # local fc 00:26:02.532 20:43:20 -- common/autotest_common.sh@1346 -- # local cs 00:26:02.532 20:43:20 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:02.792 20:43:20 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:26:02.792 { 00:26:02.792 "uuid": "c11fb8d2-176a-46cc-a08d-d3f20e76efb4", 00:26:02.792 "name": "lvs_0", 00:26:02.792 "base_bdev": "Nvme0n1", 00:26:02.792 "total_data_clusters": 457407, 00:26:02.792 "free_clusters": 457407, 00:26:02.792 "block_size": 512, 00:26:02.792 "cluster_size": 4194304 00:26:02.792 } 00:26:02.792 ]' 00:26:02.792 20:43:20 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="c11fb8d2-176a-46cc-a08d-d3f20e76efb4") .free_clusters' 00:26:02.792 20:43:20 -- common/autotest_common.sh@1348 -- # fc=457407 00:26:02.792 20:43:21 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="c11fb8d2-176a-46cc-a08d-d3f20e76efb4") .cluster_size' 00:26:02.792 20:43:21 -- common/autotest_common.sh@1349 -- # cs=4194304 00:26:02.792 20:43:21 -- common/autotest_common.sh@1352 -- # free_mb=1829628 00:26:02.792 20:43:21 -- common/autotest_common.sh@1353 -- # echo 1829628 00:26:02.792 1829628 00:26:02.792 20:43:21 -- host/perf.sh@77 -- # '[' 1829628 -gt 20480 ']' 00:26:02.792 20:43:21 -- host/perf.sh@78 -- # free_mb=20480 00:26:02.792 20:43:21 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u c11fb8d2-176a-46cc-a08d-d3f20e76efb4 lbd_0 20480 00:26:03.053 20:43:21 -- host/perf.sh@80 -- # lb_guid=f5f19ca6-76aa-4172-9457-6266233bdeef 00:26:03.053 20:43:21 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore f5f19ca6-76aa-4172-9457-6266233bdeef lvs_n_0 00:26:04.966 20:43:22 -- host/perf.sh@83 -- # ls_nested_guid=32a64545-b148-4872-b5fb-6fabe573234f 00:26:04.966 20:43:22 -- host/perf.sh@84 -- # get_lvs_free_mb 32a64545-b148-4872-b5fb-6fabe573234f 00:26:04.966 20:43:22 -- common/autotest_common.sh@1343 -- # local lvs_uuid=32a64545-b148-4872-b5fb-6fabe573234f 00:26:04.966 20:43:22 -- common/autotest_common.sh@1344 -- # local lvs_info 00:26:04.966 20:43:22 -- common/autotest_common.sh@1345 -- # local fc 00:26:04.966 20:43:22 -- common/autotest_common.sh@1346 -- # local cs 00:26:04.966 20:43:22 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:04.966 20:43:23 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:26:04.966 { 00:26:04.966 "uuid": "c11fb8d2-176a-46cc-a08d-d3f20e76efb4", 00:26:04.966 "name": "lvs_0", 00:26:04.966 "base_bdev": "Nvme0n1", 00:26:04.966 "total_data_clusters": 457407, 00:26:04.966 "free_clusters": 452287, 00:26:04.966 "block_size": 512, 00:26:04.966 "cluster_size": 4194304 00:26:04.966 }, 00:26:04.966 { 00:26:04.966 "uuid": "32a64545-b148-4872-b5fb-6fabe573234f", 00:26:04.966 "name": "lvs_n_0", 00:26:04.966 "base_bdev": "f5f19ca6-76aa-4172-9457-6266233bdeef", 00:26:04.966 "total_data_clusters": 5114, 00:26:04.966 "free_clusters": 5114, 00:26:04.966 "block_size": 512, 00:26:04.966 "cluster_size": 4194304 00:26:04.966 } 00:26:04.966 ]' 00:26:04.966 20:43:23 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="32a64545-b148-4872-b5fb-6fabe573234f") .free_clusters' 00:26:04.966 20:43:23 -- common/autotest_common.sh@1348 -- # fc=5114 00:26:04.966 20:43:23 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="32a64545-b148-4872-b5fb-6fabe573234f") .cluster_size' 00:26:04.966 20:43:23 -- common/autotest_common.sh@1349 -- # cs=4194304 00:26:04.966 20:43:23 -- common/autotest_common.sh@1352 -- # free_mb=20456 00:26:04.966 20:43:23 -- common/autotest_common.sh@1353 -- # echo 20456 00:26:04.966 20456 00:26:04.966 20:43:23 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:04.966 20:43:23 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 32a64545-b148-4872-b5fb-6fabe573234f lbd_nest_0 20456 00:26:04.966 20:43:23 -- host/perf.sh@88 -- # lb_nested_guid=8d6c902a-a2bf-4c2d-b1f4-a99114eb75ff 00:26:04.966 20:43:23 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:05.227 20:43:23 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:05.227 20:43:23 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 8d6c902a-a2bf-4c2d-b1f4-a99114eb75ff 00:26:05.487 20:43:23 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:05.487 20:43:23 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:05.487 20:43:23 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:05.487 20:43:23 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:05.487 20:43:23 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:05.487 20:43:23 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:05.487 EAL: No free 2048 kB hugepages reported on node 1 00:26:17.724 Initializing NVMe Controllers 00:26:17.724 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:17.724 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:17.724 Initialization complete. Launching workers. 00:26:17.724 ======================================================== 00:26:17.724 Latency(us) 00:26:17.724 Device Information : IOPS MiB/s Average min max 00:26:17.724 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 44.50 0.02 22506.40 174.37 48694.00 00:26:17.724 ======================================================== 00:26:17.724 Total : 44.50 0.02 22506.40 174.37 48694.00 00:26:17.724 00:26:17.724 20:43:34 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:17.724 20:43:34 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:17.724 EAL: No free 2048 kB hugepages reported on node 1 00:26:27.727 Initializing NVMe Controllers 00:26:27.727 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:27.727 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:27.727 Initialization complete. Launching workers. 00:26:27.727 ======================================================== 00:26:27.727 Latency(us) 00:26:27.727 Device Information : IOPS MiB/s Average min max 00:26:27.727 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 79.80 9.97 12551.50 6999.54 48868.92 00:26:27.727 ======================================================== 00:26:27.727 Total : 79.80 9.97 12551.50 6999.54 48868.92 00:26:27.727 00:26:27.727 20:43:44 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:27.727 20:43:44 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:27.727 20:43:44 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:27.727 EAL: No free 2048 kB hugepages reported on node 1 00:26:37.732 Initializing NVMe Controllers 00:26:37.732 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:37.732 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:37.732 Initialization complete. Launching workers. 00:26:37.732 ======================================================== 00:26:37.732 Latency(us) 00:26:37.732 Device Information : IOPS MiB/s Average min max 00:26:37.732 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 6350.49 3.10 5040.08 407.95 12036.63 00:26:37.732 ======================================================== 00:26:37.732 Total : 6350.49 3.10 5040.08 407.95 12036.63 00:26:37.732 00:26:37.732 20:43:54 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:37.732 20:43:54 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:37.732 EAL: No free 2048 kB hugepages reported on node 1 00:26:47.733 Initializing NVMe Controllers 00:26:47.733 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:47.733 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:47.733 Initialization complete. Launching workers. 00:26:47.733 ======================================================== 00:26:47.733 Latency(us) 00:26:47.733 Device Information : IOPS MiB/s Average min max 00:26:47.733 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 2176.10 272.01 14720.71 832.00 32152.59 00:26:47.733 ======================================================== 00:26:47.733 Total : 2176.10 272.01 14720.71 832.00 32152.59 00:26:47.733 00:26:47.733 20:44:05 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:47.733 20:44:05 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:47.733 20:44:05 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:47.733 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.735 Initializing NVMe Controllers 00:26:57.735 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:57.735 Controller IO queue size 128, less than required. 00:26:57.735 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:57.735 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:57.735 Initialization complete. Launching workers. 00:26:57.735 ======================================================== 00:26:57.735 Latency(us) 00:26:57.735 Device Information : IOPS MiB/s Average min max 00:26:57.735 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12451.50 6.08 10285.08 1997.91 25792.50 00:26:57.735 ======================================================== 00:26:57.735 Total : 12451.50 6.08 10285.08 1997.91 25792.50 00:26:57.735 00:26:57.735 20:44:15 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:57.735 20:44:15 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:57.735 EAL: No free 2048 kB hugepages reported on node 1 00:27:10.079 Initializing NVMe Controllers 00:27:10.079 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:10.079 Controller IO queue size 128, less than required. 00:27:10.079 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:10.079 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:10.079 Initialization complete. Launching workers. 00:27:10.079 ======================================================== 00:27:10.079 Latency(us) 00:27:10.079 Device Information : IOPS MiB/s Average min max 00:27:10.079 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1138.11 142.26 112825.50 16680.01 236413.94 00:27:10.079 ======================================================== 00:27:10.079 Total : 1138.11 142.26 112825.50 16680.01 236413.94 00:27:10.079 00:27:10.079 20:44:26 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:10.079 20:44:26 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 8d6c902a-a2bf-4c2d-b1f4-a99114eb75ff 00:27:10.079 20:44:28 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:10.079 20:44:28 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete f5f19ca6-76aa-4172-9457-6266233bdeef 00:27:10.340 20:44:28 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:10.340 20:44:28 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:10.340 20:44:28 -- host/perf.sh@114 -- # nvmftestfini 00:27:10.340 20:44:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:10.340 20:44:28 -- nvmf/common.sh@116 -- # sync 00:27:10.340 20:44:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:10.340 20:44:28 -- nvmf/common.sh@119 -- # set +e 00:27:10.340 20:44:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:10.340 20:44:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:10.340 rmmod nvme_tcp 00:27:10.340 rmmod nvme_fabrics 00:27:10.340 rmmod nvme_keyring 00:27:10.340 20:44:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:10.340 20:44:28 -- nvmf/common.sh@123 -- # set -e 00:27:10.340 20:44:28 -- nvmf/common.sh@124 -- # return 0 00:27:10.340 20:44:28 -- nvmf/common.sh@477 -- # '[' -n 4182177 ']' 00:27:10.340 20:44:28 -- nvmf/common.sh@478 -- # killprocess 4182177 00:27:10.340 20:44:28 -- common/autotest_common.sh@926 -- # '[' -z 4182177 ']' 00:27:10.340 20:44:28 -- common/autotest_common.sh@930 -- # kill -0 4182177 00:27:10.340 20:44:28 -- common/autotest_common.sh@931 -- # uname 00:27:10.340 20:44:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:10.340 20:44:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 4182177 00:27:10.601 20:44:28 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:10.601 20:44:28 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:10.601 20:44:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 4182177' 00:27:10.601 killing process with pid 4182177 00:27:10.601 20:44:28 -- common/autotest_common.sh@945 -- # kill 4182177 00:27:10.601 20:44:28 -- common/autotest_common.sh@950 -- # wait 4182177 00:27:12.518 20:44:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:12.518 20:44:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:12.518 20:44:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:12.518 20:44:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:12.518 20:44:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:12.518 20:44:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:12.518 20:44:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:12.518 20:44:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:14.434 20:44:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:14.434 00:27:14.434 real 1m32.297s 00:27:14.434 user 5m20.805s 00:27:14.434 sys 0m14.516s 00:27:14.434 20:44:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:14.434 20:44:32 -- common/autotest_common.sh@10 -- # set +x 00:27:14.434 ************************************ 00:27:14.434 END TEST nvmf_perf 00:27:14.434 ************************************ 00:27:14.696 20:44:32 -- nvmf/nvmf.sh@98 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:14.696 20:44:32 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:14.696 20:44:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:14.696 20:44:32 -- common/autotest_common.sh@10 -- # set +x 00:27:14.696 ************************************ 00:27:14.696 START TEST nvmf_fio_host 00:27:14.696 ************************************ 00:27:14.696 20:44:32 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:14.696 * Looking for test storage... 00:27:14.696 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:14.696 20:44:32 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:14.696 20:44:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:14.696 20:44:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:14.696 20:44:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:14.696 20:44:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:14.696 20:44:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:14.696 20:44:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:14.696 20:44:32 -- paths/export.sh@5 -- # export PATH 00:27:14.696 20:44:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:14.696 20:44:32 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:14.696 20:44:32 -- nvmf/common.sh@7 -- # uname -s 00:27:14.696 20:44:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:14.696 20:44:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:14.696 20:44:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:14.696 20:44:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:14.696 20:44:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:14.697 20:44:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:14.697 20:44:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:14.697 20:44:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:14.697 20:44:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:14.697 20:44:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:14.697 20:44:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:27:14.697 20:44:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:27:14.697 20:44:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:14.697 20:44:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:14.697 20:44:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:14.697 20:44:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:14.697 20:44:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:14.697 20:44:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:14.697 20:44:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:14.697 20:44:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:14.697 20:44:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:14.697 20:44:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:14.697 20:44:32 -- paths/export.sh@5 -- # export PATH 00:27:14.697 20:44:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:14.697 20:44:32 -- nvmf/common.sh@46 -- # : 0 00:27:14.697 20:44:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:14.697 20:44:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:14.697 20:44:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:14.697 20:44:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:14.697 20:44:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:14.697 20:44:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:14.697 20:44:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:14.697 20:44:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:14.697 20:44:32 -- host/fio.sh@12 -- # nvmftestinit 00:27:14.697 20:44:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:14.697 20:44:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:14.697 20:44:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:14.697 20:44:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:14.697 20:44:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:14.697 20:44:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:14.697 20:44:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:14.697 20:44:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:14.697 20:44:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:14.697 20:44:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:14.697 20:44:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:14.697 20:44:32 -- common/autotest_common.sh@10 -- # set +x 00:27:22.846 20:44:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:22.846 20:44:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:22.846 20:44:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:22.846 20:44:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:22.846 20:44:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:22.846 20:44:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:22.846 20:44:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:22.846 20:44:39 -- nvmf/common.sh@294 -- # net_devs=() 00:27:22.846 20:44:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:22.846 20:44:39 -- nvmf/common.sh@295 -- # e810=() 00:27:22.846 20:44:39 -- nvmf/common.sh@295 -- # local -ga e810 00:27:22.846 20:44:39 -- nvmf/common.sh@296 -- # x722=() 00:27:22.846 20:44:39 -- nvmf/common.sh@296 -- # local -ga x722 00:27:22.846 20:44:39 -- nvmf/common.sh@297 -- # mlx=() 00:27:22.846 20:44:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:22.846 20:44:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:22.846 20:44:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:22.846 20:44:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:22.846 20:44:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:22.846 20:44:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:22.846 20:44:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:22.846 20:44:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:22.846 20:44:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:22.846 20:44:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:22.847 20:44:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:22.847 20:44:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:22.847 20:44:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:22.847 20:44:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:22.847 20:44:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:22.847 20:44:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:22.847 20:44:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:27:22.847 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:27:22.847 20:44:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:22.847 20:44:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:27:22.847 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:27:22.847 20:44:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:22.847 20:44:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:22.847 20:44:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:22.847 20:44:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:22.847 20:44:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:22.847 20:44:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:27:22.847 Found net devices under 0000:4b:00.0: cvl_0_0 00:27:22.847 20:44:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:22.847 20:44:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:22.847 20:44:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:22.847 20:44:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:22.847 20:44:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:22.847 20:44:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:27:22.847 Found net devices under 0000:4b:00.1: cvl_0_1 00:27:22.847 20:44:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:22.847 20:44:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:22.847 20:44:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:22.847 20:44:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:22.847 20:44:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:22.847 20:44:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:22.847 20:44:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:22.847 20:44:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:22.847 20:44:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:22.847 20:44:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:22.847 20:44:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:22.847 20:44:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:22.847 20:44:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:22.847 20:44:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:22.847 20:44:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:22.847 20:44:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:22.847 20:44:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:22.847 20:44:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:22.847 20:44:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:22.847 20:44:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:22.847 20:44:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:22.847 20:44:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:22.847 20:44:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:22.847 20:44:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:22.847 20:44:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:22.847 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:22.847 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.489 ms 00:27:22.847 00:27:22.847 --- 10.0.0.2 ping statistics --- 00:27:22.847 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:22.847 rtt min/avg/max/mdev = 0.489/0.489/0.489/0.000 ms 00:27:22.847 20:44:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:22.847 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:22.847 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.285 ms 00:27:22.847 00:27:22.847 --- 10.0.0.1 ping statistics --- 00:27:22.847 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:22.847 rtt min/avg/max/mdev = 0.285/0.285/0.285/0.000 ms 00:27:22.847 20:44:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:22.847 20:44:40 -- nvmf/common.sh@410 -- # return 0 00:27:22.847 20:44:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:22.847 20:44:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:22.847 20:44:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:22.847 20:44:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:22.847 20:44:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:22.847 20:44:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:22.847 20:44:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:22.847 20:44:40 -- host/fio.sh@14 -- # [[ y != y ]] 00:27:22.847 20:44:40 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:27:22.847 20:44:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:22.847 20:44:40 -- common/autotest_common.sh@10 -- # set +x 00:27:22.847 20:44:40 -- host/fio.sh@22 -- # nvmfpid=9217 00:27:22.847 20:44:40 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:22.847 20:44:40 -- host/fio.sh@21 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:22.847 20:44:40 -- host/fio.sh@26 -- # waitforlisten 9217 00:27:22.847 20:44:40 -- common/autotest_common.sh@819 -- # '[' -z 9217 ']' 00:27:22.847 20:44:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:22.847 20:44:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:22.847 20:44:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:22.847 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:22.847 20:44:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:22.847 20:44:40 -- common/autotest_common.sh@10 -- # set +x 00:27:22.847 [2024-04-26 20:44:40.256804] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:27:22.847 [2024-04-26 20:44:40.256902] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:22.847 EAL: No free 2048 kB hugepages reported on node 1 00:27:22.847 [2024-04-26 20:44:40.327913] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:22.847 [2024-04-26 20:44:40.397720] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:22.847 [2024-04-26 20:44:40.397851] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:22.847 [2024-04-26 20:44:40.397861] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:22.847 [2024-04-26 20:44:40.397870] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:22.847 [2024-04-26 20:44:40.397910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:22.847 [2024-04-26 20:44:40.398027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:22.847 [2024-04-26 20:44:40.398176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:22.847 [2024-04-26 20:44:40.398179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:22.847 20:44:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:22.847 20:44:41 -- common/autotest_common.sh@852 -- # return 0 00:27:22.847 20:44:41 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:22.847 20:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:22.847 20:44:41 -- common/autotest_common.sh@10 -- # set +x 00:27:22.847 [2024-04-26 20:44:41.029321] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:22.847 20:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:22.847 20:44:41 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:27:22.847 20:44:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:22.847 20:44:41 -- common/autotest_common.sh@10 -- # set +x 00:27:22.847 20:44:41 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:27:22.847 20:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:22.847 20:44:41 -- common/autotest_common.sh@10 -- # set +x 00:27:22.847 Malloc1 00:27:22.847 20:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:22.847 20:44:41 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:22.847 20:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:22.847 20:44:41 -- common/autotest_common.sh@10 -- # set +x 00:27:22.847 20:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:22.847 20:44:41 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:22.847 20:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:22.847 20:44:41 -- common/autotest_common.sh@10 -- # set +x 00:27:22.847 20:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:22.847 20:44:41 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:22.847 20:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:22.847 20:44:41 -- common/autotest_common.sh@10 -- # set +x 00:27:22.847 [2024-04-26 20:44:41.128936] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:22.847 20:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:22.847 20:44:41 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:22.847 20:44:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:22.847 20:44:41 -- common/autotest_common.sh@10 -- # set +x 00:27:22.847 20:44:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:22.848 20:44:41 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:22.848 20:44:41 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:22.848 20:44:41 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:22.848 20:44:41 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:22.848 20:44:41 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:22.848 20:44:41 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:22.848 20:44:41 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:22.848 20:44:41 -- common/autotest_common.sh@1320 -- # shift 00:27:22.848 20:44:41 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:22.848 20:44:41 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:22.848 20:44:41 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:22.848 20:44:41 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:22.848 20:44:41 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:22.848 20:44:41 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:22.848 20:44:41 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:22.848 20:44:41 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:22.848 20:44:41 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:22.848 20:44:41 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:22.848 20:44:41 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:23.133 20:44:41 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:23.133 20:44:41 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:23.133 20:44:41 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:23.133 20:44:41 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:23.398 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:23.398 fio-3.35 00:27:23.398 Starting 1 thread 00:27:23.398 EAL: No free 2048 kB hugepages reported on node 1 00:27:25.982 00:27:25.982 test: (groupid=0, jobs=1): err= 0: pid=9722: Fri Apr 26 20:44:43 2024 00:27:25.982 read: IOPS=10.2k, BW=39.9MiB/s (41.9MB/s)(80.0MiB/2005msec) 00:27:25.982 slat (usec): min=2, max=276, avg= 2.21, stdev= 2.75 00:27:25.982 clat (usec): min=3946, max=12629, avg=7116.83, stdev=1091.81 00:27:25.982 lat (usec): min=3982, max=12631, avg=7119.03, stdev=1091.78 00:27:25.982 clat percentiles (usec): 00:27:25.982 | 1.00th=[ 5080], 5.00th=[ 5669], 10.00th=[ 5997], 20.00th=[ 6390], 00:27:25.982 | 30.00th=[ 6587], 40.00th=[ 6783], 50.00th=[ 6980], 60.00th=[ 7111], 00:27:25.982 | 70.00th=[ 7373], 80.00th=[ 7635], 90.00th=[ 8455], 95.00th=[ 9372], 00:27:25.982 | 99.00th=[10945], 99.50th=[11338], 99.90th=[12256], 99.95th=[12518], 00:27:25.982 | 99.99th=[12649] 00:27:25.982 bw ( KiB/s): min=40128, max=41592, per=99.88%, avg=40832.00, stdev=632.93, samples=4 00:27:25.982 iops : min=10032, max=10398, avg=10208.00, stdev=158.23, samples=4 00:27:25.982 write: IOPS=10.2k, BW=39.9MiB/s (41.9MB/s)(80.1MiB/2005msec); 0 zone resets 00:27:25.982 slat (usec): min=2, max=258, avg= 2.31, stdev= 2.00 00:27:25.982 clat (usec): min=2512, max=9893, avg=5353.49, stdev=700.79 00:27:25.982 lat (usec): min=2514, max=9895, avg=5355.80, stdev=700.80 00:27:25.982 clat percentiles (usec): 00:27:25.982 | 1.00th=[ 3392], 5.00th=[ 4015], 10.00th=[ 4424], 20.00th=[ 4883], 00:27:25.982 | 30.00th=[ 5145], 40.00th=[ 5276], 50.00th=[ 5407], 60.00th=[ 5538], 00:27:25.982 | 70.00th=[ 5669], 80.00th=[ 5866], 90.00th=[ 6063], 95.00th=[ 6325], 00:27:25.982 | 99.00th=[ 7046], 99.50th=[ 7242], 99.90th=[ 8225], 99.95th=[ 9241], 00:27:25.982 | 99.99th=[ 9765] 00:27:25.982 bw ( KiB/s): min=40736, max=41200, per=100.00%, avg=40900.00, stdev=205.47, samples=4 00:27:25.982 iops : min=10184, max=10300, avg=10225.00, stdev=51.37, samples=4 00:27:25.982 lat (msec) : 4=2.44%, 10=96.05%, 20=1.51% 00:27:25.982 cpu : usr=65.42%, sys=27.40%, ctx=19, majf=0, minf=6 00:27:25.982 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:25.982 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:25.982 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:25.982 issued rwts: total=20491,20502,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:25.982 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:25.982 00:27:25.982 Run status group 0 (all jobs): 00:27:25.982 READ: bw=39.9MiB/s (41.9MB/s), 39.9MiB/s-39.9MiB/s (41.9MB/s-41.9MB/s), io=80.0MiB (83.9MB), run=2005-2005msec 00:27:25.982 WRITE: bw=39.9MiB/s (41.9MB/s), 39.9MiB/s-39.9MiB/s (41.9MB/s-41.9MB/s), io=80.1MiB (84.0MB), run=2005-2005msec 00:27:25.982 20:44:43 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:25.982 20:44:43 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:25.982 20:44:43 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:25.982 20:44:43 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:25.983 20:44:43 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:25.983 20:44:43 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:25.983 20:44:43 -- common/autotest_common.sh@1320 -- # shift 00:27:25.983 20:44:43 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:25.983 20:44:43 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:25.983 20:44:43 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:25.983 20:44:43 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:25.983 20:44:43 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:25.983 20:44:44 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:25.983 20:44:44 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:25.983 20:44:44 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:25.983 20:44:44 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:25.983 20:44:44 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:25.983 20:44:44 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:25.983 20:44:44 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:25.983 20:44:44 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:25.983 20:44:44 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:25.983 20:44:44 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:26.242 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:26.242 fio-3.35 00:27:26.242 Starting 1 thread 00:27:26.242 EAL: No free 2048 kB hugepages reported on node 1 00:27:28.826 00:27:28.826 test: (groupid=0, jobs=1): err= 0: pid=10408: Fri Apr 26 20:44:46 2024 00:27:28.826 read: IOPS=8597, BW=134MiB/s (141MB/s)(270MiB/2010msec) 00:27:28.826 slat (usec): min=3, max=111, avg= 3.63, stdev= 1.67 00:27:28.826 clat (usec): min=2679, max=52167, avg=9265.04, stdev=3932.34 00:27:28.826 lat (usec): min=2683, max=52171, avg=9268.67, stdev=3932.59 00:27:28.826 clat percentiles (usec): 00:27:28.826 | 1.00th=[ 4293], 5.00th=[ 5342], 10.00th=[ 5997], 20.00th=[ 6783], 00:27:28.826 | 30.00th=[ 7439], 40.00th=[ 8094], 50.00th=[ 8717], 60.00th=[ 9372], 00:27:28.826 | 70.00th=[10028], 80.00th=[11207], 90.00th=[12780], 95.00th=[14353], 00:27:28.826 | 99.00th=[18482], 99.50th=[44303], 99.90th=[50070], 99.95th=[51119], 00:27:28.826 | 99.99th=[52167] 00:27:28.826 bw ( KiB/s): min=58368, max=82304, per=51.58%, avg=70944.00, stdev=11345.61, samples=4 00:27:28.826 iops : min= 3648, max= 5144, avg=4434.00, stdev=709.10, samples=4 00:27:28.826 write: IOPS=5174, BW=80.8MiB/s (84.8MB/s)(145MiB/1793msec); 0 zone resets 00:27:28.826 slat (usec): min=39, max=450, avg=41.10, stdev= 8.65 00:27:28.826 clat (usec): min=3300, max=53302, avg=9706.97, stdev=3138.92 00:27:28.826 lat (usec): min=3340, max=53342, avg=9748.07, stdev=3140.72 00:27:28.826 clat percentiles (usec): 00:27:28.826 | 1.00th=[ 6259], 5.00th=[ 7046], 10.00th=[ 7504], 20.00th=[ 8029], 00:27:28.826 | 30.00th=[ 8455], 40.00th=[ 8848], 50.00th=[ 9372], 60.00th=[ 9765], 00:27:28.826 | 70.00th=[10290], 80.00th=[10814], 90.00th=[11863], 95.00th=[12911], 00:27:28.826 | 99.00th=[18482], 99.50th=[20317], 99.90th=[51119], 99.95th=[52167], 00:27:28.826 | 99.99th=[53216] 00:27:28.826 bw ( KiB/s): min=61376, max=85408, per=89.34%, avg=73960.00, stdev=11523.86, samples=4 00:27:28.826 iops : min= 3836, max= 5338, avg=4622.50, stdev=720.24, samples=4 00:27:28.826 lat (msec) : 4=0.41%, 10=67.44%, 20=31.47%, 50=0.55%, 100=0.14% 00:27:28.826 cpu : usr=83.43%, sys=12.84%, ctx=11, majf=0, minf=15 00:27:28.826 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:27:28.826 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:28.826 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:28.826 issued rwts: total=17280,9277,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:28.826 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:28.826 00:27:28.826 Run status group 0 (all jobs): 00:27:28.826 READ: bw=134MiB/s (141MB/s), 134MiB/s-134MiB/s (141MB/s-141MB/s), io=270MiB (283MB), run=2010-2010msec 00:27:28.826 WRITE: bw=80.8MiB/s (84.8MB/s), 80.8MiB/s-80.8MiB/s (84.8MB/s-84.8MB/s), io=145MiB (152MB), run=1793-1793msec 00:27:28.826 20:44:46 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:28.826 20:44:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:28.826 20:44:46 -- common/autotest_common.sh@10 -- # set +x 00:27:28.826 20:44:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:28.826 20:44:46 -- host/fio.sh@47 -- # '[' 1 -eq 1 ']' 00:27:28.826 20:44:46 -- host/fio.sh@49 -- # bdfs=($(get_nvme_bdfs)) 00:27:28.826 20:44:46 -- host/fio.sh@49 -- # get_nvme_bdfs 00:27:28.826 20:44:46 -- common/autotest_common.sh@1498 -- # bdfs=() 00:27:28.826 20:44:46 -- common/autotest_common.sh@1498 -- # local bdfs 00:27:28.826 20:44:46 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:28.826 20:44:46 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:28.826 20:44:46 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:27:28.826 20:44:46 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:27:28.826 20:44:46 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:65:00.0 00:27:28.826 20:44:46 -- host/fio.sh@50 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:65:00.0 -i 10.0.0.2 00:27:28.826 20:44:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:28.826 20:44:46 -- common/autotest_common.sh@10 -- # set +x 00:27:28.826 Nvme0n1 00:27:28.826 20:44:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:28.826 20:44:47 -- host/fio.sh@51 -- # rpc_cmd bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:28.826 20:44:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:28.826 20:44:47 -- common/autotest_common.sh@10 -- # set +x 00:27:29.396 20:44:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:29.396 20:44:47 -- host/fio.sh@51 -- # ls_guid=79c24d51-25fe-447c-b540-9c3a8c9d34ac 00:27:29.396 20:44:47 -- host/fio.sh@52 -- # get_lvs_free_mb 79c24d51-25fe-447c-b540-9c3a8c9d34ac 00:27:29.396 20:44:47 -- common/autotest_common.sh@1343 -- # local lvs_uuid=79c24d51-25fe-447c-b540-9c3a8c9d34ac 00:27:29.396 20:44:47 -- common/autotest_common.sh@1344 -- # local lvs_info 00:27:29.396 20:44:47 -- common/autotest_common.sh@1345 -- # local fc 00:27:29.396 20:44:47 -- common/autotest_common.sh@1346 -- # local cs 00:27:29.396 20:44:47 -- common/autotest_common.sh@1347 -- # rpc_cmd bdev_lvol_get_lvstores 00:27:29.396 20:44:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:29.396 20:44:47 -- common/autotest_common.sh@10 -- # set +x 00:27:29.396 20:44:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:29.396 20:44:47 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:27:29.396 { 00:27:29.396 "uuid": "79c24d51-25fe-447c-b540-9c3a8c9d34ac", 00:27:29.396 "name": "lvs_0", 00:27:29.396 "base_bdev": "Nvme0n1", 00:27:29.396 "total_data_clusters": 1787, 00:27:29.396 "free_clusters": 1787, 00:27:29.396 "block_size": 512, 00:27:29.396 "cluster_size": 1073741824 00:27:29.396 } 00:27:29.396 ]' 00:27:29.396 20:44:47 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="79c24d51-25fe-447c-b540-9c3a8c9d34ac") .free_clusters' 00:27:29.396 20:44:47 -- common/autotest_common.sh@1348 -- # fc=1787 00:27:29.396 20:44:47 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="79c24d51-25fe-447c-b540-9c3a8c9d34ac") .cluster_size' 00:27:29.396 20:44:47 -- common/autotest_common.sh@1349 -- # cs=1073741824 00:27:29.396 20:44:47 -- common/autotest_common.sh@1352 -- # free_mb=1829888 00:27:29.396 20:44:47 -- common/autotest_common.sh@1353 -- # echo 1829888 00:27:29.396 1829888 00:27:29.396 20:44:47 -- host/fio.sh@53 -- # rpc_cmd bdev_lvol_create -l lvs_0 lbd_0 1829888 00:27:29.396 20:44:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:29.396 20:44:47 -- common/autotest_common.sh@10 -- # set +x 00:27:29.396 2f40e4af-eff9-4619-a68d-1e5f98d47624 00:27:29.396 20:44:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:29.396 20:44:47 -- host/fio.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:29.396 20:44:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:29.396 20:44:47 -- common/autotest_common.sh@10 -- # set +x 00:27:29.396 20:44:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:29.396 20:44:47 -- host/fio.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:29.396 20:44:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:29.396 20:44:47 -- common/autotest_common.sh@10 -- # set +x 00:27:29.396 20:44:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:29.396 20:44:47 -- host/fio.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:29.396 20:44:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:29.396 20:44:47 -- common/autotest_common.sh@10 -- # set +x 00:27:29.396 20:44:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:29.396 20:44:47 -- host/fio.sh@57 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:29.397 20:44:47 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:29.397 20:44:47 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:29.397 20:44:47 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:29.397 20:44:47 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:29.397 20:44:47 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:29.397 20:44:47 -- common/autotest_common.sh@1320 -- # shift 00:27:29.397 20:44:47 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:29.397 20:44:47 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:29.397 20:44:47 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:29.397 20:44:47 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:29.397 20:44:47 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:29.397 20:44:47 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:29.397 20:44:47 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:29.397 20:44:47 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:29.397 20:44:47 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:29.397 20:44:47 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:29.397 20:44:47 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:29.397 20:44:47 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:29.397 20:44:47 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:29.397 20:44:47 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:29.397 20:44:47 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:29.993 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:29.993 fio-3.35 00:27:29.993 Starting 1 thread 00:27:29.993 EAL: No free 2048 kB hugepages reported on node 1 00:27:32.538 00:27:32.538 test: (groupid=0, jobs=1): err= 0: pid=11280: Fri Apr 26 20:44:50 2024 00:27:32.538 read: IOPS=7646, BW=29.9MiB/s (31.3MB/s)(59.9MiB/2007msec) 00:27:32.538 slat (usec): min=2, max=109, avg= 2.21, stdev= 1.17 00:27:32.538 clat (usec): min=3315, max=15721, avg=9395.03, stdev=1029.33 00:27:32.538 lat (usec): min=3334, max=15723, avg=9397.24, stdev=1029.28 00:27:32.538 clat percentiles (usec): 00:27:32.538 | 1.00th=[ 6915], 5.00th=[ 7832], 10.00th=[ 8160], 20.00th=[ 8586], 00:27:32.538 | 30.00th=[ 8848], 40.00th=[ 9110], 50.00th=[ 9372], 60.00th=[ 9634], 00:27:32.538 | 70.00th=[ 9896], 80.00th=[10159], 90.00th=[10552], 95.00th=[11076], 00:27:32.538 | 99.00th=[12387], 99.50th=[12780], 99.90th=[13829], 99.95th=[14746], 00:27:32.538 | 99.99th=[15664] 00:27:32.538 bw ( KiB/s): min=29416, max=31192, per=99.88%, avg=30550.00, stdev=807.12, samples=4 00:27:32.538 iops : min= 7354, max= 7798, avg=7637.50, stdev=201.78, samples=4 00:27:32.538 write: IOPS=7629, BW=29.8MiB/s (31.2MB/s)(59.8MiB/2007msec); 0 zone resets 00:27:32.538 slat (nsec): min=2118, max=95878, avg=2320.80, stdev=829.07 00:27:32.538 clat (usec): min=1456, max=13176, avg=7286.50, stdev=804.41 00:27:32.538 lat (usec): min=1464, max=13178, avg=7288.82, stdev=804.40 00:27:32.538 clat percentiles (usec): 00:27:32.538 | 1.00th=[ 5080], 5.00th=[ 5997], 10.00th=[ 6259], 20.00th=[ 6718], 00:27:32.538 | 30.00th=[ 6915], 40.00th=[ 7111], 50.00th=[ 7308], 60.00th=[ 7504], 00:27:32.538 | 70.00th=[ 7701], 80.00th=[ 7963], 90.00th=[ 8225], 95.00th=[ 8455], 00:27:32.538 | 99.00th=[ 8979], 99.50th=[ 9241], 99.90th=[10159], 99.95th=[11994], 00:27:32.538 | 99.99th=[13173] 00:27:32.538 bw ( KiB/s): min=30336, max=30664, per=99.99%, avg=30514.00, stdev=144.65, samples=4 00:27:32.538 iops : min= 7584, max= 7666, avg=7628.50, stdev=36.16, samples=4 00:27:32.538 lat (msec) : 2=0.01%, 4=0.08%, 10=87.75%, 20=12.15% 00:27:32.538 cpu : usr=63.66%, sys=30.51%, ctx=61, majf=0, minf=6 00:27:32.538 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:32.538 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:32.538 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:32.538 issued rwts: total=15347,15312,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:32.538 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:32.538 00:27:32.538 Run status group 0 (all jobs): 00:27:32.538 READ: bw=29.9MiB/s (31.3MB/s), 29.9MiB/s-29.9MiB/s (31.3MB/s-31.3MB/s), io=59.9MiB (62.9MB), run=2007-2007msec 00:27:32.538 WRITE: bw=29.8MiB/s (31.2MB/s), 29.8MiB/s-29.8MiB/s (31.2MB/s-31.2MB/s), io=59.8MiB (62.7MB), run=2007-2007msec 00:27:32.538 20:44:50 -- host/fio.sh@59 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:32.538 20:44:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:32.538 20:44:50 -- common/autotest_common.sh@10 -- # set +x 00:27:32.538 20:44:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:32.538 20:44:50 -- host/fio.sh@62 -- # rpc_cmd bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:27:32.538 20:44:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:32.538 20:44:50 -- common/autotest_common.sh@10 -- # set +x 00:27:32.799 20:44:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:32.799 20:44:51 -- host/fio.sh@62 -- # ls_nested_guid=3eccfbe6-ef37-4b70-b4f3-6482843a864e 00:27:32.799 20:44:51 -- host/fio.sh@63 -- # get_lvs_free_mb 3eccfbe6-ef37-4b70-b4f3-6482843a864e 00:27:32.799 20:44:51 -- common/autotest_common.sh@1343 -- # local lvs_uuid=3eccfbe6-ef37-4b70-b4f3-6482843a864e 00:27:32.799 20:44:51 -- common/autotest_common.sh@1344 -- # local lvs_info 00:27:32.799 20:44:51 -- common/autotest_common.sh@1345 -- # local fc 00:27:32.799 20:44:51 -- common/autotest_common.sh@1346 -- # local cs 00:27:32.799 20:44:51 -- common/autotest_common.sh@1347 -- # rpc_cmd bdev_lvol_get_lvstores 00:27:32.799 20:44:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:32.799 20:44:51 -- common/autotest_common.sh@10 -- # set +x 00:27:32.799 20:44:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:32.799 20:44:51 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:27:32.799 { 00:27:32.799 "uuid": "79c24d51-25fe-447c-b540-9c3a8c9d34ac", 00:27:32.799 "name": "lvs_0", 00:27:32.799 "base_bdev": "Nvme0n1", 00:27:32.799 "total_data_clusters": 1787, 00:27:32.799 "free_clusters": 0, 00:27:32.799 "block_size": 512, 00:27:32.799 "cluster_size": 1073741824 00:27:32.799 }, 00:27:32.799 { 00:27:32.799 "uuid": "3eccfbe6-ef37-4b70-b4f3-6482843a864e", 00:27:32.799 "name": "lvs_n_0", 00:27:32.799 "base_bdev": "2f40e4af-eff9-4619-a68d-1e5f98d47624", 00:27:32.799 "total_data_clusters": 457025, 00:27:32.799 "free_clusters": 457025, 00:27:32.799 "block_size": 512, 00:27:32.799 "cluster_size": 4194304 00:27:32.799 } 00:27:32.799 ]' 00:27:32.799 20:44:51 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="3eccfbe6-ef37-4b70-b4f3-6482843a864e") .free_clusters' 00:27:33.060 20:44:51 -- common/autotest_common.sh@1348 -- # fc=457025 00:27:33.060 20:44:51 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="3eccfbe6-ef37-4b70-b4f3-6482843a864e") .cluster_size' 00:27:33.060 20:44:51 -- common/autotest_common.sh@1349 -- # cs=4194304 00:27:33.060 20:44:51 -- common/autotest_common.sh@1352 -- # free_mb=1828100 00:27:33.060 20:44:51 -- common/autotest_common.sh@1353 -- # echo 1828100 00:27:33.060 1828100 00:27:33.060 20:44:51 -- host/fio.sh@64 -- # rpc_cmd bdev_lvol_create -l lvs_n_0 lbd_nest_0 1828100 00:27:33.060 20:44:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:33.060 20:44:51 -- common/autotest_common.sh@10 -- # set +x 00:27:34.031 0172c4cb-007d-4827-bff4-72b99a5445a7 00:27:34.031 20:44:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:34.031 20:44:52 -- host/fio.sh@65 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:27:34.031 20:44:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:34.031 20:44:52 -- common/autotest_common.sh@10 -- # set +x 00:27:34.031 20:44:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:34.031 20:44:52 -- host/fio.sh@66 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:27:34.031 20:44:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:34.031 20:44:52 -- common/autotest_common.sh@10 -- # set +x 00:27:34.031 20:44:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:34.031 20:44:52 -- host/fio.sh@67 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:27:34.031 20:44:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:34.031 20:44:52 -- common/autotest_common.sh@10 -- # set +x 00:27:34.031 20:44:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:34.031 20:44:52 -- host/fio.sh@68 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:34.031 20:44:52 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:34.031 20:44:52 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:34.031 20:44:52 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:34.031 20:44:52 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:34.031 20:44:52 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:34.031 20:44:52 -- common/autotest_common.sh@1320 -- # shift 00:27:34.031 20:44:52 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:34.031 20:44:52 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:34.031 20:44:52 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:34.031 20:44:52 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:34.031 20:44:52 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:34.031 20:44:52 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:34.031 20:44:52 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:34.031 20:44:52 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:34.031 20:44:52 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:34.031 20:44:52 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:34.031 20:44:52 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:34.031 20:44:52 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:34.031 20:44:52 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:34.031 20:44:52 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:34.031 20:44:52 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:34.300 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:34.300 fio-3.35 00:27:34.300 Starting 1 thread 00:27:34.300 EAL: No free 2048 kB hugepages reported on node 1 00:27:36.840 00:27:36.840 test: (groupid=0, jobs=1): err= 0: pid=12435: Fri Apr 26 20:44:54 2024 00:27:36.840 read: IOPS=6662, BW=26.0MiB/s (27.3MB/s)(52.3MiB/2008msec) 00:27:36.840 slat (usec): min=2, max=104, avg= 2.20, stdev= 1.21 00:27:36.840 clat (usec): min=2639, max=17742, avg=10623.79, stdev=928.75 00:27:36.840 lat (usec): min=2658, max=17744, avg=10625.99, stdev=928.68 00:27:36.840 clat percentiles (usec): 00:27:36.840 | 1.00th=[ 8455], 5.00th=[ 9241], 10.00th=[ 9503], 20.00th=[ 9896], 00:27:36.840 | 30.00th=[10159], 40.00th=[10421], 50.00th=[10552], 60.00th=[10814], 00:27:36.840 | 70.00th=[11076], 80.00th=[11338], 90.00th=[11731], 95.00th=[11994], 00:27:36.840 | 99.00th=[12649], 99.50th=[13042], 99.90th=[15664], 99.95th=[16909], 00:27:36.840 | 99.99th=[17695] 00:27:36.840 bw ( KiB/s): min=25232, max=27408, per=99.90%, avg=26624.00, stdev=962.40, samples=4 00:27:36.840 iops : min= 6308, max= 6852, avg=6656.00, stdev=240.60, samples=4 00:27:36.840 write: IOPS=6671, BW=26.1MiB/s (27.3MB/s)(52.3MiB/2008msec); 0 zone resets 00:27:36.840 slat (nsec): min=2130, max=100036, avg=2306.55, stdev=896.88 00:27:36.840 clat (usec): min=1607, max=15601, avg=8415.49, stdev=786.58 00:27:36.840 lat (usec): min=1614, max=15603, avg=8417.79, stdev=786.56 00:27:36.840 clat percentiles (usec): 00:27:36.840 | 1.00th=[ 6587], 5.00th=[ 7242], 10.00th=[ 7504], 20.00th=[ 7832], 00:27:36.840 | 30.00th=[ 8029], 40.00th=[ 8225], 50.00th=[ 8455], 60.00th=[ 8586], 00:27:36.840 | 70.00th=[ 8848], 80.00th=[ 8979], 90.00th=[ 9372], 95.00th=[ 9634], 00:27:36.840 | 99.00th=[10159], 99.50th=[10421], 99.90th=[14091], 99.95th=[14353], 00:27:36.840 | 99.99th=[15533] 00:27:36.840 bw ( KiB/s): min=26432, max=26944, per=99.94%, avg=26672.00, stdev=234.42, samples=4 00:27:36.840 iops : min= 6608, max= 6736, avg=6668.00, stdev=58.61, samples=4 00:27:36.840 lat (msec) : 2=0.01%, 4=0.07%, 10=60.83%, 20=39.09% 00:27:36.840 cpu : usr=62.18%, sys=32.64%, ctx=50, majf=0, minf=6 00:27:36.840 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:36.840 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:36.840 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:36.840 issued rwts: total=13378,13397,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:36.840 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:36.840 00:27:36.840 Run status group 0 (all jobs): 00:27:36.840 READ: bw=26.0MiB/s (27.3MB/s), 26.0MiB/s-26.0MiB/s (27.3MB/s-27.3MB/s), io=52.3MiB (54.8MB), run=2008-2008msec 00:27:36.840 WRITE: bw=26.1MiB/s (27.3MB/s), 26.1MiB/s-26.1MiB/s (27.3MB/s-27.3MB/s), io=52.3MiB (54.9MB), run=2008-2008msec 00:27:36.840 20:44:54 -- host/fio.sh@70 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:27:36.840 20:44:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:36.840 20:44:54 -- common/autotest_common.sh@10 -- # set +x 00:27:36.840 20:44:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:36.840 20:44:54 -- host/fio.sh@72 -- # sync 00:27:36.840 20:44:54 -- host/fio.sh@74 -- # rpc_cmd bdev_lvol_delete lvs_n_0/lbd_nest_0 00:27:36.840 20:44:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:36.840 20:44:54 -- common/autotest_common.sh@10 -- # set +x 00:27:38.750 20:44:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:38.750 20:44:56 -- host/fio.sh@75 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_n_0 00:27:38.750 20:44:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:38.750 20:44:56 -- common/autotest_common.sh@10 -- # set +x 00:27:38.750 20:44:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:38.750 20:44:56 -- host/fio.sh@76 -- # rpc_cmd bdev_lvol_delete lvs_0/lbd_0 00:27:38.750 20:44:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:38.750 20:44:56 -- common/autotest_common.sh@10 -- # set +x 00:27:39.009 20:44:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.009 20:44:57 -- host/fio.sh@77 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_0 00:27:39.009 20:44:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.009 20:44:57 -- common/autotest_common.sh@10 -- # set +x 00:27:39.009 20:44:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:39.009 20:44:57 -- host/fio.sh@78 -- # rpc_cmd bdev_nvme_detach_controller Nvme0 00:27:39.009 20:44:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:39.009 20:44:57 -- common/autotest_common.sh@10 -- # set +x 00:27:40.919 20:44:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:40.919 20:44:58 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:27:40.919 20:44:58 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:27:40.919 20:44:58 -- host/fio.sh@84 -- # nvmftestfini 00:27:40.919 20:44:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:40.919 20:44:58 -- nvmf/common.sh@116 -- # sync 00:27:40.919 20:44:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:40.919 20:44:58 -- nvmf/common.sh@119 -- # set +e 00:27:40.919 20:44:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:40.919 20:44:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:40.919 rmmod nvme_tcp 00:27:40.919 rmmod nvme_fabrics 00:27:40.919 rmmod nvme_keyring 00:27:40.919 20:44:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:40.919 20:44:59 -- nvmf/common.sh@123 -- # set -e 00:27:40.919 20:44:59 -- nvmf/common.sh@124 -- # return 0 00:27:40.919 20:44:59 -- nvmf/common.sh@477 -- # '[' -n 9217 ']' 00:27:40.919 20:44:59 -- nvmf/common.sh@478 -- # killprocess 9217 00:27:40.919 20:44:59 -- common/autotest_common.sh@926 -- # '[' -z 9217 ']' 00:27:40.919 20:44:59 -- common/autotest_common.sh@930 -- # kill -0 9217 00:27:40.919 20:44:59 -- common/autotest_common.sh@931 -- # uname 00:27:40.919 20:44:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:40.919 20:44:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 9217 00:27:40.919 20:44:59 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:40.919 20:44:59 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:40.919 20:44:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 9217' 00:27:40.919 killing process with pid 9217 00:27:40.919 20:44:59 -- common/autotest_common.sh@945 -- # kill 9217 00:27:40.919 20:44:59 -- common/autotest_common.sh@950 -- # wait 9217 00:27:40.919 20:44:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:40.919 20:44:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:40.919 20:44:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:40.919 20:44:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:40.919 20:44:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:40.919 20:44:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:40.919 20:44:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:40.919 20:44:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:43.459 20:45:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:43.459 00:27:43.459 real 0m28.519s 00:27:43.459 user 2m26.774s 00:27:43.459 sys 0m9.208s 00:27:43.459 20:45:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:43.459 20:45:01 -- common/autotest_common.sh@10 -- # set +x 00:27:43.459 ************************************ 00:27:43.459 END TEST nvmf_fio_host 00:27:43.459 ************************************ 00:27:43.459 20:45:01 -- nvmf/nvmf.sh@99 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:43.459 20:45:01 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:43.459 20:45:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:43.459 20:45:01 -- common/autotest_common.sh@10 -- # set +x 00:27:43.459 ************************************ 00:27:43.459 START TEST nvmf_failover 00:27:43.459 ************************************ 00:27:43.459 20:45:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:43.459 * Looking for test storage... 00:27:43.459 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:43.459 20:45:01 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:43.459 20:45:01 -- nvmf/common.sh@7 -- # uname -s 00:27:43.459 20:45:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:43.459 20:45:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:43.459 20:45:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:43.459 20:45:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:43.459 20:45:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:43.459 20:45:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:43.459 20:45:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:43.459 20:45:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:43.459 20:45:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:43.459 20:45:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:43.459 20:45:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:27:43.459 20:45:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:27:43.459 20:45:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:43.459 20:45:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:43.459 20:45:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:43.459 20:45:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:43.459 20:45:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:43.459 20:45:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:43.459 20:45:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:43.459 20:45:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:43.459 20:45:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:43.459 20:45:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:43.459 20:45:01 -- paths/export.sh@5 -- # export PATH 00:27:43.459 20:45:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:43.459 20:45:01 -- nvmf/common.sh@46 -- # : 0 00:27:43.459 20:45:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:43.459 20:45:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:43.459 20:45:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:43.459 20:45:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:43.459 20:45:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:43.459 20:45:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:43.459 20:45:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:43.459 20:45:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:43.459 20:45:01 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:43.459 20:45:01 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:43.459 20:45:01 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:43.459 20:45:01 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:27:43.459 20:45:01 -- host/failover.sh@18 -- # nvmftestinit 00:27:43.459 20:45:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:43.459 20:45:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:43.459 20:45:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:43.459 20:45:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:43.459 20:45:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:43.459 20:45:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:43.459 20:45:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:43.459 20:45:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:43.459 20:45:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:43.459 20:45:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:43.459 20:45:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:43.459 20:45:01 -- common/autotest_common.sh@10 -- # set +x 00:27:50.042 20:45:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:50.042 20:45:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:50.042 20:45:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:50.042 20:45:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:50.042 20:45:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:50.042 20:45:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:50.043 20:45:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:50.043 20:45:08 -- nvmf/common.sh@294 -- # net_devs=() 00:27:50.043 20:45:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:50.043 20:45:08 -- nvmf/common.sh@295 -- # e810=() 00:27:50.043 20:45:08 -- nvmf/common.sh@295 -- # local -ga e810 00:27:50.043 20:45:08 -- nvmf/common.sh@296 -- # x722=() 00:27:50.043 20:45:08 -- nvmf/common.sh@296 -- # local -ga x722 00:27:50.043 20:45:08 -- nvmf/common.sh@297 -- # mlx=() 00:27:50.043 20:45:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:50.043 20:45:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:50.043 20:45:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:50.043 20:45:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:50.043 20:45:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:50.043 20:45:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:50.043 20:45:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:50.043 20:45:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:50.043 20:45:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:50.043 20:45:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:50.043 20:45:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:50.043 20:45:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:50.043 20:45:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:50.043 20:45:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:50.043 20:45:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:50.043 20:45:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:50.043 20:45:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:27:50.043 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:27:50.043 20:45:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:50.043 20:45:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:27:50.043 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:27:50.043 20:45:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:50.043 20:45:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:50.043 20:45:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:50.043 20:45:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:50.043 20:45:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:50.043 20:45:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:27:50.043 Found net devices under 0000:4b:00.0: cvl_0_0 00:27:50.043 20:45:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:50.043 20:45:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:50.043 20:45:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:50.043 20:45:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:50.043 20:45:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:50.043 20:45:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:27:50.043 Found net devices under 0000:4b:00.1: cvl_0_1 00:27:50.043 20:45:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:50.043 20:45:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:50.043 20:45:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:50.043 20:45:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:50.043 20:45:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:50.043 20:45:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:50.043 20:45:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:50.043 20:45:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:50.043 20:45:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:50.043 20:45:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:50.043 20:45:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:50.043 20:45:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:50.043 20:45:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:50.043 20:45:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:50.043 20:45:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:50.043 20:45:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:50.043 20:45:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:50.043 20:45:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:50.043 20:45:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:50.043 20:45:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:50.043 20:45:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:50.043 20:45:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:50.043 20:45:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:50.043 20:45:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:50.043 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:50.043 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.411 ms 00:27:50.043 00:27:50.043 --- 10.0.0.2 ping statistics --- 00:27:50.043 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:50.043 rtt min/avg/max/mdev = 0.411/0.411/0.411/0.000 ms 00:27:50.043 20:45:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:50.043 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:50.043 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.223 ms 00:27:50.043 00:27:50.043 --- 10.0.0.1 ping statistics --- 00:27:50.043 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:50.043 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:27:50.043 20:45:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:50.043 20:45:08 -- nvmf/common.sh@410 -- # return 0 00:27:50.043 20:45:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:50.043 20:45:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:50.043 20:45:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:50.043 20:45:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:50.043 20:45:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:50.043 20:45:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:50.303 20:45:08 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:27:50.303 20:45:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:50.303 20:45:08 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:50.303 20:45:08 -- common/autotest_common.sh@10 -- # set +x 00:27:50.303 20:45:08 -- nvmf/common.sh@469 -- # nvmfpid=17869 00:27:50.303 20:45:08 -- nvmf/common.sh@470 -- # waitforlisten 17869 00:27:50.303 20:45:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:50.303 20:45:08 -- common/autotest_common.sh@819 -- # '[' -z 17869 ']' 00:27:50.303 20:45:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:50.303 20:45:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:50.303 20:45:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:50.303 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:50.303 20:45:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:50.303 20:45:08 -- common/autotest_common.sh@10 -- # set +x 00:27:50.303 [2024-04-26 20:45:08.449119] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:27:50.303 [2024-04-26 20:45:08.449182] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:50.303 EAL: No free 2048 kB hugepages reported on node 1 00:27:50.303 [2024-04-26 20:45:08.519175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:50.303 [2024-04-26 20:45:08.590866] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:50.304 [2024-04-26 20:45:08.590985] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:50.304 [2024-04-26 20:45:08.590993] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:50.304 [2024-04-26 20:45:08.591001] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:50.304 [2024-04-26 20:45:08.591121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:50.304 [2024-04-26 20:45:08.591264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:50.304 [2024-04-26 20:45:08.591266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:50.900 20:45:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:50.900 20:45:09 -- common/autotest_common.sh@852 -- # return 0 00:27:50.900 20:45:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:50.900 20:45:09 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:50.900 20:45:09 -- common/autotest_common.sh@10 -- # set +x 00:27:51.173 20:45:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:51.173 20:45:09 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:51.173 [2024-04-26 20:45:09.407317] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:51.173 20:45:09 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:27:51.435 Malloc0 00:27:51.435 20:45:09 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:51.695 20:45:09 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:51.695 20:45:09 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:51.955 [2024-04-26 20:45:10.099403] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:51.955 20:45:10 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:27:51.955 [2024-04-26 20:45:10.267867] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:27:51.955 20:45:10 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:27:52.215 [2024-04-26 20:45:10.432382] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:27:52.215 20:45:10 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:27:52.215 20:45:10 -- host/failover.sh@31 -- # bdevperf_pid=18598 00:27:52.215 20:45:10 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:52.215 20:45:10 -- host/failover.sh@34 -- # waitforlisten 18598 /var/tmp/bdevperf.sock 00:27:52.215 20:45:10 -- common/autotest_common.sh@819 -- # '[' -z 18598 ']' 00:27:52.215 20:45:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:27:52.215 20:45:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:52.215 20:45:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:27:52.215 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:27:52.215 20:45:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:52.215 20:45:10 -- common/autotest_common.sh@10 -- # set +x 00:27:53.157 20:45:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:53.157 20:45:11 -- common/autotest_common.sh@852 -- # return 0 00:27:53.157 20:45:11 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:53.420 NVMe0n1 00:27:53.420 20:45:11 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:53.681 00:27:53.681 20:45:11 -- host/failover.sh@39 -- # run_test_pid=19076 00:27:53.681 20:45:11 -- host/failover.sh@41 -- # sleep 1 00:27:53.681 20:45:11 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:27:54.623 20:45:12 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:54.885 [2024-04-26 20:45:13.094123] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094163] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094174] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094183] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094188] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094192] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094197] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094201] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094205] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094210] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094214] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094218] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094223] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094227] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094231] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094236] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094240] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094249] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094253] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094257] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094262] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094266] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094271] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094275] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094285] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094290] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094294] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094298] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094303] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094308] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094313] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.885 [2024-04-26 20:45:13.094317] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.886 [2024-04-26 20:45:13.094322] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.886 [2024-04-26 20:45:13.094326] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.886 [2024-04-26 20:45:13.094330] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.886 [2024-04-26 20:45:13.094335] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.886 [2024-04-26 20:45:13.094339] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.886 [2024-04-26 20:45:13.094343] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231c380 is same with the state(5) to be set 00:27:54.886 20:45:13 -- host/failover.sh@45 -- # sleep 3 00:27:58.191 20:45:16 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:58.191 00:27:58.191 20:45:16 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:27:58.453 [2024-04-26 20:45:16.550716] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550762] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550770] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550777] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550783] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550790] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550796] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550803] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550809] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550815] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550821] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550827] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550834] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550840] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550846] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550858] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550865] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550871] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550877] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.453 [2024-04-26 20:45:16.550883] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550890] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550896] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550902] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550909] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550915] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550921] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550927] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550933] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550940] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550946] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550952] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550958] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550964] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550971] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550977] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550983] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.550997] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551003] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551009] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551016] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551022] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551030] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551036] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551043] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551050] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551056] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551063] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551069] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551075] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551082] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551088] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551094] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551100] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551107] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551114] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551121] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551127] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551134] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 [2024-04-26 20:45:16.551140] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231d230 is same with the state(5) to be set 00:27:58.454 20:45:16 -- host/failover.sh@50 -- # sleep 3 00:28:01.761 20:45:19 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:01.761 [2024-04-26 20:45:19.723560] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:01.761 20:45:19 -- host/failover.sh@55 -- # sleep 1 00:28:02.704 20:45:20 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:02.704 [2024-04-26 20:45:20.899387] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899422] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899429] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899436] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899443] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899455] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899462] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899468] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899475] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899481] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899487] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899493] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899500] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899506] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899512] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899518] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899525] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899532] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899538] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899544] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899550] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899557] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899563] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899569] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899576] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899582] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899589] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899595] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899601] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899607] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 [2024-04-26 20:45:20.899614] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x231df20 is same with the state(5) to be set 00:28:02.704 20:45:20 -- host/failover.sh@59 -- # wait 19076 00:28:09.300 0 00:28:09.300 20:45:27 -- host/failover.sh@61 -- # killprocess 18598 00:28:09.300 20:45:27 -- common/autotest_common.sh@926 -- # '[' -z 18598 ']' 00:28:09.300 20:45:27 -- common/autotest_common.sh@930 -- # kill -0 18598 00:28:09.300 20:45:27 -- common/autotest_common.sh@931 -- # uname 00:28:09.300 20:45:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:09.300 20:45:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 18598 00:28:09.300 20:45:27 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:09.300 20:45:27 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:09.300 20:45:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 18598' 00:28:09.300 killing process with pid 18598 00:28:09.300 20:45:27 -- common/autotest_common.sh@945 -- # kill 18598 00:28:09.300 20:45:27 -- common/autotest_common.sh@950 -- # wait 18598 00:28:09.300 20:45:27 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:09.300 [2024-04-26 20:45:10.494651] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:28:09.300 [2024-04-26 20:45:10.494709] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid18598 ] 00:28:09.300 EAL: No free 2048 kB hugepages reported on node 1 00:28:09.300 [2024-04-26 20:45:10.553153] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:09.300 [2024-04-26 20:45:10.615200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:09.300 Running I/O for 15 seconds... 00:28:09.300 [2024-04-26 20:45:13.094873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:32400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.300 [2024-04-26 20:45:13.094906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.300 [2024-04-26 20:45:13.094923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:32408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.300 [2024-04-26 20:45:13.094931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.300 [2024-04-26 20:45:13.094941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:32416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.300 [2024-04-26 20:45:13.094948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.300 [2024-04-26 20:45:13.094958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.300 [2024-04-26 20:45:13.094965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.300 [2024-04-26 20:45:13.094974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:32880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.300 [2024-04-26 20:45:13.094981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.300 [2024-04-26 20:45:13.094990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:32904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.300 [2024-04-26 20:45:13.094998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.300 [2024-04-26 20:45:13.095007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:32912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.300 [2024-04-26 20:45:13.095014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.300 [2024-04-26 20:45:13.095023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.300 [2024-04-26 20:45:13.095030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.300 [2024-04-26 20:45:13.095039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:32944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.300 [2024-04-26 20:45:13.095046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.300 [2024-04-26 20:45:13.095056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:32952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.300 [2024-04-26 20:45:13.095063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.300 [2024-04-26 20:45:13.095072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:32960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:32968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:32992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.301 [2024-04-26 20:45:13.095151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:33000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:33008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:32456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:32464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:32536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:32544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:32560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:32576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:33016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.301 [2024-04-26 20:45:13.095323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:33024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:33032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.301 [2024-04-26 20:45:13.095355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:33040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:33048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.301 [2024-04-26 20:45:13.095388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:33056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.301 [2024-04-26 20:45:13.095404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:33064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.301 [2024-04-26 20:45:13.095436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:33080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:33088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.301 [2024-04-26 20:45:13.095486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:33112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:33144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.301 [2024-04-26 20:45:13.095587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:33152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:33160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.301 [2024-04-26 20:45:13.095619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.301 [2024-04-26 20:45:13.095635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:32608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:32632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:32640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.301 [2024-04-26 20:45:13.095709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:32648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.301 [2024-04-26 20:45:13.095718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:32656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.095734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.095750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.302 [2024-04-26 20:45:13.095766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:33184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.302 [2024-04-26 20:45:13.095782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:33192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.302 [2024-04-26 20:45:13.095798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:33200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.302 [2024-04-26 20:45:13.095814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:33208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.095830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:33216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.095847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:33224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.095863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:33232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.095879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.095895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:33248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.095911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:33256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.302 [2024-04-26 20:45:13.095928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:33264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.095945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.095960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:33280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.302 [2024-04-26 20:45:13.095977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.095986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.095993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:33296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:33304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:32704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:32712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:32728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:32752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:32776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:32784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:33312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.302 [2024-04-26 20:45:13.096173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:33320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.302 [2024-04-26 20:45:13.096189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:33328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:33344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.302 [2024-04-26 20:45:13.096241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:33352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.302 [2024-04-26 20:45:13.096257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:33360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.302 [2024-04-26 20:45:13.096273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:33368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.302 [2024-04-26 20:45:13.096293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:33376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.302 [2024-04-26 20:45:13.096325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:33392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.302 [2024-04-26 20:45:13.096343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.302 [2024-04-26 20:45:13.096352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:33400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.303 [2024-04-26 20:45:13.096359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:33408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.303 [2024-04-26 20:45:13.096375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:33416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.303 [2024-04-26 20:45:13.096391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:33424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.303 [2024-04-26 20:45:13.096407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:33432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.303 [2024-04-26 20:45:13.096423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:33440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.303 [2024-04-26 20:45:13.096439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:33448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.303 [2024-04-26 20:45:13.096455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:33456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:33472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:33480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.303 [2024-04-26 20:45:13.096520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:32800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:32832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:32840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:32856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:32864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:32888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:32896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:33488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:33496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:33512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:33528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:33544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:33552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.303 [2024-04-26 20:45:13.096818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:33560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.303 [2024-04-26 20:45:13.096835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.303 [2024-04-26 20:45:13.096844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:33568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.304 [2024-04-26 20:45:13.096851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.096860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:33576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.304 [2024-04-26 20:45:13.096867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.096877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:33584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.304 [2024-04-26 20:45:13.096884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.096893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.304 [2024-04-26 20:45:13.096900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.096910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:33600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.304 [2024-04-26 20:45:13.096917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.096927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.304 [2024-04-26 20:45:13.096934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.096943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:33616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.304 [2024-04-26 20:45:13.096951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.096960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.304 [2024-04-26 20:45:13.096972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.096981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:33632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.304 [2024-04-26 20:45:13.096988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.096997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:33640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.304 [2024-04-26 20:45:13.097004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.097027] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:09.304 [2024-04-26 20:45:13.097033] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:09.304 [2024-04-26 20:45:13.097040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:32936 len:8 PRP1 0x0 PRP2 0x0 00:28:09.304 [2024-04-26 20:45:13.097047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.097083] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d9b6d0 was disconnected and freed. reset controller. 00:28:09.304 [2024-04-26 20:45:13.097096] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:09.304 [2024-04-26 20:45:13.097115] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:09.304 [2024-04-26 20:45:13.097123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.097131] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:09.304 [2024-04-26 20:45:13.097138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.097146] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:09.304 [2024-04-26 20:45:13.097153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.097160] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:09.304 [2024-04-26 20:45:13.097167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:13.097175] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:09.304 [2024-04-26 20:45:13.097207] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d8b130 (9): Bad file descriptor 00:28:09.304 [2024-04-26 20:45:13.099369] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:09.304 [2024-04-26 20:45:13.172104] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:09.304 [2024-04-26 20:45:16.551433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:50072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.304 [2024-04-26 20:45:16.551468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:16.551485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:50096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.304 [2024-04-26 20:45:16.551494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:16.551509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:50112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.304 [2024-04-26 20:45:16.551517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:16.551526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:49456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.304 [2024-04-26 20:45:16.551533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:16.551543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:49472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.304 [2024-04-26 20:45:16.551550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:16.551560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:49480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.304 [2024-04-26 20:45:16.551567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:16.551577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:49512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.304 [2024-04-26 20:45:16.551584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:16.551593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:49536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.304 [2024-04-26 20:45:16.551601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:16.551610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:49568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.304 [2024-04-26 20:45:16.551617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.304 [2024-04-26 20:45:16.551627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:49576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:49592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:50136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:49624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:49640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:49656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:49664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:49680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:49696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:49712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:49728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:50160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:50168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:50176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:50184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:50200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:50208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:50232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:50240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:50248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:50264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:50272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.551985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.551995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:50288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.305 [2024-04-26 20:45:16.552002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.305 [2024-04-26 20:45:16.552011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:50304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:49768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:49800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:49808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:49816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:49824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:49848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:49856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:49864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:50328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.306 [2024-04-26 20:45:16.552171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:50336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:50344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:50352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.306 [2024-04-26 20:45:16.552220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:50360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.306 [2024-04-26 20:45:16.552237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:50368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:50376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:50384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:50392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.306 [2024-04-26 20:45:16.552307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:50400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:50408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.306 [2024-04-26 20:45:16.552340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:50416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.306 [2024-04-26 20:45:16.552358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:50424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:50432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:50440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.306 [2024-04-26 20:45:16.552407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.306 [2024-04-26 20:45:16.552416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:50448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.306 [2024-04-26 20:45:16.552423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:50456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:50464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:49872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:49880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:49896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:49928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:49936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:49944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:49952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:49960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:49968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:50000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:50008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:50016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:50024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:50040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:50048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:50056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:50472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.307 [2024-04-26 20:45:16.552739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:50480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:50488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:50496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:50504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.307 [2024-04-26 20:45:16.552806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:50512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.307 [2024-04-26 20:45:16.552823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:50520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.307 [2024-04-26 20:45:16.552839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:50528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.307 [2024-04-26 20:45:16.552855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.307 [2024-04-26 20:45:16.552864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:50536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.308 [2024-04-26 20:45:16.552871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.552881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:50544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.552888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.552897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:50552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.308 [2024-04-26 20:45:16.552904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.552914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:50560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.552921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.552930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:50568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.308 [2024-04-26 20:45:16.552937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.552946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:50576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.308 [2024-04-26 20:45:16.552953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.552962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:50584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.552969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.552980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:50592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.552987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.552997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:50600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:50608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:50616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.308 [2024-04-26 20:45:16.553037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:50624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:50632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.308 [2024-04-26 20:45:16.553069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:50640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:50648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.308 [2024-04-26 20:45:16.553102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:50656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.308 [2024-04-26 20:45:16.553119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:50664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:50064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:50080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:50088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:50104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:50120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:50128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:50144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:50152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:50672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.308 [2024-04-26 20:45:16.553288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.308 [2024-04-26 20:45:16.553297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:50680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.308 [2024-04-26 20:45:16.553305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:50688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.309 [2024-04-26 20:45:16.553321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:50696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.309 [2024-04-26 20:45:16.553337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:50704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.309 [2024-04-26 20:45:16.553353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:50712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.309 [2024-04-26 20:45:16.553370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:50720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.309 [2024-04-26 20:45:16.553387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:50728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.309 [2024-04-26 20:45:16.553409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:50736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.309 [2024-04-26 20:45:16.553425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:50744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.309 [2024-04-26 20:45:16.553442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:50752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.309 [2024-04-26 20:45:16.553458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:50760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.309 [2024-04-26 20:45:16.553475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:50192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.309 [2024-04-26 20:45:16.553491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:50216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.309 [2024-04-26 20:45:16.553507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:50224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.309 [2024-04-26 20:45:16.553524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:50256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.309 [2024-04-26 20:45:16.553540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:50280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.309 [2024-04-26 20:45:16.553557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:50296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.309 [2024-04-26 20:45:16.553573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:50312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.309 [2024-04-26 20:45:16.553589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d9d660 is same with the state(5) to be set 00:28:09.309 [2024-04-26 20:45:16.553606] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:09.309 [2024-04-26 20:45:16.553614] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:09.309 [2024-04-26 20:45:16.553621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:50320 len:8 PRP1 0x0 PRP2 0x0 00:28:09.309 [2024-04-26 20:45:16.553628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553663] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d9d660 was disconnected and freed. reset controller. 00:28:09.309 [2024-04-26 20:45:16.553673] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:09.309 [2024-04-26 20:45:16.553692] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:09.309 [2024-04-26 20:45:16.553700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553708] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:09.309 [2024-04-26 20:45:16.553715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553722] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:09.309 [2024-04-26 20:45:16.553729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553737] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:09.309 [2024-04-26 20:45:16.553744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:16.553751] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:09.309 [2024-04-26 20:45:16.556173] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:09.309 [2024-04-26 20:45:16.556195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d8b130 (9): Bad file descriptor 00:28:09.309 [2024-04-26 20:45:16.596979] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:09.309 [2024-04-26 20:45:20.898637] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:09.309 [2024-04-26 20:45:20.898680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.309 [2024-04-26 20:45:20.898691] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:09.309 [2024-04-26 20:45:20.898698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.898706] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:09.310 [2024-04-26 20:45:20.898713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.898721] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:09.310 [2024-04-26 20:45:20.898728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.898735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d8b130 is same with the state(5) to be set 00:28:09.310 [2024-04-26 20:45:20.899978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:26656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:27024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:27040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:27088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:27096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:27152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:27160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:27200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:27256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:27264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:26688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:26712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:26752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:26776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:26832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:26856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:26880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:27304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:27312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:27320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.310 [2024-04-26 20:45:20.900395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.310 [2024-04-26 20:45:20.900404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:27328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.310 [2024-04-26 20:45:20.900411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:27336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:27344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:27352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.311 [2024-04-26 20:45:20.900462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:27360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:27368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:27376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:27384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:27392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.311 [2024-04-26 20:45:20.900543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:27400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:27408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.311 [2024-04-26 20:45:20.900575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:27416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:27424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.311 [2024-04-26 20:45:20.900608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:27432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:27440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:27448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:27456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.311 [2024-04-26 20:45:20.900689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:27472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.311 [2024-04-26 20:45:20.900721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:27488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.311 [2024-04-26 20:45:20.900737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:27496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.311 [2024-04-26 20:45:20.900769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:27512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.311 [2024-04-26 20:45:20.900785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:26888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.311 [2024-04-26 20:45:20.900801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:26904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.311 [2024-04-26 20:45:20.900817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:26912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.311 [2024-04-26 20:45:20.900833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:26920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.311 [2024-04-26 20:45:20.900851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.311 [2024-04-26 20:45:20.900860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.900867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.900876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.900883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.900893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:26976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.900900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.900909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:27016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.900916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.900925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:27520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.900932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.900941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:27528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.312 [2024-04-26 20:45:20.900948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.900957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:27536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.312 [2024-04-26 20:45:20.900964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.900973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:27544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.900980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.900989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:27552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.900996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:27560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.312 [2024-04-26 20:45:20.901012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:27568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.312 [2024-04-26 20:45:20.901028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:27576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.312 [2024-04-26 20:45:20.901045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:27584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.901062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:27592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.901079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.312 [2024-04-26 20:45:20.901095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:27608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.312 [2024-04-26 20:45:20.901112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:27616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.312 [2024-04-26 20:45:20.901128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:27624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.901144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:27632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.312 [2024-04-26 20:45:20.901160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:27640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.901176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:27648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.312 [2024-04-26 20:45:20.901192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:27656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.312 [2024-04-26 20:45:20.901208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.312 [2024-04-26 20:45:20.901224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:27672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.901239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:27680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.901257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:27688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.312 [2024-04-26 20:45:20.901273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.312 [2024-04-26 20:45:20.901286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:27696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.313 [2024-04-26 20:45:20.901293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:27704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.313 [2024-04-26 20:45:20.901308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:27712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.313 [2024-04-26 20:45:20.901326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:27032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:27048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:27056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:27064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:27072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:27104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:27112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:27720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:27744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:27752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:27760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:27768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.313 [2024-04-26 20:45:20.901552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:27776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.313 [2024-04-26 20:45:20.901568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:27784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.313 [2024-04-26 20:45:20.901588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:27792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.313 [2024-04-26 20:45:20.901604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:27824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.313 [2024-04-26 20:45:20.901671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:27832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.313 [2024-04-26 20:45:20.901720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:27864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.313 [2024-04-26 20:45:20.901752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:27872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.313 [2024-04-26 20:45:20.901800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:27896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:09.313 [2024-04-26 20:45:20.901817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:27120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:27128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.313 [2024-04-26 20:45:20.901876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.313 [2024-04-26 20:45:20.901883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.901892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:27144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.314 [2024-04-26 20:45:20.901899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.901908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:27168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.314 [2024-04-26 20:45:20.901915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.901925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:27184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.314 [2024-04-26 20:45:20.901931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.901940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.314 [2024-04-26 20:45:20.901947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.901956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.314 [2024-04-26 20:45:20.901963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.901972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.314 [2024-04-26 20:45:20.901979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.901988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:27224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.314 [2024-04-26 20:45:20.901995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.902005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:27232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.314 [2024-04-26 20:45:20.902012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.902021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:27240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.314 [2024-04-26 20:45:20.902028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.902036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.314 [2024-04-26 20:45:20.902043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.902052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:27272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.314 [2024-04-26 20:45:20.902060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.902069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:27280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:09.314 [2024-04-26 20:45:20.902077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.902097] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:09.314 [2024-04-26 20:45:20.902103] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:09.314 [2024-04-26 20:45:20.902110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:27296 len:8 PRP1 0x0 PRP2 0x0 00:28:09.314 [2024-04-26 20:45:20.902119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:09.314 [2024-04-26 20:45:20.902157] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1da1500 was disconnected and freed. reset controller. 00:28:09.314 [2024-04-26 20:45:20.902167] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:09.314 [2024-04-26 20:45:20.902174] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:09.314 [2024-04-26 20:45:20.904281] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:09.314 [2024-04-26 20:45:20.904303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d8b130 (9): Bad file descriptor 00:28:09.314 [2024-04-26 20:45:20.931425] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:09.314 00:28:09.314 Latency(us) 00:28:09.314 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:09.314 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:09.314 Verification LBA range: start 0x0 length 0x4000 00:28:09.314 NVMe0n1 : 15.01 14270.44 55.74 531.84 0.00 8629.19 1208.32 20206.93 00:28:09.314 =================================================================================================================== 00:28:09.314 Total : 14270.44 55.74 531.84 0.00 8629.19 1208.32 20206.93 00:28:09.314 Received shutdown signal, test time was about 15.000000 seconds 00:28:09.314 00:28:09.314 Latency(us) 00:28:09.314 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:09.314 =================================================================================================================== 00:28:09.314 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:09.314 20:45:27 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:09.314 20:45:27 -- host/failover.sh@65 -- # count=3 00:28:09.314 20:45:27 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:09.314 20:45:27 -- host/failover.sh@73 -- # bdevperf_pid=21952 00:28:09.314 20:45:27 -- host/failover.sh@75 -- # waitforlisten 21952 /var/tmp/bdevperf.sock 00:28:09.314 20:45:27 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:09.314 20:45:27 -- common/autotest_common.sh@819 -- # '[' -z 21952 ']' 00:28:09.314 20:45:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:09.314 20:45:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:09.314 20:45:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:09.314 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:09.314 20:45:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:09.314 20:45:27 -- common/autotest_common.sh@10 -- # set +x 00:28:09.886 20:45:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:09.886 20:45:28 -- common/autotest_common.sh@852 -- # return 0 00:28:09.886 20:45:28 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:10.146 [2024-04-26 20:45:28.231295] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:10.146 20:45:28 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:10.146 [2024-04-26 20:45:28.399722] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:10.147 20:45:28 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:10.719 NVMe0n1 00:28:10.719 20:45:28 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:10.980 00:28:10.980 20:45:29 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:11.242 00:28:11.242 20:45:29 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:11.242 20:45:29 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:11.505 20:45:29 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:11.505 20:45:29 -- host/failover.sh@87 -- # sleep 3 00:28:14.809 20:45:32 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:14.809 20:45:32 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:14.809 20:45:32 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:14.809 20:45:32 -- host/failover.sh@90 -- # run_test_pid=23162 00:28:14.809 20:45:32 -- host/failover.sh@92 -- # wait 23162 00:28:15.747 0 00:28:16.010 20:45:34 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:16.010 [2024-04-26 20:45:27.327838] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:28:16.010 [2024-04-26 20:45:27.327895] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid21952 ] 00:28:16.010 EAL: No free 2048 kB hugepages reported on node 1 00:28:16.010 [2024-04-26 20:45:27.386916] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:16.010 [2024-04-26 20:45:27.448753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:16.010 [2024-04-26 20:45:29.791877] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:16.010 [2024-04-26 20:45:29.791919] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.010 [2024-04-26 20:45:29.791930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.010 [2024-04-26 20:45:29.791939] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.010 [2024-04-26 20:45:29.791946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.010 [2024-04-26 20:45:29.791954] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.010 [2024-04-26 20:45:29.791962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.010 [2024-04-26 20:45:29.791969] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:16.010 [2024-04-26 20:45:29.791976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:16.010 [2024-04-26 20:45:29.791983] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:16.010 [2024-04-26 20:45:29.792005] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:16.010 [2024-04-26 20:45:29.792019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1574130 (9): Bad file descriptor 00:28:16.010 [2024-04-26 20:45:29.846825] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:16.010 Running I/O for 1 seconds... 00:28:16.010 00:28:16.010 Latency(us) 00:28:16.010 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:16.010 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:16.010 Verification LBA range: start 0x0 length 0x4000 00:28:16.010 NVMe0n1 : 1.01 13857.61 54.13 0.00 0.00 9195.71 1338.03 20425.39 00:28:16.010 =================================================================================================================== 00:28:16.010 Total : 13857.61 54.13 0.00 0.00 9195.71 1338.03 20425.39 00:28:16.010 20:45:34 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:16.010 20:45:34 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:16.010 20:45:34 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:16.271 20:45:34 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:16.271 20:45:34 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:16.271 20:45:34 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:16.533 20:45:34 -- host/failover.sh@101 -- # sleep 3 00:28:19.834 20:45:37 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:19.834 20:45:37 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:19.834 20:45:37 -- host/failover.sh@108 -- # killprocess 21952 00:28:19.834 20:45:37 -- common/autotest_common.sh@926 -- # '[' -z 21952 ']' 00:28:19.834 20:45:37 -- common/autotest_common.sh@930 -- # kill -0 21952 00:28:19.834 20:45:37 -- common/autotest_common.sh@931 -- # uname 00:28:19.834 20:45:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:19.834 20:45:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 21952 00:28:19.834 20:45:38 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:19.834 20:45:38 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:19.834 20:45:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 21952' 00:28:19.834 killing process with pid 21952 00:28:19.834 20:45:38 -- common/autotest_common.sh@945 -- # kill 21952 00:28:19.834 20:45:38 -- common/autotest_common.sh@950 -- # wait 21952 00:28:19.834 20:45:38 -- host/failover.sh@110 -- # sync 00:28:19.834 20:45:38 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:20.094 20:45:38 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:20.094 20:45:38 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:20.094 20:45:38 -- host/failover.sh@116 -- # nvmftestfini 00:28:20.094 20:45:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:20.094 20:45:38 -- nvmf/common.sh@116 -- # sync 00:28:20.094 20:45:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:20.094 20:45:38 -- nvmf/common.sh@119 -- # set +e 00:28:20.094 20:45:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:20.094 20:45:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:20.094 rmmod nvme_tcp 00:28:20.094 rmmod nvme_fabrics 00:28:20.094 rmmod nvme_keyring 00:28:20.094 20:45:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:20.094 20:45:38 -- nvmf/common.sh@123 -- # set -e 00:28:20.094 20:45:38 -- nvmf/common.sh@124 -- # return 0 00:28:20.094 20:45:38 -- nvmf/common.sh@477 -- # '[' -n 17869 ']' 00:28:20.094 20:45:38 -- nvmf/common.sh@478 -- # killprocess 17869 00:28:20.094 20:45:38 -- common/autotest_common.sh@926 -- # '[' -z 17869 ']' 00:28:20.094 20:45:38 -- common/autotest_common.sh@930 -- # kill -0 17869 00:28:20.094 20:45:38 -- common/autotest_common.sh@931 -- # uname 00:28:20.094 20:45:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:20.094 20:45:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 17869 00:28:20.094 20:45:38 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:20.094 20:45:38 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:20.094 20:45:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 17869' 00:28:20.094 killing process with pid 17869 00:28:20.094 20:45:38 -- common/autotest_common.sh@945 -- # kill 17869 00:28:20.094 20:45:38 -- common/autotest_common.sh@950 -- # wait 17869 00:28:20.353 20:45:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:20.353 20:45:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:20.353 20:45:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:20.353 20:45:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:20.353 20:45:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:20.353 20:45:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:20.353 20:45:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:20.353 20:45:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:22.899 20:45:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:22.899 00:28:22.899 real 0m39.253s 00:28:22.899 user 2m2.295s 00:28:22.899 sys 0m7.765s 00:28:22.899 20:45:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:22.899 20:45:40 -- common/autotest_common.sh@10 -- # set +x 00:28:22.899 ************************************ 00:28:22.899 END TEST nvmf_failover 00:28:22.899 ************************************ 00:28:22.899 20:45:40 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:22.899 20:45:40 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:28:22.899 20:45:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:22.899 20:45:40 -- common/autotest_common.sh@10 -- # set +x 00:28:22.899 ************************************ 00:28:22.899 START TEST nvmf_discovery 00:28:22.899 ************************************ 00:28:22.899 20:45:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:22.899 * Looking for test storage... 00:28:22.899 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:22.899 20:45:40 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:22.899 20:45:40 -- nvmf/common.sh@7 -- # uname -s 00:28:22.899 20:45:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:22.899 20:45:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:22.899 20:45:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:22.899 20:45:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:22.899 20:45:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:22.899 20:45:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:22.899 20:45:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:22.899 20:45:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:22.899 20:45:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:22.899 20:45:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:22.899 20:45:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:28:22.899 20:45:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:28:22.899 20:45:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:22.899 20:45:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:22.899 20:45:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:22.899 20:45:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:22.899 20:45:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:22.899 20:45:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:22.899 20:45:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:22.899 20:45:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.899 20:45:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.899 20:45:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.899 20:45:40 -- paths/export.sh@5 -- # export PATH 00:28:22.899 20:45:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.899 20:45:40 -- nvmf/common.sh@46 -- # : 0 00:28:22.899 20:45:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:22.899 20:45:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:22.899 20:45:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:22.899 20:45:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:22.899 20:45:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:22.899 20:45:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:22.899 20:45:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:22.899 20:45:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:22.899 20:45:40 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:22.899 20:45:40 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:22.899 20:45:40 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:22.899 20:45:40 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:22.899 20:45:40 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:22.899 20:45:40 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:22.899 20:45:40 -- host/discovery.sh@25 -- # nvmftestinit 00:28:22.899 20:45:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:22.899 20:45:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:22.899 20:45:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:22.899 20:45:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:22.899 20:45:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:22.899 20:45:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:22.899 20:45:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:22.899 20:45:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:22.899 20:45:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:22.899 20:45:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:22.899 20:45:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:22.899 20:45:40 -- common/autotest_common.sh@10 -- # set +x 00:28:29.486 20:45:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:29.486 20:45:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:29.486 20:45:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:29.486 20:45:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:29.486 20:45:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:29.486 20:45:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:29.486 20:45:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:29.486 20:45:47 -- nvmf/common.sh@294 -- # net_devs=() 00:28:29.486 20:45:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:29.486 20:45:47 -- nvmf/common.sh@295 -- # e810=() 00:28:29.486 20:45:47 -- nvmf/common.sh@295 -- # local -ga e810 00:28:29.486 20:45:47 -- nvmf/common.sh@296 -- # x722=() 00:28:29.486 20:45:47 -- nvmf/common.sh@296 -- # local -ga x722 00:28:29.486 20:45:47 -- nvmf/common.sh@297 -- # mlx=() 00:28:29.486 20:45:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:29.486 20:45:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:29.486 20:45:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:29.486 20:45:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:29.486 20:45:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:29.486 20:45:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:29.486 20:45:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:29.486 20:45:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:29.486 20:45:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:29.486 20:45:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:29.486 20:45:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:29.486 20:45:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:29.486 20:45:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:29.486 20:45:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:29.486 20:45:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:29.486 20:45:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:29.486 20:45:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:28:29.486 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:28:29.486 20:45:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:29.486 20:45:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:28:29.486 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:28:29.486 20:45:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:29.486 20:45:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:29.486 20:45:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:29.486 20:45:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:29.486 20:45:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:29.486 20:45:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:28:29.486 Found net devices under 0000:4b:00.0: cvl_0_0 00:28:29.486 20:45:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:29.486 20:45:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:29.486 20:45:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:29.486 20:45:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:29.486 20:45:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:29.486 20:45:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:28:29.486 Found net devices under 0000:4b:00.1: cvl_0_1 00:28:29.486 20:45:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:29.486 20:45:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:29.486 20:45:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:29.486 20:45:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:29.486 20:45:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:29.486 20:45:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:29.486 20:45:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:29.486 20:45:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:29.486 20:45:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:29.486 20:45:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:29.486 20:45:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:29.486 20:45:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:29.486 20:45:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:29.486 20:45:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:29.486 20:45:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:29.486 20:45:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:29.486 20:45:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:29.486 20:45:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:29.486 20:45:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:29.486 20:45:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:29.486 20:45:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:29.486 20:45:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:29.486 20:45:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:29.486 20:45:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:29.486 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:29.486 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.518 ms 00:28:29.486 00:28:29.486 --- 10.0.0.2 ping statistics --- 00:28:29.486 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:29.486 rtt min/avg/max/mdev = 0.518/0.518/0.518/0.000 ms 00:28:29.486 20:45:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:29.486 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:29.486 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.246 ms 00:28:29.486 00:28:29.486 --- 10.0.0.1 ping statistics --- 00:28:29.486 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:29.486 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:28:29.486 20:45:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:29.486 20:45:47 -- nvmf/common.sh@410 -- # return 0 00:28:29.486 20:45:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:29.486 20:45:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:29.486 20:45:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:29.486 20:45:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:29.486 20:45:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:29.486 20:45:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:29.486 20:45:47 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:29.486 20:45:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:29.486 20:45:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:29.486 20:45:47 -- common/autotest_common.sh@10 -- # set +x 00:28:29.486 20:45:47 -- nvmf/common.sh@469 -- # nvmfpid=28207 00:28:29.486 20:45:47 -- nvmf/common.sh@470 -- # waitforlisten 28207 00:28:29.486 20:45:47 -- common/autotest_common.sh@819 -- # '[' -z 28207 ']' 00:28:29.487 20:45:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:29.487 20:45:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:29.487 20:45:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:29.487 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:29.487 20:45:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:29.487 20:45:47 -- common/autotest_common.sh@10 -- # set +x 00:28:29.487 20:45:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:29.747 [2024-04-26 20:45:47.841946] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:28:29.747 [2024-04-26 20:45:47.841994] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:29.747 EAL: No free 2048 kB hugepages reported on node 1 00:28:29.747 [2024-04-26 20:45:47.906129] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:29.747 [2024-04-26 20:45:47.968936] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:29.747 [2024-04-26 20:45:47.969052] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:29.747 [2024-04-26 20:45:47.969060] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:29.747 [2024-04-26 20:45:47.969067] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:29.747 [2024-04-26 20:45:47.969089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:30.320 20:45:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:30.320 20:45:48 -- common/autotest_common.sh@852 -- # return 0 00:28:30.320 20:45:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:30.320 20:45:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:30.320 20:45:48 -- common/autotest_common.sh@10 -- # set +x 00:28:30.320 20:45:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:30.320 20:45:48 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:30.320 20:45:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.320 20:45:48 -- common/autotest_common.sh@10 -- # set +x 00:28:30.320 [2024-04-26 20:45:48.639472] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:30.320 20:45:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.320 20:45:48 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:28:30.320 20:45:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.320 20:45:48 -- common/autotest_common.sh@10 -- # set +x 00:28:30.320 [2024-04-26 20:45:48.651658] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:30.320 20:45:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.320 20:45:48 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:28:30.320 20:45:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.320 20:45:48 -- common/autotest_common.sh@10 -- # set +x 00:28:30.581 null0 00:28:30.581 20:45:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.581 20:45:48 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:28:30.581 20:45:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.581 20:45:48 -- common/autotest_common.sh@10 -- # set +x 00:28:30.581 null1 00:28:30.581 20:45:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.581 20:45:48 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:28:30.581 20:45:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.581 20:45:48 -- common/autotest_common.sh@10 -- # set +x 00:28:30.581 20:45:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.581 20:45:48 -- host/discovery.sh@45 -- # hostpid=28546 00:28:30.581 20:45:48 -- host/discovery.sh@46 -- # waitforlisten 28546 /tmp/host.sock 00:28:30.581 20:45:48 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:28:30.581 20:45:48 -- common/autotest_common.sh@819 -- # '[' -z 28546 ']' 00:28:30.581 20:45:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:28:30.581 20:45:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:30.581 20:45:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:30.581 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:30.581 20:45:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:30.581 20:45:48 -- common/autotest_common.sh@10 -- # set +x 00:28:30.581 [2024-04-26 20:45:48.735541] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:28:30.581 [2024-04-26 20:45:48.735586] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid28546 ] 00:28:30.581 EAL: No free 2048 kB hugepages reported on node 1 00:28:30.581 [2024-04-26 20:45:48.793339] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:30.581 [2024-04-26 20:45:48.855327] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:30.581 [2024-04-26 20:45:48.855453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:31.154 20:45:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:31.154 20:45:49 -- common/autotest_common.sh@852 -- # return 0 00:28:31.154 20:45:49 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:31.154 20:45:49 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:28:31.154 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.154 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.418 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.419 20:45:49 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:28:31.419 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.419 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.419 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.419 20:45:49 -- host/discovery.sh@72 -- # notify_id=0 00:28:31.419 20:45:49 -- host/discovery.sh@78 -- # get_subsystem_names 00:28:31.419 20:45:49 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:31.419 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.419 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.419 20:45:49 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:31.419 20:45:49 -- host/discovery.sh@59 -- # sort 00:28:31.419 20:45:49 -- host/discovery.sh@59 -- # xargs 00:28:31.419 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.419 20:45:49 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:28:31.419 20:45:49 -- host/discovery.sh@79 -- # get_bdev_list 00:28:31.419 20:45:49 -- host/discovery.sh@55 -- # sort 00:28:31.419 20:45:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:31.419 20:45:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:31.419 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.419 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.419 20:45:49 -- host/discovery.sh@55 -- # xargs 00:28:31.419 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.419 20:45:49 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:28:31.419 20:45:49 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:28:31.419 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.419 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.419 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.419 20:45:49 -- host/discovery.sh@82 -- # get_subsystem_names 00:28:31.419 20:45:49 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:31.419 20:45:49 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:31.419 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.419 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.419 20:45:49 -- host/discovery.sh@59 -- # sort 00:28:31.419 20:45:49 -- host/discovery.sh@59 -- # xargs 00:28:31.419 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.419 20:45:49 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:28:31.419 20:45:49 -- host/discovery.sh@83 -- # get_bdev_list 00:28:31.419 20:45:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:31.419 20:45:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:31.419 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.419 20:45:49 -- host/discovery.sh@55 -- # sort 00:28:31.419 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.419 20:45:49 -- host/discovery.sh@55 -- # xargs 00:28:31.419 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.419 20:45:49 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:28:31.419 20:45:49 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:28:31.419 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.419 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.419 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.419 20:45:49 -- host/discovery.sh@86 -- # get_subsystem_names 00:28:31.419 20:45:49 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:31.419 20:45:49 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:31.419 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.419 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.419 20:45:49 -- host/discovery.sh@59 -- # sort 00:28:31.419 20:45:49 -- host/discovery.sh@59 -- # xargs 00:28:31.726 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.726 20:45:49 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:28:31.726 20:45:49 -- host/discovery.sh@87 -- # get_bdev_list 00:28:31.726 20:45:49 -- host/discovery.sh@55 -- # xargs 00:28:31.726 20:45:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:31.726 20:45:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:31.726 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.726 20:45:49 -- host/discovery.sh@55 -- # sort 00:28:31.726 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.726 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.726 20:45:49 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:28:31.726 20:45:49 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:31.726 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.726 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.726 [2024-04-26 20:45:49.858780] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:31.726 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.726 20:45:49 -- host/discovery.sh@92 -- # get_subsystem_names 00:28:31.726 20:45:49 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:31.726 20:45:49 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:31.726 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.726 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.726 20:45:49 -- host/discovery.sh@59 -- # sort 00:28:31.726 20:45:49 -- host/discovery.sh@59 -- # xargs 00:28:31.726 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.726 20:45:49 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:28:31.726 20:45:49 -- host/discovery.sh@93 -- # get_bdev_list 00:28:31.726 20:45:49 -- host/discovery.sh@55 -- # xargs 00:28:31.726 20:45:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:31.726 20:45:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:31.726 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.726 20:45:49 -- host/discovery.sh@55 -- # sort 00:28:31.726 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.726 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.726 20:45:49 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:28:31.726 20:45:49 -- host/discovery.sh@94 -- # get_notification_count 00:28:31.726 20:45:49 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:31.726 20:45:49 -- host/discovery.sh@74 -- # jq '. | length' 00:28:31.726 20:45:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.726 20:45:49 -- common/autotest_common.sh@10 -- # set +x 00:28:31.726 20:45:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.726 20:45:50 -- host/discovery.sh@74 -- # notification_count=0 00:28:31.726 20:45:50 -- host/discovery.sh@75 -- # notify_id=0 00:28:31.726 20:45:50 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:28:31.726 20:45:50 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:28:31.726 20:45:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.726 20:45:50 -- common/autotest_common.sh@10 -- # set +x 00:28:31.726 20:45:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.726 20:45:50 -- host/discovery.sh@100 -- # sleep 1 00:28:32.336 [2024-04-26 20:45:50.518216] bdev_nvme.c:6753:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:32.336 [2024-04-26 20:45:50.518245] bdev_nvme.c:6833:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:32.336 [2024-04-26 20:45:50.518260] bdev_nvme.c:6716:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:32.336 [2024-04-26 20:45:50.609551] bdev_nvme.c:6682:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:32.597 [2024-04-26 20:45:50.833826] bdev_nvme.c:6572:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:32.597 [2024-04-26 20:45:50.833851] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:32.858 20:45:51 -- host/discovery.sh@101 -- # get_subsystem_names 00:28:32.858 20:45:51 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:32.858 20:45:51 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:32.858 20:45:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.858 20:45:51 -- common/autotest_common.sh@10 -- # set +x 00:28:32.858 20:45:51 -- host/discovery.sh@59 -- # sort 00:28:32.858 20:45:51 -- host/discovery.sh@59 -- # xargs 00:28:32.858 20:45:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.858 20:45:51 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:32.858 20:45:51 -- host/discovery.sh@102 -- # get_bdev_list 00:28:32.858 20:45:51 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:32.858 20:45:51 -- host/discovery.sh@55 -- # xargs 00:28:32.858 20:45:51 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:32.858 20:45:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.858 20:45:51 -- common/autotest_common.sh@10 -- # set +x 00:28:32.858 20:45:51 -- host/discovery.sh@55 -- # sort 00:28:32.858 20:45:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.858 20:45:51 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:28:32.858 20:45:51 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:28:32.858 20:45:51 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:32.858 20:45:51 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:32.858 20:45:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.858 20:45:51 -- common/autotest_common.sh@10 -- # set +x 00:28:32.858 20:45:51 -- host/discovery.sh@63 -- # sort -n 00:28:32.858 20:45:51 -- host/discovery.sh@63 -- # xargs 00:28:32.858 20:45:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.858 20:45:51 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:28:32.858 20:45:51 -- host/discovery.sh@104 -- # get_notification_count 00:28:32.858 20:45:51 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:32.858 20:45:51 -- host/discovery.sh@74 -- # jq '. | length' 00:28:32.858 20:45:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.858 20:45:51 -- common/autotest_common.sh@10 -- # set +x 00:28:32.858 20:45:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:33.119 20:45:51 -- host/discovery.sh@74 -- # notification_count=1 00:28:33.119 20:45:51 -- host/discovery.sh@75 -- # notify_id=1 00:28:33.119 20:45:51 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:28:33.119 20:45:51 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:28:33.119 20:45:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:33.119 20:45:51 -- common/autotest_common.sh@10 -- # set +x 00:28:33.119 20:45:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:33.119 20:45:51 -- host/discovery.sh@109 -- # sleep 1 00:28:34.062 20:45:52 -- host/discovery.sh@110 -- # get_bdev_list 00:28:34.062 20:45:52 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:34.062 20:45:52 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:34.062 20:45:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:34.062 20:45:52 -- common/autotest_common.sh@10 -- # set +x 00:28:34.062 20:45:52 -- host/discovery.sh@55 -- # sort 00:28:34.062 20:45:52 -- host/discovery.sh@55 -- # xargs 00:28:34.062 20:45:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:34.062 20:45:52 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:34.062 20:45:52 -- host/discovery.sh@111 -- # get_notification_count 00:28:34.062 20:45:52 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:28:34.062 20:45:52 -- host/discovery.sh@74 -- # jq '. | length' 00:28:34.062 20:45:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:34.062 20:45:52 -- common/autotest_common.sh@10 -- # set +x 00:28:34.062 20:45:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:34.062 20:45:52 -- host/discovery.sh@74 -- # notification_count=1 00:28:34.062 20:45:52 -- host/discovery.sh@75 -- # notify_id=2 00:28:34.062 20:45:52 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:28:34.062 20:45:52 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:28:34.062 20:45:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:34.062 20:45:52 -- common/autotest_common.sh@10 -- # set +x 00:28:34.062 [2024-04-26 20:45:52.353667] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:34.062 [2024-04-26 20:45:52.354190] bdev_nvme.c:6735:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:34.062 [2024-04-26 20:45:52.354215] bdev_nvme.c:6716:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:34.062 20:45:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:34.062 20:45:52 -- host/discovery.sh@117 -- # sleep 1 00:28:34.322 [2024-04-26 20:45:52.442547] bdev_nvme.c:6677:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:28:34.583 [2024-04-26 20:45:52.713927] bdev_nvme.c:6572:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:34.583 [2024-04-26 20:45:52.713945] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:34.583 [2024-04-26 20:45:52.713950] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:35.153 20:45:53 -- host/discovery.sh@118 -- # get_subsystem_names 00:28:35.154 20:45:53 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:35.154 20:45:53 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:35.154 20:45:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.154 20:45:53 -- host/discovery.sh@59 -- # sort 00:28:35.154 20:45:53 -- common/autotest_common.sh@10 -- # set +x 00:28:35.154 20:45:53 -- host/discovery.sh@59 -- # xargs 00:28:35.154 20:45:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.154 20:45:53 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:35.154 20:45:53 -- host/discovery.sh@119 -- # get_bdev_list 00:28:35.154 20:45:53 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:35.154 20:45:53 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:35.154 20:45:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.154 20:45:53 -- host/discovery.sh@55 -- # sort 00:28:35.154 20:45:53 -- common/autotest_common.sh@10 -- # set +x 00:28:35.154 20:45:53 -- host/discovery.sh@55 -- # xargs 00:28:35.154 20:45:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.154 20:45:53 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:35.154 20:45:53 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:28:35.154 20:45:53 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:35.154 20:45:53 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:35.154 20:45:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.154 20:45:53 -- host/discovery.sh@63 -- # sort -n 00:28:35.154 20:45:53 -- common/autotest_common.sh@10 -- # set +x 00:28:35.154 20:45:53 -- host/discovery.sh@63 -- # xargs 00:28:35.154 20:45:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.415 20:45:53 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:28:35.415 20:45:53 -- host/discovery.sh@121 -- # get_notification_count 00:28:35.415 20:45:53 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:35.415 20:45:53 -- host/discovery.sh@74 -- # jq '. | length' 00:28:35.415 20:45:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.415 20:45:53 -- common/autotest_common.sh@10 -- # set +x 00:28:35.415 20:45:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.415 20:45:53 -- host/discovery.sh@74 -- # notification_count=0 00:28:35.415 20:45:53 -- host/discovery.sh@75 -- # notify_id=2 00:28:35.415 20:45:53 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:28:35.415 20:45:53 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:35.415 20:45:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.415 20:45:53 -- common/autotest_common.sh@10 -- # set +x 00:28:35.415 [2024-04-26 20:45:53.566221] bdev_nvme.c:6735:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:35.415 [2024-04-26 20:45:53.566243] bdev_nvme.c:6716:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:35.415 [2024-04-26 20:45:53.567529] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:35.415 [2024-04-26 20:45:53.567546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:35.415 [2024-04-26 20:45:53.567555] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:35.415 [2024-04-26 20:45:53.567562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:35.415 [2024-04-26 20:45:53.567570] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:35.415 [2024-04-26 20:45:53.567577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:35.415 [2024-04-26 20:45:53.567585] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:35.415 [2024-04-26 20:45:53.567592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:35.415 [2024-04-26 20:45:53.567599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e99f50 is same with the state(5) to be set 00:28:35.415 20:45:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.415 20:45:53 -- host/discovery.sh@127 -- # sleep 1 00:28:35.415 [2024-04-26 20:45:53.577543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e99f50 (9): Bad file descriptor 00:28:35.415 [2024-04-26 20:45:53.587582] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:35.415 [2024-04-26 20:45:53.588030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.415 [2024-04-26 20:45:53.588570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.415 [2024-04-26 20:45:53.588608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e99f50 with addr=10.0.0.2, port=4420 00:28:35.415 [2024-04-26 20:45:53.588619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e99f50 is same with the state(5) to be set 00:28:35.415 [2024-04-26 20:45:53.588637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e99f50 (9): Bad file descriptor 00:28:35.415 [2024-04-26 20:45:53.588663] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:35.415 [2024-04-26 20:45:53.588671] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:35.415 [2024-04-26 20:45:53.588680] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:35.415 [2024-04-26 20:45:53.588694] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:35.415 [2024-04-26 20:45:53.597636] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:35.415 [2024-04-26 20:45:53.598078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.415 [2024-04-26 20:45:53.598612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.415 [2024-04-26 20:45:53.598649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e99f50 with addr=10.0.0.2, port=4420 00:28:35.415 [2024-04-26 20:45:53.598661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e99f50 is same with the state(5) to be set 00:28:35.415 [2024-04-26 20:45:53.598681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e99f50 (9): Bad file descriptor 00:28:35.415 [2024-04-26 20:45:53.598725] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:35.415 [2024-04-26 20:45:53.598734] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:35.415 [2024-04-26 20:45:53.598742] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:35.415 [2024-04-26 20:45:53.598757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:35.415 [2024-04-26 20:45:53.607689] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:35.415 [2024-04-26 20:45:53.608127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.415 [2024-04-26 20:45:53.608688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.415 [2024-04-26 20:45:53.608725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e99f50 with addr=10.0.0.2, port=4420 00:28:35.415 [2024-04-26 20:45:53.608736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e99f50 is same with the state(5) to be set 00:28:35.416 [2024-04-26 20:45:53.608804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e99f50 (9): Bad file descriptor 00:28:35.416 [2024-04-26 20:45:53.608837] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:35.416 [2024-04-26 20:45:53.608846] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:35.416 [2024-04-26 20:45:53.608854] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:35.416 [2024-04-26 20:45:53.608868] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:35.416 [2024-04-26 20:45:53.617743] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:35.416 [2024-04-26 20:45:53.618181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.618694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.618731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e99f50 with addr=10.0.0.2, port=4420 00:28:35.416 [2024-04-26 20:45:53.618742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e99f50 is same with the state(5) to be set 00:28:35.416 [2024-04-26 20:45:53.618760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e99f50 (9): Bad file descriptor 00:28:35.416 [2024-04-26 20:45:53.618797] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:35.416 [2024-04-26 20:45:53.618805] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:35.416 [2024-04-26 20:45:53.618813] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:35.416 [2024-04-26 20:45:53.618828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:35.416 [2024-04-26 20:45:53.627802] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:35.416 [2024-04-26 20:45:53.628262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.628761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.628797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e99f50 with addr=10.0.0.2, port=4420 00:28:35.416 [2024-04-26 20:45:53.628808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e99f50 is same with the state(5) to be set 00:28:35.416 [2024-04-26 20:45:53.628826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e99f50 (9): Bad file descriptor 00:28:35.416 [2024-04-26 20:45:53.628851] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:35.416 [2024-04-26 20:45:53.628864] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:35.416 [2024-04-26 20:45:53.628872] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:35.416 [2024-04-26 20:45:53.628887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:35.416 [2024-04-26 20:45:53.637861] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:35.416 [2024-04-26 20:45:53.638477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.638937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.638950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e99f50 with addr=10.0.0.2, port=4420 00:28:35.416 [2024-04-26 20:45:53.638959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e99f50 is same with the state(5) to be set 00:28:35.416 [2024-04-26 20:45:53.638977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e99f50 (9): Bad file descriptor 00:28:35.416 [2024-04-26 20:45:53.639007] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:35.416 [2024-04-26 20:45:53.639015] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:35.416 [2024-04-26 20:45:53.639023] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:35.416 [2024-04-26 20:45:53.639037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:35.416 [2024-04-26 20:45:53.647914] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:35.416 [2024-04-26 20:45:53.648246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.648507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.648526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e99f50 with addr=10.0.0.2, port=4420 00:28:35.416 [2024-04-26 20:45:53.648533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e99f50 is same with the state(5) to be set 00:28:35.416 [2024-04-26 20:45:53.648546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e99f50 (9): Bad file descriptor 00:28:35.416 [2024-04-26 20:45:53.648565] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:35.416 [2024-04-26 20:45:53.648572] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:35.416 [2024-04-26 20:45:53.648579] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:35.416 [2024-04-26 20:45:53.648590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:35.416 [2024-04-26 20:45:53.657969] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:35.416 [2024-04-26 20:45:53.658410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.658834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.658843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e99f50 with addr=10.0.0.2, port=4420 00:28:35.416 [2024-04-26 20:45:53.658850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e99f50 is same with the state(5) to be set 00:28:35.416 [2024-04-26 20:45:53.658861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e99f50 (9): Bad file descriptor 00:28:35.416 [2024-04-26 20:45:53.658879] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:35.416 [2024-04-26 20:45:53.658886] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:35.416 [2024-04-26 20:45:53.658896] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:35.416 [2024-04-26 20:45:53.658907] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:35.416 [2024-04-26 20:45:53.668027] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:35.416 [2024-04-26 20:45:53.668466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.668901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.668910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e99f50 with addr=10.0.0.2, port=4420 00:28:35.416 [2024-04-26 20:45:53.668916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e99f50 is same with the state(5) to be set 00:28:35.416 [2024-04-26 20:45:53.668928] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e99f50 (9): Bad file descriptor 00:28:35.416 [2024-04-26 20:45:53.668944] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:35.416 [2024-04-26 20:45:53.668950] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:35.416 [2024-04-26 20:45:53.668957] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:35.416 [2024-04-26 20:45:53.668968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:35.416 [2024-04-26 20:45:53.678077] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:35.416 [2024-04-26 20:45:53.678534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.678964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.678973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e99f50 with addr=10.0.0.2, port=4420 00:28:35.416 [2024-04-26 20:45:53.678980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e99f50 is same with the state(5) to be set 00:28:35.416 [2024-04-26 20:45:53.678991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e99f50 (9): Bad file descriptor 00:28:35.416 [2024-04-26 20:45:53.679008] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:35.416 [2024-04-26 20:45:53.679015] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:35.416 [2024-04-26 20:45:53.679021] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:35.416 [2024-04-26 20:45:53.679031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:35.416 [2024-04-26 20:45:53.688127] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:35.416 [2024-04-26 20:45:53.688601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.689036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:35.416 [2024-04-26 20:45:53.689045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e99f50 with addr=10.0.0.2, port=4420 00:28:35.416 [2024-04-26 20:45:53.689052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e99f50 is same with the state(5) to be set 00:28:35.416 [2024-04-26 20:45:53.689062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e99f50 (9): Bad file descriptor 00:28:35.416 [2024-04-26 20:45:53.689078] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:35.416 [2024-04-26 20:45:53.689085] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:35.416 [2024-04-26 20:45:53.689091] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:35.416 [2024-04-26 20:45:53.689101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:35.416 [2024-04-26 20:45:53.695102] bdev_nvme.c:6540:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:28:35.416 [2024-04-26 20:45:53.695121] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:36.358 20:45:54 -- host/discovery.sh@128 -- # get_subsystem_names 00:28:36.358 20:45:54 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:36.358 20:45:54 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:36.358 20:45:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:36.358 20:45:54 -- host/discovery.sh@59 -- # sort 00:28:36.358 20:45:54 -- common/autotest_common.sh@10 -- # set +x 00:28:36.358 20:45:54 -- host/discovery.sh@59 -- # xargs 00:28:36.358 20:45:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:36.358 20:45:54 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:36.358 20:45:54 -- host/discovery.sh@129 -- # get_bdev_list 00:28:36.358 20:45:54 -- host/discovery.sh@55 -- # xargs 00:28:36.358 20:45:54 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:36.358 20:45:54 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:36.358 20:45:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:36.358 20:45:54 -- host/discovery.sh@55 -- # sort 00:28:36.358 20:45:54 -- common/autotest_common.sh@10 -- # set +x 00:28:36.358 20:45:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:36.358 20:45:54 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:36.358 20:45:54 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:28:36.358 20:45:54 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:36.358 20:45:54 -- host/discovery.sh@63 -- # xargs 00:28:36.358 20:45:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:36.358 20:45:54 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:36.358 20:45:54 -- common/autotest_common.sh@10 -- # set +x 00:28:36.358 20:45:54 -- host/discovery.sh@63 -- # sort -n 00:28:36.358 20:45:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:36.620 20:45:54 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:28:36.620 20:45:54 -- host/discovery.sh@131 -- # get_notification_count 00:28:36.620 20:45:54 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:36.620 20:45:54 -- host/discovery.sh@74 -- # jq '. | length' 00:28:36.620 20:45:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:36.620 20:45:54 -- common/autotest_common.sh@10 -- # set +x 00:28:36.620 20:45:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:36.620 20:45:54 -- host/discovery.sh@74 -- # notification_count=0 00:28:36.620 20:45:54 -- host/discovery.sh@75 -- # notify_id=2 00:28:36.620 20:45:54 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:28:36.620 20:45:54 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:28:36.620 20:45:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:36.620 20:45:54 -- common/autotest_common.sh@10 -- # set +x 00:28:36.620 20:45:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:36.620 20:45:54 -- host/discovery.sh@135 -- # sleep 1 00:28:37.562 20:45:55 -- host/discovery.sh@136 -- # get_subsystem_names 00:28:37.562 20:45:55 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:37.562 20:45:55 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:37.562 20:45:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:37.562 20:45:55 -- host/discovery.sh@59 -- # sort 00:28:37.562 20:45:55 -- common/autotest_common.sh@10 -- # set +x 00:28:37.562 20:45:55 -- host/discovery.sh@59 -- # xargs 00:28:37.562 20:45:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:37.562 20:45:55 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:28:37.562 20:45:55 -- host/discovery.sh@137 -- # get_bdev_list 00:28:37.562 20:45:55 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:37.562 20:45:55 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:37.562 20:45:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:37.562 20:45:55 -- host/discovery.sh@55 -- # sort 00:28:37.562 20:45:55 -- common/autotest_common.sh@10 -- # set +x 00:28:37.562 20:45:55 -- host/discovery.sh@55 -- # xargs 00:28:37.562 20:45:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:37.562 20:45:55 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:28:37.823 20:45:55 -- host/discovery.sh@138 -- # get_notification_count 00:28:37.823 20:45:55 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:37.823 20:45:55 -- host/discovery.sh@74 -- # jq '. | length' 00:28:37.823 20:45:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:37.823 20:45:55 -- common/autotest_common.sh@10 -- # set +x 00:28:37.823 20:45:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:37.823 20:45:55 -- host/discovery.sh@74 -- # notification_count=2 00:28:37.823 20:45:55 -- host/discovery.sh@75 -- # notify_id=4 00:28:37.823 20:45:55 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:28:37.823 20:45:55 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:37.823 20:45:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:37.823 20:45:55 -- common/autotest_common.sh@10 -- # set +x 00:28:38.764 [2024-04-26 20:45:57.016603] bdev_nvme.c:6753:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:38.764 [2024-04-26 20:45:57.016621] bdev_nvme.c:6833:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:38.764 [2024-04-26 20:45:57.016635] bdev_nvme.c:6716:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:39.026 [2024-04-26 20:45:57.147051] bdev_nvme.c:6682:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:28:39.288 [2024-04-26 20:45:57.415741] bdev_nvme.c:6572:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:39.288 [2024-04-26 20:45:57.415774] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:39.288 20:45:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.288 20:45:57 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:39.288 20:45:57 -- common/autotest_common.sh@640 -- # local es=0 00:28:39.288 20:45:57 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:39.288 20:45:57 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:28:39.288 20:45:57 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:39.288 20:45:57 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:28:39.288 20:45:57 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:39.288 20:45:57 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:39.288 20:45:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.288 20:45:57 -- common/autotest_common.sh@10 -- # set +x 00:28:39.288 request: 00:28:39.288 { 00:28:39.288 "name": "nvme", 00:28:39.288 "trtype": "tcp", 00:28:39.288 "traddr": "10.0.0.2", 00:28:39.288 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:39.288 "adrfam": "ipv4", 00:28:39.288 "trsvcid": "8009", 00:28:39.288 "wait_for_attach": true, 00:28:39.288 "method": "bdev_nvme_start_discovery", 00:28:39.288 "req_id": 1 00:28:39.288 } 00:28:39.288 Got JSON-RPC error response 00:28:39.288 response: 00:28:39.288 { 00:28:39.288 "code": -17, 00:28:39.288 "message": "File exists" 00:28:39.288 } 00:28:39.288 20:45:57 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:28:39.288 20:45:57 -- common/autotest_common.sh@643 -- # es=1 00:28:39.288 20:45:57 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:28:39.288 20:45:57 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:28:39.288 20:45:57 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:28:39.288 20:45:57 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:28:39.288 20:45:57 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:39.288 20:45:57 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:39.288 20:45:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.288 20:45:57 -- host/discovery.sh@67 -- # sort 00:28:39.288 20:45:57 -- common/autotest_common.sh@10 -- # set +x 00:28:39.288 20:45:57 -- host/discovery.sh@67 -- # xargs 00:28:39.288 20:45:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.288 20:45:57 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:28:39.288 20:45:57 -- host/discovery.sh@147 -- # get_bdev_list 00:28:39.288 20:45:57 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:39.288 20:45:57 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:39.288 20:45:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.288 20:45:57 -- host/discovery.sh@55 -- # sort 00:28:39.288 20:45:57 -- common/autotest_common.sh@10 -- # set +x 00:28:39.288 20:45:57 -- host/discovery.sh@55 -- # xargs 00:28:39.288 20:45:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.288 20:45:57 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:39.288 20:45:57 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:39.288 20:45:57 -- common/autotest_common.sh@640 -- # local es=0 00:28:39.288 20:45:57 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:39.288 20:45:57 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:28:39.288 20:45:57 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:39.288 20:45:57 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:28:39.288 20:45:57 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:39.288 20:45:57 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:39.288 20:45:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.288 20:45:57 -- common/autotest_common.sh@10 -- # set +x 00:28:39.288 request: 00:28:39.288 { 00:28:39.288 "name": "nvme_second", 00:28:39.288 "trtype": "tcp", 00:28:39.288 "traddr": "10.0.0.2", 00:28:39.288 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:39.288 "adrfam": "ipv4", 00:28:39.288 "trsvcid": "8009", 00:28:39.288 "wait_for_attach": true, 00:28:39.288 "method": "bdev_nvme_start_discovery", 00:28:39.288 "req_id": 1 00:28:39.288 } 00:28:39.288 Got JSON-RPC error response 00:28:39.288 response: 00:28:39.288 { 00:28:39.288 "code": -17, 00:28:39.288 "message": "File exists" 00:28:39.288 } 00:28:39.288 20:45:57 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:28:39.288 20:45:57 -- common/autotest_common.sh@643 -- # es=1 00:28:39.288 20:45:57 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:28:39.288 20:45:57 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:28:39.288 20:45:57 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:28:39.288 20:45:57 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:28:39.288 20:45:57 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:39.288 20:45:57 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:39.288 20:45:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.288 20:45:57 -- host/discovery.sh@67 -- # sort 00:28:39.288 20:45:57 -- common/autotest_common.sh@10 -- # set +x 00:28:39.288 20:45:57 -- host/discovery.sh@67 -- # xargs 00:28:39.288 20:45:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.288 20:45:57 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:28:39.288 20:45:57 -- host/discovery.sh@153 -- # get_bdev_list 00:28:39.288 20:45:57 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:39.288 20:45:57 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:39.288 20:45:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.288 20:45:57 -- common/autotest_common.sh@10 -- # set +x 00:28:39.288 20:45:57 -- host/discovery.sh@55 -- # sort 00:28:39.288 20:45:57 -- host/discovery.sh@55 -- # xargs 00:28:39.550 20:45:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.550 20:45:57 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:39.550 20:45:57 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:39.550 20:45:57 -- common/autotest_common.sh@640 -- # local es=0 00:28:39.550 20:45:57 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:39.550 20:45:57 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:28:39.550 20:45:57 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:39.550 20:45:57 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:28:39.550 20:45:57 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:39.550 20:45:57 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:39.550 20:45:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.550 20:45:57 -- common/autotest_common.sh@10 -- # set +x 00:28:40.490 [2024-04-26 20:45:58.680263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:40.490 [2024-04-26 20:45:58.680837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:40.490 [2024-04-26 20:45:58.680875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e91c80 with addr=10.0.0.2, port=8010 00:28:40.490 [2024-04-26 20:45:58.680889] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:40.490 [2024-04-26 20:45:58.680896] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:40.490 [2024-04-26 20:45:58.680903] bdev_nvme.c:6815:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:41.435 [2024-04-26 20:45:59.682708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:41.435 [2024-04-26 20:45:59.683175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:41.435 [2024-04-26 20:45:59.683187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ea5800 with addr=10.0.0.2, port=8010 00:28:41.435 [2024-04-26 20:45:59.683200] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:41.435 [2024-04-26 20:45:59.683207] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:41.435 [2024-04-26 20:45:59.683214] bdev_nvme.c:6815:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:42.379 [2024-04-26 20:46:00.684464] bdev_nvme.c:6796:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:28:42.379 request: 00:28:42.379 { 00:28:42.379 "name": "nvme_second", 00:28:42.379 "trtype": "tcp", 00:28:42.379 "traddr": "10.0.0.2", 00:28:42.379 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:42.379 "adrfam": "ipv4", 00:28:42.379 "trsvcid": "8010", 00:28:42.379 "attach_timeout_ms": 3000, 00:28:42.379 "method": "bdev_nvme_start_discovery", 00:28:42.379 "req_id": 1 00:28:42.379 } 00:28:42.379 Got JSON-RPC error response 00:28:42.379 response: 00:28:42.379 { 00:28:42.379 "code": -110, 00:28:42.379 "message": "Connection timed out" 00:28:42.379 } 00:28:42.379 20:46:00 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:28:42.379 20:46:00 -- common/autotest_common.sh@643 -- # es=1 00:28:42.379 20:46:00 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:28:42.379 20:46:00 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:28:42.379 20:46:00 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:28:42.379 20:46:00 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:28:42.379 20:46:00 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:42.379 20:46:00 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:42.379 20:46:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:42.379 20:46:00 -- host/discovery.sh@67 -- # sort 00:28:42.379 20:46:00 -- common/autotest_common.sh@10 -- # set +x 00:28:42.379 20:46:00 -- host/discovery.sh@67 -- # xargs 00:28:42.379 20:46:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:42.639 20:46:00 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:28:42.639 20:46:00 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:28:42.639 20:46:00 -- host/discovery.sh@162 -- # kill 28546 00:28:42.639 20:46:00 -- host/discovery.sh@163 -- # nvmftestfini 00:28:42.639 20:46:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:42.639 20:46:00 -- nvmf/common.sh@116 -- # sync 00:28:42.639 20:46:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:42.639 20:46:00 -- nvmf/common.sh@119 -- # set +e 00:28:42.639 20:46:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:42.639 20:46:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:42.640 rmmod nvme_tcp 00:28:42.640 rmmod nvme_fabrics 00:28:42.640 rmmod nvme_keyring 00:28:42.640 20:46:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:42.640 20:46:00 -- nvmf/common.sh@123 -- # set -e 00:28:42.640 20:46:00 -- nvmf/common.sh@124 -- # return 0 00:28:42.640 20:46:00 -- nvmf/common.sh@477 -- # '[' -n 28207 ']' 00:28:42.640 20:46:00 -- nvmf/common.sh@478 -- # killprocess 28207 00:28:42.640 20:46:00 -- common/autotest_common.sh@926 -- # '[' -z 28207 ']' 00:28:42.640 20:46:00 -- common/autotest_common.sh@930 -- # kill -0 28207 00:28:42.640 20:46:00 -- common/autotest_common.sh@931 -- # uname 00:28:42.640 20:46:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:42.640 20:46:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 28207 00:28:42.640 20:46:00 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:42.640 20:46:00 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:42.640 20:46:00 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 28207' 00:28:42.640 killing process with pid 28207 00:28:42.640 20:46:00 -- common/autotest_common.sh@945 -- # kill 28207 00:28:42.640 20:46:00 -- common/autotest_common.sh@950 -- # wait 28207 00:28:42.900 20:46:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:42.900 20:46:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:42.900 20:46:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:42.900 20:46:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:42.900 20:46:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:42.900 20:46:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:42.900 20:46:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:42.900 20:46:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:44.808 20:46:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:44.808 00:28:44.808 real 0m22.412s 00:28:44.808 user 0m28.798s 00:28:44.808 sys 0m6.512s 00:28:44.808 20:46:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:44.808 20:46:03 -- common/autotest_common.sh@10 -- # set +x 00:28:44.808 ************************************ 00:28:44.808 END TEST nvmf_discovery 00:28:44.808 ************************************ 00:28:44.808 20:46:03 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:44.808 20:46:03 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:28:44.808 20:46:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:44.808 20:46:03 -- common/autotest_common.sh@10 -- # set +x 00:28:44.808 ************************************ 00:28:44.808 START TEST nvmf_discovery_remove_ifc 00:28:44.808 ************************************ 00:28:44.808 20:46:03 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:45.069 * Looking for test storage... 00:28:45.069 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:45.069 20:46:03 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:45.069 20:46:03 -- nvmf/common.sh@7 -- # uname -s 00:28:45.069 20:46:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:45.069 20:46:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:45.069 20:46:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:45.069 20:46:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:45.069 20:46:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:45.069 20:46:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:45.069 20:46:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:45.069 20:46:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:45.069 20:46:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:45.069 20:46:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:45.069 20:46:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:28:45.069 20:46:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:28:45.069 20:46:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:45.069 20:46:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:45.069 20:46:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:45.069 20:46:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:45.069 20:46:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:45.069 20:46:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:45.069 20:46:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:45.069 20:46:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:45.069 20:46:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:45.069 20:46:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:45.069 20:46:03 -- paths/export.sh@5 -- # export PATH 00:28:45.069 20:46:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:45.069 20:46:03 -- nvmf/common.sh@46 -- # : 0 00:28:45.069 20:46:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:45.069 20:46:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:45.069 20:46:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:45.069 20:46:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:45.069 20:46:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:45.069 20:46:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:45.069 20:46:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:45.069 20:46:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:45.069 20:46:03 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:28:45.069 20:46:03 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:28:45.069 20:46:03 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:28:45.069 20:46:03 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:28:45.069 20:46:03 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:28:45.069 20:46:03 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:28:45.069 20:46:03 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:28:45.069 20:46:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:45.069 20:46:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:45.069 20:46:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:45.069 20:46:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:45.069 20:46:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:45.069 20:46:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:45.069 20:46:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:45.069 20:46:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:45.069 20:46:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:45.069 20:46:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:45.069 20:46:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:45.069 20:46:03 -- common/autotest_common.sh@10 -- # set +x 00:28:51.690 20:46:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:51.690 20:46:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:51.690 20:46:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:51.690 20:46:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:51.690 20:46:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:51.690 20:46:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:51.690 20:46:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:51.690 20:46:09 -- nvmf/common.sh@294 -- # net_devs=() 00:28:51.690 20:46:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:51.690 20:46:09 -- nvmf/common.sh@295 -- # e810=() 00:28:51.690 20:46:09 -- nvmf/common.sh@295 -- # local -ga e810 00:28:51.690 20:46:09 -- nvmf/common.sh@296 -- # x722=() 00:28:51.690 20:46:09 -- nvmf/common.sh@296 -- # local -ga x722 00:28:51.690 20:46:09 -- nvmf/common.sh@297 -- # mlx=() 00:28:51.690 20:46:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:51.690 20:46:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:51.690 20:46:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:51.690 20:46:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:51.690 20:46:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:51.690 20:46:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:51.690 20:46:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:51.690 20:46:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:51.690 20:46:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:51.690 20:46:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:51.690 20:46:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:51.690 20:46:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:51.690 20:46:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:51.690 20:46:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:51.690 20:46:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:51.690 20:46:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:51.690 20:46:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:51.690 20:46:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:51.690 20:46:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:51.690 20:46:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:28:51.690 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:28:51.690 20:46:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:51.690 20:46:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:51.690 20:46:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:51.690 20:46:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:51.690 20:46:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:51.690 20:46:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:51.690 20:46:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:28:51.690 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:28:51.690 20:46:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:51.690 20:46:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:51.690 20:46:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:51.690 20:46:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:51.690 20:46:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:51.690 20:46:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:51.691 20:46:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:51.691 20:46:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:51.691 20:46:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:51.691 20:46:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:51.691 20:46:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:51.691 20:46:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:51.691 20:46:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:28:51.691 Found net devices under 0000:4b:00.0: cvl_0_0 00:28:51.691 20:46:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:51.691 20:46:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:51.691 20:46:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:51.691 20:46:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:51.691 20:46:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:51.691 20:46:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:28:51.691 Found net devices under 0000:4b:00.1: cvl_0_1 00:28:51.691 20:46:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:51.691 20:46:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:51.691 20:46:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:51.691 20:46:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:51.691 20:46:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:51.691 20:46:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:51.691 20:46:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:51.691 20:46:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:51.691 20:46:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:51.691 20:46:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:51.691 20:46:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:51.691 20:46:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:51.691 20:46:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:51.691 20:46:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:51.691 20:46:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:51.691 20:46:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:51.691 20:46:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:51.691 20:46:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:51.691 20:46:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:51.691 20:46:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:51.691 20:46:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:51.691 20:46:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:51.691 20:46:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:51.691 20:46:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:51.691 20:46:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:51.691 20:46:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:51.691 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:51.691 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.671 ms 00:28:51.691 00:28:51.691 --- 10.0.0.2 ping statistics --- 00:28:51.691 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:51.691 rtt min/avg/max/mdev = 0.671/0.671/0.671/0.000 ms 00:28:51.691 20:46:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:51.691 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:51.691 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.361 ms 00:28:51.691 00:28:51.691 --- 10.0.0.1 ping statistics --- 00:28:51.691 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:51.691 rtt min/avg/max/mdev = 0.361/0.361/0.361/0.000 ms 00:28:51.691 20:46:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:51.691 20:46:09 -- nvmf/common.sh@410 -- # return 0 00:28:51.691 20:46:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:51.691 20:46:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:51.691 20:46:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:51.691 20:46:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:51.691 20:46:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:51.691 20:46:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:51.691 20:46:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:51.691 20:46:09 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:28:51.691 20:46:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:51.691 20:46:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:51.691 20:46:09 -- common/autotest_common.sh@10 -- # set +x 00:28:51.691 20:46:09 -- nvmf/common.sh@469 -- # nvmfpid=35091 00:28:51.691 20:46:09 -- nvmf/common.sh@470 -- # waitforlisten 35091 00:28:51.691 20:46:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:51.691 20:46:09 -- common/autotest_common.sh@819 -- # '[' -z 35091 ']' 00:28:51.691 20:46:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:51.691 20:46:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:51.691 20:46:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:51.691 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:51.691 20:46:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:51.691 20:46:09 -- common/autotest_common.sh@10 -- # set +x 00:28:51.691 [2024-04-26 20:46:09.738364] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:28:51.691 [2024-04-26 20:46:09.738410] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:51.691 EAL: No free 2048 kB hugepages reported on node 1 00:28:51.691 [2024-04-26 20:46:09.802114] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:51.691 [2024-04-26 20:46:09.863608] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:51.691 [2024-04-26 20:46:09.863728] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:51.691 [2024-04-26 20:46:09.863737] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:51.691 [2024-04-26 20:46:09.863744] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:51.691 [2024-04-26 20:46:09.863761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:52.263 20:46:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:52.263 20:46:10 -- common/autotest_common.sh@852 -- # return 0 00:28:52.263 20:46:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:52.263 20:46:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:52.263 20:46:10 -- common/autotest_common.sh@10 -- # set +x 00:28:52.263 20:46:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:52.263 20:46:10 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:28:52.263 20:46:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.263 20:46:10 -- common/autotest_common.sh@10 -- # set +x 00:28:52.263 [2024-04-26 20:46:10.590228] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:52.263 [2024-04-26 20:46:10.598366] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:52.523 null0 00:28:52.524 [2024-04-26 20:46:10.630385] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:52.524 20:46:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.524 20:46:10 -- host/discovery_remove_ifc.sh@59 -- # hostpid=35222 00:28:52.524 20:46:10 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 35222 /tmp/host.sock 00:28:52.524 20:46:10 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:28:52.524 20:46:10 -- common/autotest_common.sh@819 -- # '[' -z 35222 ']' 00:28:52.524 20:46:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:28:52.524 20:46:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:52.524 20:46:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:52.524 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:52.524 20:46:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:52.524 20:46:10 -- common/autotest_common.sh@10 -- # set +x 00:28:52.524 [2024-04-26 20:46:10.695705] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:28:52.524 [2024-04-26 20:46:10.695753] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid35222 ] 00:28:52.524 EAL: No free 2048 kB hugepages reported on node 1 00:28:52.524 [2024-04-26 20:46:10.754142] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:52.524 [2024-04-26 20:46:10.816538] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:52.524 [2024-04-26 20:46:10.816660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:53.465 20:46:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:53.465 20:46:11 -- common/autotest_common.sh@852 -- # return 0 00:28:53.466 20:46:11 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:53.466 20:46:11 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:28:53.466 20:46:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:53.466 20:46:11 -- common/autotest_common.sh@10 -- # set +x 00:28:53.466 20:46:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:53.466 20:46:11 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:28:53.466 20:46:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:53.466 20:46:11 -- common/autotest_common.sh@10 -- # set +x 00:28:53.466 20:46:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:53.466 20:46:11 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:28:53.466 20:46:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:53.466 20:46:11 -- common/autotest_common.sh@10 -- # set +x 00:28:54.409 [2024-04-26 20:46:12.580539] bdev_nvme.c:6753:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:54.409 [2024-04-26 20:46:12.580559] bdev_nvme.c:6833:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:54.409 [2024-04-26 20:46:12.580579] bdev_nvme.c:6716:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:54.409 [2024-04-26 20:46:12.668861] bdev_nvme.c:6682:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:54.409 [2024-04-26 20:46:12.732592] bdev_nvme.c:7542:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:28:54.409 [2024-04-26 20:46:12.732635] bdev_nvme.c:7542:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:28:54.409 [2024-04-26 20:46:12.732659] bdev_nvme.c:7542:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:28:54.409 [2024-04-26 20:46:12.732673] bdev_nvme.c:6572:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:54.409 [2024-04-26 20:46:12.732694] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:54.409 20:46:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:54.409 20:46:12 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:28:54.409 20:46:12 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:54.409 20:46:12 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:54.409 20:46:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:54.409 20:46:12 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:54.409 20:46:12 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:54.409 20:46:12 -- common/autotest_common.sh@10 -- # set +x 00:28:54.409 20:46:12 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:54.670 20:46:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:54.670 [2024-04-26 20:46:12.779159] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x239b4d0 was disconnected and freed. delete nvme_qpair. 00:28:54.670 20:46:12 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:28:54.670 20:46:12 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:28:54.670 20:46:12 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:28:54.670 20:46:12 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:28:54.670 20:46:12 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:54.670 20:46:12 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:54.670 20:46:12 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:54.670 20:46:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:54.670 20:46:12 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:54.670 20:46:12 -- common/autotest_common.sh@10 -- # set +x 00:28:54.670 20:46:12 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:54.670 20:46:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:54.670 20:46:12 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:54.670 20:46:12 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:56.055 20:46:13 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:56.055 20:46:13 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:56.055 20:46:13 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:56.055 20:46:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:56.055 20:46:13 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:56.055 20:46:13 -- common/autotest_common.sh@10 -- # set +x 00:28:56.055 20:46:13 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:56.055 20:46:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:56.055 20:46:14 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:56.055 20:46:14 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:56.998 20:46:15 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:56.998 20:46:15 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:56.998 20:46:15 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:56.998 20:46:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:56.998 20:46:15 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:56.998 20:46:15 -- common/autotest_common.sh@10 -- # set +x 00:28:56.998 20:46:15 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:56.998 20:46:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:56.998 20:46:15 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:56.998 20:46:15 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:57.942 20:46:16 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:57.942 20:46:16 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:57.942 20:46:16 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:57.942 20:46:16 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:57.942 20:46:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:57.942 20:46:16 -- common/autotest_common.sh@10 -- # set +x 00:28:57.942 20:46:16 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:57.942 20:46:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:57.942 20:46:16 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:57.942 20:46:16 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:58.887 20:46:17 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:58.887 20:46:17 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:58.887 20:46:17 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:58.887 20:46:17 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:58.887 20:46:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:58.887 20:46:17 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:58.887 20:46:17 -- common/autotest_common.sh@10 -- # set +x 00:28:58.887 20:46:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:58.887 20:46:17 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:58.887 20:46:17 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:59.830 [2024-04-26 20:46:18.173041] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:28:59.830 [2024-04-26 20:46:18.173081] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.830 [2024-04-26 20:46:18.173094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.830 [2024-04-26 20:46:18.173103] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.830 [2024-04-26 20:46:18.173111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.830 [2024-04-26 20:46:18.173118] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.830 [2024-04-26 20:46:18.173126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.830 [2024-04-26 20:46:18.173133] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.830 [2024-04-26 20:46:18.173140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.830 [2024-04-26 20:46:18.173149] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:28:59.830 [2024-04-26 20:46:18.173156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:59.830 [2024-04-26 20:46:18.173163] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2361b30 is same with the state(5) to be set 00:29:00.091 [2024-04-26 20:46:18.183062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2361b30 (9): Bad file descriptor 00:29:00.091 [2024-04-26 20:46:18.193103] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:00.091 20:46:18 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:00.091 20:46:18 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:00.091 20:46:18 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:00.091 20:46:18 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:00.091 20:46:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:00.091 20:46:18 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:00.091 20:46:18 -- common/autotest_common.sh@10 -- # set +x 00:29:01.035 [2024-04-26 20:46:19.204308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:01.979 [2024-04-26 20:46:20.228329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:01.979 [2024-04-26 20:46:20.228391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2361b30 with addr=10.0.0.2, port=4420 00:29:01.979 [2024-04-26 20:46:20.228405] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2361b30 is same with the state(5) to be set 00:29:01.979 [2024-04-26 20:46:20.228788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2361b30 (9): Bad file descriptor 00:29:01.979 [2024-04-26 20:46:20.228815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:01.979 [2024-04-26 20:46:20.228837] bdev_nvme.c:6504:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:01.979 [2024-04-26 20:46:20.228863] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:01.979 [2024-04-26 20:46:20.228875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:01.979 [2024-04-26 20:46:20.228886] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:01.979 [2024-04-26 20:46:20.228893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:01.979 [2024-04-26 20:46:20.228901] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:01.979 [2024-04-26 20:46:20.228908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:01.979 [2024-04-26 20:46:20.228915] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:01.979 [2024-04-26 20:46:20.228922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:01.979 [2024-04-26 20:46:20.228930] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:01.979 [2024-04-26 20:46:20.228937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:01.979 [2024-04-26 20:46:20.228944] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:01.979 [2024-04-26 20:46:20.229433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2361f40 (9): Bad file descriptor 00:29:01.979 [2024-04-26 20:46:20.230446] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:01.979 [2024-04-26 20:46:20.230465] nvme_ctrlr.c:1135:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:01.979 20:46:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:01.979 20:46:20 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:01.979 20:46:20 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:02.923 20:46:21 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:02.923 20:46:21 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.923 20:46:21 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:02.923 20:46:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:02.923 20:46:21 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:02.923 20:46:21 -- common/autotest_common.sh@10 -- # set +x 00:29:02.923 20:46:21 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:03.184 20:46:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:03.184 20:46:21 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:03.184 20:46:21 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:03.184 20:46:21 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:03.184 20:46:21 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:03.184 20:46:21 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:03.184 20:46:21 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:03.184 20:46:21 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:03.184 20:46:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:03.184 20:46:21 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:03.184 20:46:21 -- common/autotest_common.sh@10 -- # set +x 00:29:03.184 20:46:21 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:03.184 20:46:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:03.184 20:46:21 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:03.184 20:46:21 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:04.125 [2024-04-26 20:46:22.284550] bdev_nvme.c:6753:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:04.125 [2024-04-26 20:46:22.284572] bdev_nvme.c:6833:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:04.125 [2024-04-26 20:46:22.284587] bdev_nvme.c:6716:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:04.125 [2024-04-26 20:46:22.414988] bdev_nvme.c:6682:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:04.125 20:46:22 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:04.125 20:46:22 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:04.125 20:46:22 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:04.125 20:46:22 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:04.125 20:46:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:04.125 20:46:22 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:04.125 20:46:22 -- common/autotest_common.sh@10 -- # set +x 00:29:04.386 20:46:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:04.386 20:46:22 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:04.386 20:46:22 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:04.386 [2024-04-26 20:46:22.638553] bdev_nvme.c:7542:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:04.386 [2024-04-26 20:46:22.638593] bdev_nvme.c:7542:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:04.386 [2024-04-26 20:46:22.638614] bdev_nvme.c:7542:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:04.386 [2024-04-26 20:46:22.638628] bdev_nvme.c:6572:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:04.386 [2024-04-26 20:46:22.638635] bdev_nvme.c:6531:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:04.386 [2024-04-26 20:46:22.643692] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x236f830 was disconnected and freed. delete nvme_qpair. 00:29:05.430 20:46:23 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:05.430 20:46:23 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:05.430 20:46:23 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:05.430 20:46:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:05.430 20:46:23 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:05.430 20:46:23 -- common/autotest_common.sh@10 -- # set +x 00:29:05.430 20:46:23 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:05.430 20:46:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:05.430 20:46:23 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:05.430 20:46:23 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:05.430 20:46:23 -- host/discovery_remove_ifc.sh@90 -- # killprocess 35222 00:29:05.430 20:46:23 -- common/autotest_common.sh@926 -- # '[' -z 35222 ']' 00:29:05.430 20:46:23 -- common/autotest_common.sh@930 -- # kill -0 35222 00:29:05.430 20:46:23 -- common/autotest_common.sh@931 -- # uname 00:29:05.430 20:46:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:05.430 20:46:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 35222 00:29:05.430 20:46:23 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:05.430 20:46:23 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:05.430 20:46:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 35222' 00:29:05.430 killing process with pid 35222 00:29:05.430 20:46:23 -- common/autotest_common.sh@945 -- # kill 35222 00:29:05.430 20:46:23 -- common/autotest_common.sh@950 -- # wait 35222 00:29:05.699 20:46:23 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:05.699 20:46:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:05.699 20:46:23 -- nvmf/common.sh@116 -- # sync 00:29:05.699 20:46:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:05.699 20:46:23 -- nvmf/common.sh@119 -- # set +e 00:29:05.699 20:46:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:05.699 20:46:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:05.699 rmmod nvme_tcp 00:29:05.699 rmmod nvme_fabrics 00:29:05.699 rmmod nvme_keyring 00:29:05.699 20:46:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:05.699 20:46:23 -- nvmf/common.sh@123 -- # set -e 00:29:05.699 20:46:23 -- nvmf/common.sh@124 -- # return 0 00:29:05.699 20:46:23 -- nvmf/common.sh@477 -- # '[' -n 35091 ']' 00:29:05.699 20:46:23 -- nvmf/common.sh@478 -- # killprocess 35091 00:29:05.699 20:46:23 -- common/autotest_common.sh@926 -- # '[' -z 35091 ']' 00:29:05.699 20:46:23 -- common/autotest_common.sh@930 -- # kill -0 35091 00:29:05.699 20:46:23 -- common/autotest_common.sh@931 -- # uname 00:29:05.699 20:46:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:05.699 20:46:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 35091 00:29:05.699 20:46:23 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:05.699 20:46:23 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:05.699 20:46:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 35091' 00:29:05.699 killing process with pid 35091 00:29:05.699 20:46:23 -- common/autotest_common.sh@945 -- # kill 35091 00:29:05.699 20:46:23 -- common/autotest_common.sh@950 -- # wait 35091 00:29:05.699 20:46:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:05.699 20:46:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:05.699 20:46:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:05.699 20:46:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:05.699 20:46:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:05.699 20:46:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:05.699 20:46:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:05.699 20:46:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:08.247 20:46:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:08.247 00:29:08.247 real 0m22.970s 00:29:08.247 user 0m27.638s 00:29:08.247 sys 0m5.977s 00:29:08.247 20:46:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:08.247 20:46:26 -- common/autotest_common.sh@10 -- # set +x 00:29:08.247 ************************************ 00:29:08.247 END TEST nvmf_discovery_remove_ifc 00:29:08.247 ************************************ 00:29:08.247 20:46:26 -- nvmf/nvmf.sh@105 -- # [[ tcp == \t\c\p ]] 00:29:08.247 20:46:26 -- nvmf/nvmf.sh@106 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:08.247 20:46:26 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:08.247 20:46:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:08.247 20:46:26 -- common/autotest_common.sh@10 -- # set +x 00:29:08.247 ************************************ 00:29:08.247 START TEST nvmf_digest 00:29:08.247 ************************************ 00:29:08.247 20:46:26 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:08.247 * Looking for test storage... 00:29:08.247 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:08.247 20:46:26 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:08.247 20:46:26 -- nvmf/common.sh@7 -- # uname -s 00:29:08.247 20:46:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:08.247 20:46:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:08.247 20:46:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:08.247 20:46:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:08.247 20:46:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:08.247 20:46:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:08.247 20:46:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:08.247 20:46:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:08.247 20:46:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:08.247 20:46:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:08.247 20:46:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:29:08.247 20:46:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:29:08.247 20:46:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:08.247 20:46:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:08.247 20:46:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:08.247 20:46:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:08.247 20:46:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:08.247 20:46:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:08.247 20:46:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:08.247 20:46:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:08.247 20:46:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:08.247 20:46:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:08.247 20:46:26 -- paths/export.sh@5 -- # export PATH 00:29:08.247 20:46:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:08.247 20:46:26 -- nvmf/common.sh@46 -- # : 0 00:29:08.247 20:46:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:08.247 20:46:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:08.247 20:46:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:08.247 20:46:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:08.247 20:46:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:08.247 20:46:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:08.247 20:46:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:08.247 20:46:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:08.247 20:46:26 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:08.247 20:46:26 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:08.247 20:46:26 -- host/digest.sh@16 -- # runtime=2 00:29:08.247 20:46:26 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:08.247 20:46:26 -- host/digest.sh@132 -- # nvmftestinit 00:29:08.247 20:46:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:08.247 20:46:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:08.247 20:46:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:08.248 20:46:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:08.248 20:46:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:08.248 20:46:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:08.248 20:46:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:08.248 20:46:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:08.248 20:46:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:08.248 20:46:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:08.248 20:46:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:08.248 20:46:26 -- common/autotest_common.sh@10 -- # set +x 00:29:14.843 20:46:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:14.843 20:46:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:14.843 20:46:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:14.843 20:46:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:14.843 20:46:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:14.843 20:46:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:14.843 20:46:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:14.843 20:46:32 -- nvmf/common.sh@294 -- # net_devs=() 00:29:14.843 20:46:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:14.843 20:46:32 -- nvmf/common.sh@295 -- # e810=() 00:29:14.843 20:46:32 -- nvmf/common.sh@295 -- # local -ga e810 00:29:14.843 20:46:32 -- nvmf/common.sh@296 -- # x722=() 00:29:14.843 20:46:32 -- nvmf/common.sh@296 -- # local -ga x722 00:29:14.843 20:46:32 -- nvmf/common.sh@297 -- # mlx=() 00:29:14.843 20:46:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:14.843 20:46:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:14.843 20:46:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:14.843 20:46:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:14.843 20:46:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:14.843 20:46:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:14.843 20:46:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:14.843 20:46:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:14.843 20:46:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:14.843 20:46:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:14.843 20:46:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:14.843 20:46:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:14.843 20:46:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:14.843 20:46:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:14.843 20:46:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:14.843 20:46:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:14.843 20:46:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:29:14.843 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:29:14.843 20:46:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:14.843 20:46:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:29:14.843 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:29:14.843 20:46:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:14.843 20:46:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:14.843 20:46:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:14.843 20:46:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:14.843 20:46:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:14.843 20:46:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:29:14.843 Found net devices under 0000:4b:00.0: cvl_0_0 00:29:14.843 20:46:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:14.843 20:46:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:14.843 20:46:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:14.843 20:46:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:14.843 20:46:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:14.843 20:46:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:29:14.843 Found net devices under 0000:4b:00.1: cvl_0_1 00:29:14.843 20:46:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:14.843 20:46:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:14.843 20:46:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:14.843 20:46:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:14.843 20:46:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:14.843 20:46:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:14.843 20:46:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:14.843 20:46:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:14.843 20:46:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:14.843 20:46:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:14.843 20:46:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:14.843 20:46:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:14.843 20:46:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:14.843 20:46:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:14.843 20:46:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:14.843 20:46:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:14.844 20:46:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:14.844 20:46:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:14.844 20:46:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:14.844 20:46:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:14.844 20:46:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:14.844 20:46:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:15.107 20:46:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:15.107 20:46:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:15.107 20:46:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:15.107 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:15.107 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.544 ms 00:29:15.107 00:29:15.107 --- 10.0.0.2 ping statistics --- 00:29:15.107 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:15.107 rtt min/avg/max/mdev = 0.544/0.544/0.544/0.000 ms 00:29:15.107 20:46:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:15.107 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:15.107 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.366 ms 00:29:15.107 00:29:15.107 --- 10.0.0.1 ping statistics --- 00:29:15.107 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:15.107 rtt min/avg/max/mdev = 0.366/0.366/0.366/0.000 ms 00:29:15.107 20:46:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:15.107 20:46:33 -- nvmf/common.sh@410 -- # return 0 00:29:15.107 20:46:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:15.107 20:46:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:15.107 20:46:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:15.107 20:46:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:15.107 20:46:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:15.107 20:46:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:15.107 20:46:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:15.107 20:46:33 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:15.107 20:46:33 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:15.107 20:46:33 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:15.107 20:46:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:15.107 20:46:33 -- common/autotest_common.sh@10 -- # set +x 00:29:15.107 ************************************ 00:29:15.107 START TEST nvmf_digest_clean 00:29:15.107 ************************************ 00:29:15.107 20:46:33 -- common/autotest_common.sh@1104 -- # run_digest 00:29:15.107 20:46:33 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:15.107 20:46:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:15.107 20:46:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:15.107 20:46:33 -- common/autotest_common.sh@10 -- # set +x 00:29:15.107 20:46:33 -- nvmf/common.sh@469 -- # nvmfpid=41940 00:29:15.107 20:46:33 -- nvmf/common.sh@470 -- # waitforlisten 41940 00:29:15.107 20:46:33 -- common/autotest_common.sh@819 -- # '[' -z 41940 ']' 00:29:15.107 20:46:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:15.107 20:46:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:15.107 20:46:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:15.107 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:15.107 20:46:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:15.107 20:46:33 -- common/autotest_common.sh@10 -- # set +x 00:29:15.107 20:46:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:15.107 [2024-04-26 20:46:33.352565] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:15.108 [2024-04-26 20:46:33.352616] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:15.108 EAL: No free 2048 kB hugepages reported on node 1 00:29:15.108 [2024-04-26 20:46:33.417780] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:15.369 [2024-04-26 20:46:33.482302] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:15.369 [2024-04-26 20:46:33.482414] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:15.369 [2024-04-26 20:46:33.482422] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:15.369 [2024-04-26 20:46:33.482429] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:15.369 [2024-04-26 20:46:33.482445] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:15.939 20:46:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:15.939 20:46:34 -- common/autotest_common.sh@852 -- # return 0 00:29:15.939 20:46:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:15.939 20:46:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:15.939 20:46:34 -- common/autotest_common.sh@10 -- # set +x 00:29:15.939 20:46:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:15.939 20:46:34 -- host/digest.sh@120 -- # common_target_config 00:29:15.939 20:46:34 -- host/digest.sh@43 -- # rpc_cmd 00:29:15.939 20:46:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:15.939 20:46:34 -- common/autotest_common.sh@10 -- # set +x 00:29:15.939 null0 00:29:15.939 [2024-04-26 20:46:34.208941] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:15.939 [2024-04-26 20:46:34.233093] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:15.939 20:46:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:15.939 20:46:34 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:15.939 20:46:34 -- host/digest.sh@77 -- # local rw bs qd 00:29:15.939 20:46:34 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:15.939 20:46:34 -- host/digest.sh@80 -- # rw=randread 00:29:15.939 20:46:34 -- host/digest.sh@80 -- # bs=4096 00:29:15.939 20:46:34 -- host/digest.sh@80 -- # qd=128 00:29:15.939 20:46:34 -- host/digest.sh@82 -- # bperfpid=42265 00:29:15.939 20:46:34 -- host/digest.sh@83 -- # waitforlisten 42265 /var/tmp/bperf.sock 00:29:15.939 20:46:34 -- common/autotest_common.sh@819 -- # '[' -z 42265 ']' 00:29:15.939 20:46:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:15.939 20:46:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:15.939 20:46:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:15.939 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:15.939 20:46:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:15.939 20:46:34 -- common/autotest_common.sh@10 -- # set +x 00:29:15.939 20:46:34 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:15.939 [2024-04-26 20:46:34.282794] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:15.939 [2024-04-26 20:46:34.282842] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid42265 ] 00:29:16.200 EAL: No free 2048 kB hugepages reported on node 1 00:29:16.200 [2024-04-26 20:46:34.340177] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:16.200 [2024-04-26 20:46:34.401854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:16.771 20:46:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:16.771 20:46:35 -- common/autotest_common.sh@852 -- # return 0 00:29:16.771 20:46:35 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:16.771 20:46:35 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:16.771 20:46:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:17.033 20:46:35 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:17.033 20:46:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:17.295 nvme0n1 00:29:17.295 20:46:35 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:17.295 20:46:35 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:17.556 Running I/O for 2 seconds... 00:29:19.470 00:29:19.470 Latency(us) 00:29:19.470 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:19.470 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:19.470 nvme0n1 : 2.00 22630.73 88.40 0.00 0.00 5649.11 3058.35 13271.04 00:29:19.470 =================================================================================================================== 00:29:19.470 Total : 22630.73 88.40 0.00 0.00 5649.11 3058.35 13271.04 00:29:19.470 0 00:29:19.470 20:46:37 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:19.470 20:46:37 -- host/digest.sh@92 -- # get_accel_stats 00:29:19.470 20:46:37 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:19.470 20:46:37 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:19.470 | select(.opcode=="crc32c") 00:29:19.470 | "\(.module_name) \(.executed)"' 00:29:19.470 20:46:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:19.731 20:46:37 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:19.731 20:46:37 -- host/digest.sh@93 -- # exp_module=software 00:29:19.731 20:46:37 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:19.731 20:46:37 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:19.731 20:46:37 -- host/digest.sh@97 -- # killprocess 42265 00:29:19.731 20:46:37 -- common/autotest_common.sh@926 -- # '[' -z 42265 ']' 00:29:19.731 20:46:37 -- common/autotest_common.sh@930 -- # kill -0 42265 00:29:19.731 20:46:37 -- common/autotest_common.sh@931 -- # uname 00:29:19.731 20:46:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:19.731 20:46:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 42265 00:29:19.731 20:46:37 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:19.731 20:46:37 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:19.731 20:46:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 42265' 00:29:19.731 killing process with pid 42265 00:29:19.731 20:46:37 -- common/autotest_common.sh@945 -- # kill 42265 00:29:19.731 Received shutdown signal, test time was about 2.000000 seconds 00:29:19.731 00:29:19.731 Latency(us) 00:29:19.731 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:19.731 =================================================================================================================== 00:29:19.731 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:19.731 20:46:37 -- common/autotest_common.sh@950 -- # wait 42265 00:29:19.731 20:46:38 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:19.731 20:46:38 -- host/digest.sh@77 -- # local rw bs qd 00:29:19.731 20:46:38 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:19.731 20:46:38 -- host/digest.sh@80 -- # rw=randread 00:29:19.731 20:46:38 -- host/digest.sh@80 -- # bs=131072 00:29:19.731 20:46:38 -- host/digest.sh@80 -- # qd=16 00:29:19.731 20:46:38 -- host/digest.sh@82 -- # bperfpid=42962 00:29:19.731 20:46:38 -- host/digest.sh@83 -- # waitforlisten 42962 /var/tmp/bperf.sock 00:29:19.731 20:46:38 -- common/autotest_common.sh@819 -- # '[' -z 42962 ']' 00:29:19.731 20:46:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:19.731 20:46:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:19.731 20:46:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:19.731 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:19.731 20:46:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:19.731 20:46:38 -- common/autotest_common.sh@10 -- # set +x 00:29:19.731 20:46:38 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:19.731 [2024-04-26 20:46:38.052091] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:19.731 [2024-04-26 20:46:38.052146] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid42962 ] 00:29:19.731 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:19.731 Zero copy mechanism will not be used. 00:29:19.992 EAL: No free 2048 kB hugepages reported on node 1 00:29:19.992 [2024-04-26 20:46:38.109565] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:19.992 [2024-04-26 20:46:38.170815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:20.565 20:46:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:20.565 20:46:38 -- common/autotest_common.sh@852 -- # return 0 00:29:20.565 20:46:38 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:20.565 20:46:38 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:20.565 20:46:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:20.826 20:46:39 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:20.826 20:46:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:21.087 nvme0n1 00:29:21.087 20:46:39 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:21.087 20:46:39 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:21.347 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:21.347 Zero copy mechanism will not be used. 00:29:21.347 Running I/O for 2 seconds... 00:29:23.264 00:29:23.264 Latency(us) 00:29:23.264 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:23.264 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:23.264 nvme0n1 : 2.00 2470.56 308.82 0.00 0.00 6472.00 3495.25 10868.05 00:29:23.264 =================================================================================================================== 00:29:23.264 Total : 2470.56 308.82 0.00 0.00 6472.00 3495.25 10868.05 00:29:23.264 0 00:29:23.264 20:46:41 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:23.264 20:46:41 -- host/digest.sh@92 -- # get_accel_stats 00:29:23.264 20:46:41 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:23.264 20:46:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:23.264 20:46:41 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:23.264 | select(.opcode=="crc32c") 00:29:23.264 | "\(.module_name) \(.executed)"' 00:29:23.524 20:46:41 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:23.525 20:46:41 -- host/digest.sh@93 -- # exp_module=software 00:29:23.525 20:46:41 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:23.525 20:46:41 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:23.525 20:46:41 -- host/digest.sh@97 -- # killprocess 42962 00:29:23.525 20:46:41 -- common/autotest_common.sh@926 -- # '[' -z 42962 ']' 00:29:23.525 20:46:41 -- common/autotest_common.sh@930 -- # kill -0 42962 00:29:23.525 20:46:41 -- common/autotest_common.sh@931 -- # uname 00:29:23.525 20:46:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:23.525 20:46:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 42962 00:29:23.525 20:46:41 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:23.525 20:46:41 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:23.525 20:46:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 42962' 00:29:23.525 killing process with pid 42962 00:29:23.525 20:46:41 -- common/autotest_common.sh@945 -- # kill 42962 00:29:23.525 Received shutdown signal, test time was about 2.000000 seconds 00:29:23.525 00:29:23.525 Latency(us) 00:29:23.525 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:23.525 =================================================================================================================== 00:29:23.525 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:23.525 20:46:41 -- common/autotest_common.sh@950 -- # wait 42962 00:29:23.525 20:46:41 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:23.525 20:46:41 -- host/digest.sh@77 -- # local rw bs qd 00:29:23.525 20:46:41 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:23.525 20:46:41 -- host/digest.sh@80 -- # rw=randwrite 00:29:23.525 20:46:41 -- host/digest.sh@80 -- # bs=4096 00:29:23.525 20:46:41 -- host/digest.sh@80 -- # qd=128 00:29:23.525 20:46:41 -- host/digest.sh@82 -- # bperfpid=43655 00:29:23.525 20:46:41 -- host/digest.sh@83 -- # waitforlisten 43655 /var/tmp/bperf.sock 00:29:23.525 20:46:41 -- common/autotest_common.sh@819 -- # '[' -z 43655 ']' 00:29:23.525 20:46:41 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:23.525 20:46:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:23.525 20:46:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:23.525 20:46:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:23.525 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:23.525 20:46:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:23.525 20:46:41 -- common/autotest_common.sh@10 -- # set +x 00:29:23.785 [2024-04-26 20:46:41.889958] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:23.785 [2024-04-26 20:46:41.890013] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid43655 ] 00:29:23.785 EAL: No free 2048 kB hugepages reported on node 1 00:29:23.785 [2024-04-26 20:46:41.947269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:23.785 [2024-04-26 20:46:42.008613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:24.358 20:46:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:24.358 20:46:42 -- common/autotest_common.sh@852 -- # return 0 00:29:24.358 20:46:42 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:24.358 20:46:42 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:24.358 20:46:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:24.618 20:46:42 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:24.618 20:46:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:24.879 nvme0n1 00:29:24.879 20:46:43 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:24.879 20:46:43 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:24.879 Running I/O for 2 seconds... 00:29:27.423 00:29:27.423 Latency(us) 00:29:27.423 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:27.423 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:27.423 nvme0n1 : 2.00 22515.22 87.95 0.00 0.00 5679.13 2921.81 17585.49 00:29:27.423 =================================================================================================================== 00:29:27.423 Total : 22515.22 87.95 0.00 0.00 5679.13 2921.81 17585.49 00:29:27.423 0 00:29:27.423 20:46:45 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:27.423 20:46:45 -- host/digest.sh@92 -- # get_accel_stats 00:29:27.423 20:46:45 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:27.423 20:46:45 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:27.423 | select(.opcode=="crc32c") 00:29:27.423 | "\(.module_name) \(.executed)"' 00:29:27.423 20:46:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:27.423 20:46:45 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:27.423 20:46:45 -- host/digest.sh@93 -- # exp_module=software 00:29:27.423 20:46:45 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:27.423 20:46:45 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:27.423 20:46:45 -- host/digest.sh@97 -- # killprocess 43655 00:29:27.423 20:46:45 -- common/autotest_common.sh@926 -- # '[' -z 43655 ']' 00:29:27.423 20:46:45 -- common/autotest_common.sh@930 -- # kill -0 43655 00:29:27.423 20:46:45 -- common/autotest_common.sh@931 -- # uname 00:29:27.423 20:46:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:27.423 20:46:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 43655 00:29:27.423 20:46:45 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:27.423 20:46:45 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:27.423 20:46:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 43655' 00:29:27.423 killing process with pid 43655 00:29:27.423 20:46:45 -- common/autotest_common.sh@945 -- # kill 43655 00:29:27.423 Received shutdown signal, test time was about 2.000000 seconds 00:29:27.423 00:29:27.423 Latency(us) 00:29:27.423 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:27.423 =================================================================================================================== 00:29:27.423 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:27.423 20:46:45 -- common/autotest_common.sh@950 -- # wait 43655 00:29:27.423 20:46:45 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:27.423 20:46:45 -- host/digest.sh@77 -- # local rw bs qd 00:29:27.423 20:46:45 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:27.423 20:46:45 -- host/digest.sh@80 -- # rw=randwrite 00:29:27.423 20:46:45 -- host/digest.sh@80 -- # bs=131072 00:29:27.423 20:46:45 -- host/digest.sh@80 -- # qd=16 00:29:27.423 20:46:45 -- host/digest.sh@82 -- # bperfpid=44363 00:29:27.423 20:46:45 -- host/digest.sh@83 -- # waitforlisten 44363 /var/tmp/bperf.sock 00:29:27.423 20:46:45 -- common/autotest_common.sh@819 -- # '[' -z 44363 ']' 00:29:27.423 20:46:45 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:27.423 20:46:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:27.424 20:46:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:27.424 20:46:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:27.424 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:27.424 20:46:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:27.424 20:46:45 -- common/autotest_common.sh@10 -- # set +x 00:29:27.424 [2024-04-26 20:46:45.634920] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:27.424 [2024-04-26 20:46:45.634976] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid44363 ] 00:29:27.424 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:27.424 Zero copy mechanism will not be used. 00:29:27.424 EAL: No free 2048 kB hugepages reported on node 1 00:29:27.424 [2024-04-26 20:46:45.692670] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:27.424 [2024-04-26 20:46:45.754592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:28.368 20:46:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:28.368 20:46:46 -- common/autotest_common.sh@852 -- # return 0 00:29:28.368 20:46:46 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:28.368 20:46:46 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:28.368 20:46:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:28.368 20:46:46 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:28.368 20:46:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:28.629 nvme0n1 00:29:28.629 20:46:46 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:28.629 20:46:46 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:28.629 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:28.629 Zero copy mechanism will not be used. 00:29:28.629 Running I/O for 2 seconds... 00:29:31.177 00:29:31.177 Latency(us) 00:29:31.177 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:31.177 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:31.177 nvme0n1 : 2.01 2474.39 309.30 0.00 0.00 6455.01 4614.83 21626.88 00:29:31.177 =================================================================================================================== 00:29:31.177 Total : 2474.39 309.30 0.00 0.00 6455.01 4614.83 21626.88 00:29:31.177 0 00:29:31.177 20:46:48 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:31.177 20:46:48 -- host/digest.sh@92 -- # get_accel_stats 00:29:31.178 20:46:48 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:31.178 20:46:48 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:31.178 | select(.opcode=="crc32c") 00:29:31.178 | "\(.module_name) \(.executed)"' 00:29:31.178 20:46:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:31.178 20:46:49 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:31.178 20:46:49 -- host/digest.sh@93 -- # exp_module=software 00:29:31.178 20:46:49 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:31.178 20:46:49 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:31.178 20:46:49 -- host/digest.sh@97 -- # killprocess 44363 00:29:31.178 20:46:49 -- common/autotest_common.sh@926 -- # '[' -z 44363 ']' 00:29:31.178 20:46:49 -- common/autotest_common.sh@930 -- # kill -0 44363 00:29:31.178 20:46:49 -- common/autotest_common.sh@931 -- # uname 00:29:31.178 20:46:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:31.178 20:46:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 44363 00:29:31.178 20:46:49 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:31.178 20:46:49 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:31.178 20:46:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 44363' 00:29:31.178 killing process with pid 44363 00:29:31.178 20:46:49 -- common/autotest_common.sh@945 -- # kill 44363 00:29:31.178 Received shutdown signal, test time was about 2.000000 seconds 00:29:31.178 00:29:31.178 Latency(us) 00:29:31.178 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:31.178 =================================================================================================================== 00:29:31.178 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:31.178 20:46:49 -- common/autotest_common.sh@950 -- # wait 44363 00:29:31.178 20:46:49 -- host/digest.sh@126 -- # killprocess 41940 00:29:31.178 20:46:49 -- common/autotest_common.sh@926 -- # '[' -z 41940 ']' 00:29:31.178 20:46:49 -- common/autotest_common.sh@930 -- # kill -0 41940 00:29:31.178 20:46:49 -- common/autotest_common.sh@931 -- # uname 00:29:31.178 20:46:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:31.178 20:46:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 41940 00:29:31.178 20:46:49 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:31.178 20:46:49 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:31.178 20:46:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 41940' 00:29:31.178 killing process with pid 41940 00:29:31.178 20:46:49 -- common/autotest_common.sh@945 -- # kill 41940 00:29:31.178 20:46:49 -- common/autotest_common.sh@950 -- # wait 41940 00:29:31.178 00:29:31.178 real 0m16.178s 00:29:31.178 user 0m31.340s 00:29:31.178 sys 0m3.331s 00:29:31.178 20:46:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:31.178 20:46:49 -- common/autotest_common.sh@10 -- # set +x 00:29:31.178 ************************************ 00:29:31.178 END TEST nvmf_digest_clean 00:29:31.178 ************************************ 00:29:31.178 20:46:49 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:31.178 20:46:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:31.178 20:46:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:31.178 20:46:49 -- common/autotest_common.sh@10 -- # set +x 00:29:31.178 ************************************ 00:29:31.178 START TEST nvmf_digest_error 00:29:31.178 ************************************ 00:29:31.178 20:46:49 -- common/autotest_common.sh@1104 -- # run_digest_error 00:29:31.178 20:46:49 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:31.178 20:46:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:31.178 20:46:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:31.178 20:46:49 -- common/autotest_common.sh@10 -- # set +x 00:29:31.439 20:46:49 -- nvmf/common.sh@469 -- # nvmfpid=45266 00:29:31.439 20:46:49 -- nvmf/common.sh@470 -- # waitforlisten 45266 00:29:31.439 20:46:49 -- common/autotest_common.sh@819 -- # '[' -z 45266 ']' 00:29:31.439 20:46:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:31.439 20:46:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:31.439 20:46:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:31.439 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:31.439 20:46:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:31.439 20:46:49 -- common/autotest_common.sh@10 -- # set +x 00:29:31.439 20:46:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:31.439 [2024-04-26 20:46:49.568926] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:31.439 [2024-04-26 20:46:49.568981] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:31.439 EAL: No free 2048 kB hugepages reported on node 1 00:29:31.439 [2024-04-26 20:46:49.632246] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:31.439 [2024-04-26 20:46:49.694833] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:31.439 [2024-04-26 20:46:49.694950] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:31.439 [2024-04-26 20:46:49.694959] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:31.439 [2024-04-26 20:46:49.694965] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:31.439 [2024-04-26 20:46:49.694987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:32.010 20:46:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:32.010 20:46:50 -- common/autotest_common.sh@852 -- # return 0 00:29:32.010 20:46:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:32.010 20:46:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:32.010 20:46:50 -- common/autotest_common.sh@10 -- # set +x 00:29:32.271 20:46:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:32.271 20:46:50 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:32.271 20:46:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.271 20:46:50 -- common/autotest_common.sh@10 -- # set +x 00:29:32.271 [2024-04-26 20:46:50.368917] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:32.271 20:46:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.271 20:46:50 -- host/digest.sh@104 -- # common_target_config 00:29:32.271 20:46:50 -- host/digest.sh@43 -- # rpc_cmd 00:29:32.271 20:46:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:32.271 20:46:50 -- common/autotest_common.sh@10 -- # set +x 00:29:32.271 null0 00:29:32.271 [2024-04-26 20:46:50.445553] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:32.271 [2024-04-26 20:46:50.469735] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:32.271 20:46:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:32.271 20:46:50 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:32.271 20:46:50 -- host/digest.sh@54 -- # local rw bs qd 00:29:32.271 20:46:50 -- host/digest.sh@56 -- # rw=randread 00:29:32.271 20:46:50 -- host/digest.sh@56 -- # bs=4096 00:29:32.271 20:46:50 -- host/digest.sh@56 -- # qd=128 00:29:32.271 20:46:50 -- host/digest.sh@58 -- # bperfpid=45409 00:29:32.271 20:46:50 -- host/digest.sh@60 -- # waitforlisten 45409 /var/tmp/bperf.sock 00:29:32.271 20:46:50 -- common/autotest_common.sh@819 -- # '[' -z 45409 ']' 00:29:32.271 20:46:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:32.271 20:46:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:32.271 20:46:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:32.272 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:32.272 20:46:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:32.272 20:46:50 -- common/autotest_common.sh@10 -- # set +x 00:29:32.272 20:46:50 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:32.272 [2024-04-26 20:46:50.520041] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:32.272 [2024-04-26 20:46:50.520089] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid45409 ] 00:29:32.272 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.272 [2024-04-26 20:46:50.577451] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:32.533 [2024-04-26 20:46:50.639596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:33.105 20:46:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:33.105 20:46:51 -- common/autotest_common.sh@852 -- # return 0 00:29:33.105 20:46:51 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:33.105 20:46:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:33.105 20:46:51 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:33.105 20:46:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.105 20:46:51 -- common/autotest_common.sh@10 -- # set +x 00:29:33.105 20:46:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.105 20:46:51 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:33.105 20:46:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:33.365 nvme0n1 00:29:33.365 20:46:51 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:33.365 20:46:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.365 20:46:51 -- common/autotest_common.sh@10 -- # set +x 00:29:33.626 20:46:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.626 20:46:51 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:33.626 20:46:51 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:33.626 Running I/O for 2 seconds... 00:29:33.626 [2024-04-26 20:46:51.817318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.626 [2024-04-26 20:46:51.817355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25171 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.626 [2024-04-26 20:46:51.817366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.626 [2024-04-26 20:46:51.836666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.626 [2024-04-26 20:46:51.836692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13111 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.626 [2024-04-26 20:46:51.836702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.626 [2024-04-26 20:46:51.855908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.626 [2024-04-26 20:46:51.855933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20462 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.626 [2024-04-26 20:46:51.855942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.626 [2024-04-26 20:46:51.875237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.626 [2024-04-26 20:46:51.875260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15118 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.626 [2024-04-26 20:46:51.875269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.626 [2024-04-26 20:46:51.894531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.626 [2024-04-26 20:46:51.894555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9913 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.626 [2024-04-26 20:46:51.894564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.626 [2024-04-26 20:46:51.913913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.626 [2024-04-26 20:46:51.913937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2481 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.626 [2024-04-26 20:46:51.913946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.626 [2024-04-26 20:46:51.932934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.626 [2024-04-26 20:46:51.932956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5651 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.626 [2024-04-26 20:46:51.932965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.626 [2024-04-26 20:46:51.952026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.626 [2024-04-26 20:46:51.952048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18815 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.626 [2024-04-26 20:46:51.952056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:51.971344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:51.971371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:4519 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:51.971380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:51.990461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:51.990483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25367 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:51.990491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:52.009101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:52.009124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:22294 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:52.009133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:52.028022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:52.028044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:17543 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:52.028053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:52.047304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:52.047326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:5797 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:52.047335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:52.066402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:52.066424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:14203 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:52.066432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:52.085628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:52.085649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:19188 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:52.085658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:52.104812] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:52.104834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:22126 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:52.104843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:52.123659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:52.123681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:23464 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:52.123690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:52.142651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:52.142673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20701 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:52.142682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:52.161913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:52.161934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12060 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:52.161943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:52.181358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:52.181380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13937 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:52.181389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:52.200392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:52.200414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25364 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:52.200423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:33.889 [2024-04-26 20:46:52.219624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:33.889 [2024-04-26 20:46:52.219646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11570 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.889 [2024-04-26 20:46:52.219655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.150 [2024-04-26 20:46:52.239082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.150 [2024-04-26 20:46:52.239104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19562 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.150 [2024-04-26 20:46:52.239112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.150 [2024-04-26 20:46:52.258201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.150 [2024-04-26 20:46:52.258223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16055 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.150 [2024-04-26 20:46:52.258231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.150 [2024-04-26 20:46:52.277377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.150 [2024-04-26 20:46:52.277398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19903 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.150 [2024-04-26 20:46:52.277406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.150 [2024-04-26 20:46:52.296532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.150 [2024-04-26 20:46:52.296553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:16472 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.150 [2024-04-26 20:46:52.296565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.150 [2024-04-26 20:46:52.315613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.150 [2024-04-26 20:46:52.315635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:18733 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.150 [2024-04-26 20:46:52.315643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.150 [2024-04-26 20:46:52.334628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.150 [2024-04-26 20:46:52.334648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25178 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.150 [2024-04-26 20:46:52.334657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.150 [2024-04-26 20:46:52.353779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.150 [2024-04-26 20:46:52.353799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:20720 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.150 [2024-04-26 20:46:52.353808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.151 [2024-04-26 20:46:52.372979] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.151 [2024-04-26 20:46:52.373000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22050 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.151 [2024-04-26 20:46:52.373008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.151 [2024-04-26 20:46:52.391736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.151 [2024-04-26 20:46:52.391757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5921 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.151 [2024-04-26 20:46:52.391765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.151 [2024-04-26 20:46:52.410818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.151 [2024-04-26 20:46:52.410840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:3940 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.151 [2024-04-26 20:46:52.410848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.151 [2024-04-26 20:46:52.430030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.151 [2024-04-26 20:46:52.430051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:7259 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.151 [2024-04-26 20:46:52.430060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.151 [2024-04-26 20:46:52.449218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.151 [2024-04-26 20:46:52.449240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:23634 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.151 [2024-04-26 20:46:52.449249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.151 [2024-04-26 20:46:52.468488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.151 [2024-04-26 20:46:52.468509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:5492 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.151 [2024-04-26 20:46:52.468518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.151 [2024-04-26 20:46:52.487759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.151 [2024-04-26 20:46:52.487781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:1230 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.151 [2024-04-26 20:46:52.487789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.412 [2024-04-26 20:46:52.507048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.412 [2024-04-26 20:46:52.507069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:17447 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.412 [2024-04-26 20:46:52.507078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.412 [2024-04-26 20:46:52.526105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.412 [2024-04-26 20:46:52.526126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:5272 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.412 [2024-04-26 20:46:52.526136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.412 [2024-04-26 20:46:52.545199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.412 [2024-04-26 20:46:52.545220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:19141 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.412 [2024-04-26 20:46:52.545229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.412 [2024-04-26 20:46:52.564628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.412 [2024-04-26 20:46:52.564650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:6273 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.412 [2024-04-26 20:46:52.564659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.412 [2024-04-26 20:46:52.583546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.412 [2024-04-26 20:46:52.583568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:2791 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.412 [2024-04-26 20:46:52.583578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.412 [2024-04-26 20:46:52.602606] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.412 [2024-04-26 20:46:52.602628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:11927 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.412 [2024-04-26 20:46:52.602637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.412 [2024-04-26 20:46:52.621518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.412 [2024-04-26 20:46:52.621540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:5919 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.412 [2024-04-26 20:46:52.621552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.412 [2024-04-26 20:46:52.640600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.412 [2024-04-26 20:46:52.640622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:343 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.412 [2024-04-26 20:46:52.640632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.412 [2024-04-26 20:46:52.659861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.412 [2024-04-26 20:46:52.659882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:1955 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.412 [2024-04-26 20:46:52.659891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.412 [2024-04-26 20:46:52.679256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.412 [2024-04-26 20:46:52.679283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9695 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.412 [2024-04-26 20:46:52.679292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.412 [2024-04-26 20:46:52.698741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.412 [2024-04-26 20:46:52.698763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9729 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.413 [2024-04-26 20:46:52.698772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.413 [2024-04-26 20:46:52.718209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.413 [2024-04-26 20:46:52.718231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:12570 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.413 [2024-04-26 20:46:52.718240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.413 [2024-04-26 20:46:52.737473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.413 [2024-04-26 20:46:52.737494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:11214 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.413 [2024-04-26 20:46:52.737503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.674 [2024-04-26 20:46:52.756776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.674 [2024-04-26 20:46:52.756797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:6131 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.674 [2024-04-26 20:46:52.756806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.674 [2024-04-26 20:46:52.775932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.674 [2024-04-26 20:46:52.775953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:3160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.674 [2024-04-26 20:46:52.775963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.674 [2024-04-26 20:46:52.794703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.674 [2024-04-26 20:46:52.794728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:7812 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.674 [2024-04-26 20:46:52.794737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.674 [2024-04-26 20:46:52.814159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.674 [2024-04-26 20:46:52.814180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:18769 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.674 [2024-04-26 20:46:52.814189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.674 [2024-04-26 20:46:52.833355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.674 [2024-04-26 20:46:52.833376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:10821 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.674 [2024-04-26 20:46:52.833385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.674 [2024-04-26 20:46:52.852490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.674 [2024-04-26 20:46:52.852511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:22147 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.674 [2024-04-26 20:46:52.852520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.674 [2024-04-26 20:46:52.871681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.674 [2024-04-26 20:46:52.871702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:11069 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.674 [2024-04-26 20:46:52.871711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.674 [2024-04-26 20:46:52.891105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.674 [2024-04-26 20:46:52.891127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:2174 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.674 [2024-04-26 20:46:52.891136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.674 [2024-04-26 20:46:52.910223] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.674 [2024-04-26 20:46:52.910244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21555 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.674 [2024-04-26 20:46:52.910253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.674 [2024-04-26 20:46:52.929472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.674 [2024-04-26 20:46:52.929494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:9804 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.674 [2024-04-26 20:46:52.929503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.675 [2024-04-26 20:46:52.948752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.675 [2024-04-26 20:46:52.948774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:2527 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.675 [2024-04-26 20:46:52.948783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.675 [2024-04-26 20:46:52.968044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.675 [2024-04-26 20:46:52.968065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:21021 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.675 [2024-04-26 20:46:52.968074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.675 [2024-04-26 20:46:52.987283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.675 [2024-04-26 20:46:52.987305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:3347 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.675 [2024-04-26 20:46:52.987314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.675 [2024-04-26 20:46:53.006426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.675 [2024-04-26 20:46:53.006447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:4340 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.675 [2024-04-26 20:46:53.006456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.936 [2024-04-26 20:46:53.034072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.936 [2024-04-26 20:46:53.034095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:16372 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.936 [2024-04-26 20:46:53.034105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.936 [2024-04-26 20:46:53.053320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.936 [2024-04-26 20:46:53.053342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:7522 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.936 [2024-04-26 20:46:53.053351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.936 [2024-04-26 20:46:53.072329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.936 [2024-04-26 20:46:53.072351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22051 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.936 [2024-04-26 20:46:53.072360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.936 [2024-04-26 20:46:53.091711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.936 [2024-04-26 20:46:53.091733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:22824 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.936 [2024-04-26 20:46:53.091742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.936 [2024-04-26 20:46:53.111022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.936 [2024-04-26 20:46:53.111043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:11252 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.936 [2024-04-26 20:46:53.111052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.936 [2024-04-26 20:46:53.129679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.936 [2024-04-26 20:46:53.129700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7667 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.936 [2024-04-26 20:46:53.129713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.936 [2024-04-26 20:46:53.148922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.936 [2024-04-26 20:46:53.148945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:21655 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.936 [2024-04-26 20:46:53.148954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.936 [2024-04-26 20:46:53.168248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.936 [2024-04-26 20:46:53.168270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:8453 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.936 [2024-04-26 20:46:53.168284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.936 [2024-04-26 20:46:53.187623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.936 [2024-04-26 20:46:53.187644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:19274 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.936 [2024-04-26 20:46:53.187653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.936 [2024-04-26 20:46:53.206870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.937 [2024-04-26 20:46:53.206892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:18918 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.937 [2024-04-26 20:46:53.206901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.937 [2024-04-26 20:46:53.226104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.937 [2024-04-26 20:46:53.226126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:21390 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.937 [2024-04-26 20:46:53.226135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.937 [2024-04-26 20:46:53.245315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.937 [2024-04-26 20:46:53.245337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:5143 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.937 [2024-04-26 20:46:53.245346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.937 [2024-04-26 20:46:53.264397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:34.937 [2024-04-26 20:46:53.264419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:24656 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.937 [2024-04-26 20:46:53.264428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.283566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.283589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:17343 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.283598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.302716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.302741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:22043 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.302750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.322027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.322049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:348 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.322058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.341309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.341331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6222 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.341340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.360503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.360525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16501 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.360534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.379934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.379957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23872 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.379966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.399256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.399284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6468 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.399293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.418556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.418577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14717 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.418586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.437834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.437856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24941 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.437865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.457342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.457363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19950 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.457372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.476525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.476547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:20394 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.476556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.495655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.495677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:22793 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.495686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.514872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.514893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:6780 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.514902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.197 [2024-04-26 20:46:53.533948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.197 [2024-04-26 20:46:53.533970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:19206 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.197 [2024-04-26 20:46:53.533978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.457 [2024-04-26 20:46:53.553125] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.457 [2024-04-26 20:46:53.553147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:21980 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.457 [2024-04-26 20:46:53.553156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.457 [2024-04-26 20:46:53.572273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.457 [2024-04-26 20:46:53.572297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:8458 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.457 [2024-04-26 20:46:53.572305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.457 [2024-04-26 20:46:53.591483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.457 [2024-04-26 20:46:53.591505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:2025 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.457 [2024-04-26 20:46:53.591514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.457 [2024-04-26 20:46:53.610825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.458 [2024-04-26 20:46:53.610847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:17242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.458 [2024-04-26 20:46:53.610856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.458 [2024-04-26 20:46:53.629547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.458 [2024-04-26 20:46:53.629572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:23705 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.458 [2024-04-26 20:46:53.629582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.458 [2024-04-26 20:46:53.648801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.458 [2024-04-26 20:46:53.648822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:9865 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.458 [2024-04-26 20:46:53.648831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.458 [2024-04-26 20:46:53.668217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.458 [2024-04-26 20:46:53.668238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:14440 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.458 [2024-04-26 20:46:53.668247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.458 [2024-04-26 20:46:53.687421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.458 [2024-04-26 20:46:53.687442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:21419 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.458 [2024-04-26 20:46:53.687451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.458 [2024-04-26 20:46:53.706671] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.458 [2024-04-26 20:46:53.706693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:23052 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.458 [2024-04-26 20:46:53.706702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.458 [2024-04-26 20:46:53.725721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.458 [2024-04-26 20:46:53.725742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:12161 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.458 [2024-04-26 20:46:53.725751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.458 [2024-04-26 20:46:53.744844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.458 [2024-04-26 20:46:53.744865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:12063 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.458 [2024-04-26 20:46:53.744874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.458 [2024-04-26 20:46:53.763967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.458 [2024-04-26 20:46:53.763988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:4268 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.458 [2024-04-26 20:46:53.763997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.458 [2024-04-26 20:46:53.782808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.458 [2024-04-26 20:46:53.782829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:2003 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.458 [2024-04-26 20:46:53.782838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.719 [2024-04-26 20:46:53.801548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1f5a600) 00:29:35.719 [2024-04-26 20:46:53.801570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:2266 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.719 [2024-04-26 20:46:53.801579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.719 00:29:35.719 Latency(us) 00:29:35.719 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:35.719 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:35.719 nvme0n1 : 2.01 13202.75 51.57 0.00 0.00 9686.46 8519.68 37137.07 00:29:35.719 =================================================================================================================== 00:29:35.719 Total : 13202.75 51.57 0.00 0.00 9686.46 8519.68 37137.07 00:29:35.719 0 00:29:35.719 20:46:53 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:35.719 20:46:53 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:35.719 20:46:53 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:35.719 | .driver_specific 00:29:35.719 | .nvme_error 00:29:35.719 | .status_code 00:29:35.719 | .command_transient_transport_error' 00:29:35.719 20:46:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:35.719 20:46:53 -- host/digest.sh@71 -- # (( 104 > 0 )) 00:29:35.719 20:46:53 -- host/digest.sh@73 -- # killprocess 45409 00:29:35.719 20:46:53 -- common/autotest_common.sh@926 -- # '[' -z 45409 ']' 00:29:35.719 20:46:53 -- common/autotest_common.sh@930 -- # kill -0 45409 00:29:35.719 20:46:53 -- common/autotest_common.sh@931 -- # uname 00:29:35.719 20:46:53 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:35.719 20:46:53 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 45409 00:29:35.719 20:46:54 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:35.719 20:46:54 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:35.719 20:46:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 45409' 00:29:35.719 killing process with pid 45409 00:29:35.719 20:46:54 -- common/autotest_common.sh@945 -- # kill 45409 00:29:35.719 Received shutdown signal, test time was about 2.000000 seconds 00:29:35.719 00:29:35.719 Latency(us) 00:29:35.719 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:35.719 =================================================================================================================== 00:29:35.719 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:35.719 20:46:54 -- common/autotest_common.sh@950 -- # wait 45409 00:29:35.980 20:46:54 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:35.980 20:46:54 -- host/digest.sh@54 -- # local rw bs qd 00:29:35.980 20:46:54 -- host/digest.sh@56 -- # rw=randread 00:29:35.980 20:46:54 -- host/digest.sh@56 -- # bs=131072 00:29:35.981 20:46:54 -- host/digest.sh@56 -- # qd=16 00:29:35.981 20:46:54 -- host/digest.sh@58 -- # bperfpid=46107 00:29:35.981 20:46:54 -- host/digest.sh@60 -- # waitforlisten 46107 /var/tmp/bperf.sock 00:29:35.981 20:46:54 -- common/autotest_common.sh@819 -- # '[' -z 46107 ']' 00:29:35.981 20:46:54 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:35.981 20:46:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:35.981 20:46:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:35.981 20:46:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:35.981 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:35.981 20:46:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:35.981 20:46:54 -- common/autotest_common.sh@10 -- # set +x 00:29:35.981 [2024-04-26 20:46:54.207866] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:35.981 [2024-04-26 20:46:54.207920] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid46107 ] 00:29:35.981 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:35.981 Zero copy mechanism will not be used. 00:29:35.981 EAL: No free 2048 kB hugepages reported on node 1 00:29:35.981 [2024-04-26 20:46:54.265515] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:36.241 [2024-04-26 20:46:54.327304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:36.812 20:46:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:36.812 20:46:54 -- common/autotest_common.sh@852 -- # return 0 00:29:36.812 20:46:54 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:36.812 20:46:54 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:36.812 20:46:55 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:36.812 20:46:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:36.812 20:46:55 -- common/autotest_common.sh@10 -- # set +x 00:29:36.812 20:46:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:36.812 20:46:55 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:36.812 20:46:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:37.382 nvme0n1 00:29:37.382 20:46:55 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:37.382 20:46:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:37.382 20:46:55 -- common/autotest_common.sh@10 -- # set +x 00:29:37.382 20:46:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:37.382 20:46:55 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:37.382 20:46:55 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:37.382 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:37.382 Zero copy mechanism will not be used. 00:29:37.382 Running I/O for 2 seconds... 00:29:37.382 [2024-04-26 20:46:55.661589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.382 [2024-04-26 20:46:55.661626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.382 [2024-04-26 20:46:55.661637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.382 [2024-04-26 20:46:55.678840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.382 [2024-04-26 20:46:55.678865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.382 [2024-04-26 20:46:55.678875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.382 [2024-04-26 20:46:55.696765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.382 [2024-04-26 20:46:55.696789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.382 [2024-04-26 20:46:55.696798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.382 [2024-04-26 20:46:55.713427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.382 [2024-04-26 20:46:55.713451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.382 [2024-04-26 20:46:55.713465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.642 [2024-04-26 20:46:55.731992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.642 [2024-04-26 20:46:55.732014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.642 [2024-04-26 20:46:55.732023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.642 [2024-04-26 20:46:55.747018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.642 [2024-04-26 20:46:55.747041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.642 [2024-04-26 20:46:55.747051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.642 [2024-04-26 20:46:55.766059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.642 [2024-04-26 20:46:55.766081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.642 [2024-04-26 20:46:55.766089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.642 [2024-04-26 20:46:55.783954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.642 [2024-04-26 20:46:55.783976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.642 [2024-04-26 20:46:55.783985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.642 [2024-04-26 20:46:55.800924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.642 [2024-04-26 20:46:55.800947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.643 [2024-04-26 20:46:55.800956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.643 [2024-04-26 20:46:55.818717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.643 [2024-04-26 20:46:55.818738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.643 [2024-04-26 20:46:55.818747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.643 [2024-04-26 20:46:55.836130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.643 [2024-04-26 20:46:55.836152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.643 [2024-04-26 20:46:55.836160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.643 [2024-04-26 20:46:55.852959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.643 [2024-04-26 20:46:55.852981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.643 [2024-04-26 20:46:55.852990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.643 [2024-04-26 20:46:55.868859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.643 [2024-04-26 20:46:55.868884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.643 [2024-04-26 20:46:55.868893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.643 [2024-04-26 20:46:55.884802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.643 [2024-04-26 20:46:55.884824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.643 [2024-04-26 20:46:55.884833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.643 [2024-04-26 20:46:55.901424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.643 [2024-04-26 20:46:55.901446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.643 [2024-04-26 20:46:55.901455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.643 [2024-04-26 20:46:55.919144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.643 [2024-04-26 20:46:55.919166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.643 [2024-04-26 20:46:55.919175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.643 [2024-04-26 20:46:55.935808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.643 [2024-04-26 20:46:55.935830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.643 [2024-04-26 20:46:55.935839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.643 [2024-04-26 20:46:55.952151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.643 [2024-04-26 20:46:55.952173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.643 [2024-04-26 20:46:55.952182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.643 [2024-04-26 20:46:55.969068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.643 [2024-04-26 20:46:55.969089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.643 [2024-04-26 20:46:55.969098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:55.986017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:55.986039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:55.986048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.002822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.002844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.002853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.018862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.018884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.018893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.036700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.036721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.036731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.053392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.053414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.053423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.071130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.071153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.071163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.086355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.086377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.086386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.103781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.103802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.103810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.120508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.120531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.120539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.138846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.138867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.138876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.155385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.155407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.155419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.174601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.174623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.174631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.191443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.191465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.191474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.207709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.207731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.207739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.224377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.224399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.224408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.904 [2024-04-26 20:46:56.241216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:37.904 [2024-04-26 20:46:56.241238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.904 [2024-04-26 20:46:56.241247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.258075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.258097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.258106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.276879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.276900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.276909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.294685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.294708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.294717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.310731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.310753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.310762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.328480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.328502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.328511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.346469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.346490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.346499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.365079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.365101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.365109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.382890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.382912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.382921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.399479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.399501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.399510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.416653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.416675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.416685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.433105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.433127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.433136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.449541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.449562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.449578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.465848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.465871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.465880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.482778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.482799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.482808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.165 [2024-04-26 20:46:56.498878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.165 [2024-04-26 20:46:56.498900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.165 [2024-04-26 20:46:56.498908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.426 [2024-04-26 20:46:56.516647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.426 [2024-04-26 20:46:56.516668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.426 [2024-04-26 20:46:56.516677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.426 [2024-04-26 20:46:56.532756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.426 [2024-04-26 20:46:56.532778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.532787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.427 [2024-04-26 20:46:56.549997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.427 [2024-04-26 20:46:56.550019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.550028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.427 [2024-04-26 20:46:56.566501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.427 [2024-04-26 20:46:56.566522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.566531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.427 [2024-04-26 20:46:56.583172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.427 [2024-04-26 20:46:56.583194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.583203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.427 [2024-04-26 20:46:56.599863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.427 [2024-04-26 20:46:56.599890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.599899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.427 [2024-04-26 20:46:56.615579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.427 [2024-04-26 20:46:56.615601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.615609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.427 [2024-04-26 20:46:56.632687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.427 [2024-04-26 20:46:56.632709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.632718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.427 [2024-04-26 20:46:56.650716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.427 [2024-04-26 20:46:56.650738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.650746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.427 [2024-04-26 20:46:56.668871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.427 [2024-04-26 20:46:56.668893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.668902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.427 [2024-04-26 20:46:56.685419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.427 [2024-04-26 20:46:56.685441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.685449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.427 [2024-04-26 20:46:56.702974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.427 [2024-04-26 20:46:56.702995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.703004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.427 [2024-04-26 20:46:56.721882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.427 [2024-04-26 20:46:56.721904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.721912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.427 [2024-04-26 20:46:56.739344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.427 [2024-04-26 20:46:56.739365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.739374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.427 [2024-04-26 20:46:56.757673] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.427 [2024-04-26 20:46:56.757695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.427 [2024-04-26 20:46:56.757704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.773576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.773598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.773607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.791086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.791107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.791117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.806999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.807021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.807029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.823039] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.823060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.823069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.841160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.841182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.841191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.855941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.855963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.855971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.872905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.872926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.872935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.889564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.889590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.889598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.906504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.906525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.906534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.924229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.924250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.924258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.940168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.940189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.940198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.956916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.956937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.956945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.973795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.973818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.973828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:56.989714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:56.989736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:56.989744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:57.005366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:57.005387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:57.005396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.688 [2024-04-26 20:46:57.024202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.688 [2024-04-26 20:46:57.024224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.688 [2024-04-26 20:46:57.024232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.949 [2024-04-26 20:46:57.041145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.041167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.041175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.057562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.057584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.057592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.076402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.076424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.076432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.092752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.092774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.092782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.108818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.108840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.108848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.126306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.126329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.126338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.143845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.143867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.143876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.159872] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.159894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.159903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.177506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.177527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.177540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.193515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.193537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.193546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.211823] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.211845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.211853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.228426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.228448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.228456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.245175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.245196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.245205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.262225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.262247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.262256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:38.950 [2024-04-26 20:46:57.280842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:38.950 [2024-04-26 20:46:57.280864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:38.950 [2024-04-26 20:46:57.280872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.261 [2024-04-26 20:46:57.298914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.261 [2024-04-26 20:46:57.298935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.261 [2024-04-26 20:46:57.298944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.261 [2024-04-26 20:46:57.316975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.316996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.317005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.333694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.333720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.333728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.349817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.349838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.349847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.365913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.365934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.365943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.383116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.383137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.383146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.397932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.397954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.397963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.414366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.414387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.414395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.430801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.430822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.430831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.449023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.449044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.449053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.467305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.467327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.467335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.482834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.482856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.482864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.499376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.499397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.499405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.515362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.515383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.515392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.531312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.531333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.531342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.548493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.548515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.548524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.565778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.565800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.565809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.582133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.582155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.582164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.262 [2024-04-26 20:46:57.599245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.262 [2024-04-26 20:46:57.599266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.262 [2024-04-26 20:46:57.599274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:39.554 [2024-04-26 20:46:57.615869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.554 [2024-04-26 20:46:57.615894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.554 [2024-04-26 20:46:57.615903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.554 [2024-04-26 20:46:57.633234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.554 [2024-04-26 20:46:57.633255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.554 [2024-04-26 20:46:57.633264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:39.554 [2024-04-26 20:46:57.649315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2269000) 00:29:39.554 [2024-04-26 20:46:57.649337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:39.554 [2024-04-26 20:46:57.649346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:39.554 00:29:39.554 Latency(us) 00:29:39.554 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:39.554 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:39.554 nvme0n1 : 2.01 1822.46 227.81 0.00 0.00 8770.96 7263.57 20971.52 00:29:39.554 =================================================================================================================== 00:29:39.554 Total : 1822.46 227.81 0.00 0.00 8770.96 7263.57 20971.52 00:29:39.554 0 00:29:39.554 20:46:57 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:39.554 20:46:57 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:39.554 20:46:57 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:39.554 | .driver_specific 00:29:39.554 | .nvme_error 00:29:39.554 | .status_code 00:29:39.554 | .command_transient_transport_error' 00:29:39.554 20:46:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:39.554 20:46:57 -- host/digest.sh@71 -- # (( 118 > 0 )) 00:29:39.554 20:46:57 -- host/digest.sh@73 -- # killprocess 46107 00:29:39.554 20:46:57 -- common/autotest_common.sh@926 -- # '[' -z 46107 ']' 00:29:39.554 20:46:57 -- common/autotest_common.sh@930 -- # kill -0 46107 00:29:39.554 20:46:57 -- common/autotest_common.sh@931 -- # uname 00:29:39.554 20:46:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:39.554 20:46:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 46107 00:29:39.835 20:46:57 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:39.835 20:46:57 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:39.835 20:46:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 46107' 00:29:39.835 killing process with pid 46107 00:29:39.835 20:46:57 -- common/autotest_common.sh@945 -- # kill 46107 00:29:39.835 Received shutdown signal, test time was about 2.000000 seconds 00:29:39.835 00:29:39.835 Latency(us) 00:29:39.835 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:39.835 =================================================================================================================== 00:29:39.835 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:39.835 20:46:57 -- common/autotest_common.sh@950 -- # wait 46107 00:29:39.835 20:46:58 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:29:39.835 20:46:58 -- host/digest.sh@54 -- # local rw bs qd 00:29:39.835 20:46:58 -- host/digest.sh@56 -- # rw=randwrite 00:29:39.835 20:46:58 -- host/digest.sh@56 -- # bs=4096 00:29:39.835 20:46:58 -- host/digest.sh@56 -- # qd=128 00:29:39.835 20:46:58 -- host/digest.sh@58 -- # bperfpid=46892 00:29:39.835 20:46:58 -- host/digest.sh@60 -- # waitforlisten 46892 /var/tmp/bperf.sock 00:29:39.835 20:46:58 -- common/autotest_common.sh@819 -- # '[' -z 46892 ']' 00:29:39.835 20:46:58 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:39.835 20:46:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:39.835 20:46:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:39.835 20:46:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:39.835 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:39.835 20:46:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:39.835 20:46:58 -- common/autotest_common.sh@10 -- # set +x 00:29:39.836 [2024-04-26 20:46:58.063556] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:39.836 [2024-04-26 20:46:58.063611] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid46892 ] 00:29:39.836 EAL: No free 2048 kB hugepages reported on node 1 00:29:39.836 [2024-04-26 20:46:58.121200] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:40.097 [2024-04-26 20:46:58.182950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:40.670 20:46:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:40.670 20:46:58 -- common/autotest_common.sh@852 -- # return 0 00:29:40.670 20:46:58 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:40.670 20:46:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:40.670 20:46:58 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:40.670 20:46:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:40.670 20:46:58 -- common/autotest_common.sh@10 -- # set +x 00:29:40.670 20:46:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:40.670 20:46:58 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:40.670 20:46:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:41.243 nvme0n1 00:29:41.243 20:46:59 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:41.243 20:46:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:41.243 20:46:59 -- common/autotest_common.sh@10 -- # set +x 00:29:41.243 20:46:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:41.243 20:46:59 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:41.243 20:46:59 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:41.243 Running I/O for 2 seconds... 00:29:41.243 [2024-04-26 20:46:59.452096] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fef90 00:29:41.243 [2024-04-26 20:46:59.452925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:24161 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.243 [2024-04-26 20:46:59.452960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:29:41.243 [2024-04-26 20:46:59.463614] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f9b30 00:29:41.243 [2024-04-26 20:46:59.464746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:884 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.243 [2024-04-26 20:46:59.464770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:29:41.243 [2024-04-26 20:46:59.475066] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fda78 00:29:41.243 [2024-04-26 20:46:59.476771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:19358 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.243 [2024-04-26 20:46:59.476798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:29:41.243 [2024-04-26 20:46:59.486428] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f46d0 00:29:41.243 [2024-04-26 20:46:59.487954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:18819 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.243 [2024-04-26 20:46:59.487974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:41.243 [2024-04-26 20:46:59.497919] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f35f0 00:29:41.243 [2024-04-26 20:46:59.499458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:4928 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.243 [2024-04-26 20:46:59.499478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:41.243 [2024-04-26 20:46:59.509405] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fef90 00:29:41.243 [2024-04-26 20:46:59.510882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:23599 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.243 [2024-04-26 20:46:59.510902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:41.243 [2024-04-26 20:46:59.520906] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190ea680 00:29:41.243 [2024-04-26 20:46:59.522472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16981 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.243 [2024-04-26 20:46:59.522492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:41.243 [2024-04-26 20:46:59.532404] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190ebfd0 00:29:41.243 [2024-04-26 20:46:59.533955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.244 [2024-04-26 20:46:59.533976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:41.244 [2024-04-26 20:46:59.543803] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f4b08 00:29:41.244 [2024-04-26 20:46:59.545321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:13495 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.244 [2024-04-26 20:46:59.545342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:41.244 [2024-04-26 20:46:59.555253] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e9e10 00:29:41.244 [2024-04-26 20:46:59.556773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:12902 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.244 [2024-04-26 20:46:59.556793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:41.244 [2024-04-26 20:46:59.566718] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fb8b8 00:29:41.244 [2024-04-26 20:46:59.568262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6467 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.244 [2024-04-26 20:46:59.568296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:41.244 [2024-04-26 20:46:59.578120] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fd640 00:29:41.244 [2024-04-26 20:46:59.579684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:16050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.244 [2024-04-26 20:46:59.579705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.589662] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:41.506 [2024-04-26 20:46:59.591161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:1280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.591180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.601137] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f4298 00:29:41.506 [2024-04-26 20:46:59.602660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:1919 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.602680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.612575] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f35f0 00:29:41.506 [2024-04-26 20:46:59.614116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:17754 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.614136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.623996] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fd208 00:29:41.506 [2024-04-26 20:46:59.625555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:20488 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.625575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.635471] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f8e88 00:29:41.506 [2024-04-26 20:46:59.637096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:23877 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.637117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.646811] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190ecc78 00:29:41.506 [2024-04-26 20:46:59.648390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:16207 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.648410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.658471] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f5be8 00:29:41.506 [2024-04-26 20:46:59.660047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:11642 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.660067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.669954] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190ee5c8 00:29:41.506 [2024-04-26 20:46:59.671427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:19916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.671448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.681465] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fb8b8 00:29:41.506 [2024-04-26 20:46:59.683082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:1951 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.683103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.692697] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fb480 00:29:41.506 [2024-04-26 20:46:59.693929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:24093 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.693950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.704125] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190eb328 00:29:41.506 [2024-04-26 20:46:59.705351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:14455 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.705371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.715589] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190eaab8 00:29:41.506 [2024-04-26 20:46:59.716884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:6329 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.716904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.727030] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190eaab8 00:29:41.506 [2024-04-26 20:46:59.728331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:3351 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.728350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.739204] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fe720 00:29:41.506 [2024-04-26 20:46:59.740515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:22173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.740535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.750679] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f7538 00:29:41.506 [2024-04-26 20:46:59.752237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19217 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.752257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.762144] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f2510 00:29:41.506 [2024-04-26 20:46:59.763748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:25341 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.763768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.773623] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f35f0 00:29:41.506 [2024-04-26 20:46:59.775207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:21416 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.775231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.785079] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f46d0 00:29:41.506 [2024-04-26 20:46:59.786043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:2037 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.786063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.796534] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f6890 00:29:41.506 [2024-04-26 20:46:59.798110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:2554 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.798130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.807976] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f5378 00:29:41.506 [2024-04-26 20:46:59.809576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:13878 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.809596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.819431] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fcdd0 00:29:41.506 [2024-04-26 20:46:59.821046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:13370 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.821066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.830817] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f9b30 00:29:41.506 [2024-04-26 20:46:59.832474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:10170 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.832494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:29:41.506 [2024-04-26 20:46:59.842240] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190ef6a8 00:29:41.506 [2024-04-26 20:46:59.843793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:17364 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.506 [2024-04-26 20:46:59.843814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:46:59.853703] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f81e0 00:29:41.769 [2024-04-26 20:46:59.855296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:14705 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:46:59.855317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:46:59.865117] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f3a28 00:29:41.769 [2024-04-26 20:46:59.866735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:24743 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:46:59.866755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:46:59.876541] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fd640 00:29:41.769 [2024-04-26 20:46:59.878302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:25586 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:46:59.878322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:46:59.887909] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fa7d8 00:29:41.769 [2024-04-26 20:46:59.889403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:10031 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:46:59.889423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:46:59.899361] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fc128 00:29:41.769 [2024-04-26 20:46:59.900912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:20268 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:46:59.900932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:46:59.910784] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fa3a0 00:29:41.769 [2024-04-26 20:46:59.912641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:10681 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:46:59.912662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:46:59.922142] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f6020 00:29:41.769 [2024-04-26 20:46:59.924080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:14611 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:46:59.924099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:46:59.933540] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fc560 00:29:41.769 [2024-04-26 20:46:59.934828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:5262 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:46:59.934848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:46:59.944972] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e9168 00:29:41.769 [2024-04-26 20:46:59.946458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:1877 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:46:59.946478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:46:59.956395] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190eaab8 00:29:41.769 [2024-04-26 20:46:59.958028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:10537 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:46:59.958049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:46:59.968817] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fac10 00:29:41.769 [2024-04-26 20:46:59.970469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:5122 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:46:59.970489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:46:59.980202] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190fc128 00:29:41.769 [2024-04-26 20:46:59.981138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:21602 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:46:59.981158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:46:59.991303] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f8618 00:29:41.769 [2024-04-26 20:46:59.992858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:327 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:46:59.992878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:47:00.003635] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f20d8 00:29:41.769 [2024-04-26 20:47:00.006090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:1952 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:47:00.006112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:47:00.016808] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190f0ff8 00:29:41.769 [2024-04-26 20:47:00.017792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6165 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:47:00.017812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:47:00.028511] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:41.769 [2024-04-26 20:47:00.028870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:3339 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:47:00.028890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:47:00.040322] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:41.769 [2024-04-26 20:47:00.040707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:15826 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:47:00.040726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:41.769 [2024-04-26 20:47:00.052196] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:41.769 [2024-04-26 20:47:00.052447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:7866 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.769 [2024-04-26 20:47:00.052466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:41.770 [2024-04-26 20:47:00.064019] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:41.770 [2024-04-26 20:47:00.064342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:2320 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.770 [2024-04-26 20:47:00.064362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:41.770 [2024-04-26 20:47:00.075863] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:41.770 [2024-04-26 20:47:00.076134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:15581 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.770 [2024-04-26 20:47:00.076158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:41.770 [2024-04-26 20:47:00.087701] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:41.770 [2024-04-26 20:47:00.087977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:4403 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.770 [2024-04-26 20:47:00.087997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:41.770 [2024-04-26 20:47:00.099542] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:41.770 [2024-04-26 20:47:00.099923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:4860 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.770 [2024-04-26 20:47:00.099942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:41.770 [2024-04-26 20:47:00.111329] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:41.770 [2024-04-26 20:47:00.111705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:298 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.770 [2024-04-26 20:47:00.111724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.123118] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.123544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:2072 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.123564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.134974] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.135275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:14615 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.135298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.146812] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.147241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:7652 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.147261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.158612] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.158887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:3848 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.158906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.170407] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.170812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:15086 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.170832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.182223] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.182622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:23197 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.182642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.194054] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.194447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:13273 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.194467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.205827] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.206162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:4031 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.206181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.217671] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.217940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:2945 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.217959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.229479] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.229846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:23631 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.229866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.241300] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.241768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:25141 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.241787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.253124] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.253384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:9429 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.253403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.264952] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.265349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:17377 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.265368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.276770] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.277042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:24622 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.277063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.288564] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.288851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:10561 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.288871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.300375] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.300653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:21056 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.300673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.312136] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.312410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:8209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.312429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.323918] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.324317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:5542 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.031 [2024-04-26 20:47:00.324337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.031 [2024-04-26 20:47:00.335694] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.031 [2024-04-26 20:47:00.336053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:14905 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.032 [2024-04-26 20:47:00.336072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.032 [2024-04-26 20:47:00.347482] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.032 [2024-04-26 20:47:00.347757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:11365 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.032 [2024-04-26 20:47:00.347776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.032 [2024-04-26 20:47:00.359250] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.032 [2024-04-26 20:47:00.359648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:22530 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.032 [2024-04-26 20:47:00.359667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.032 [2024-04-26 20:47:00.371045] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.032 [2024-04-26 20:47:00.371441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:16277 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.032 [2024-04-26 20:47:00.371461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.382857] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.383264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:18755 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.383292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.394612] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.394946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:9753 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.394966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.406384] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.406832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:24980 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.406851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.418169] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.418544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:2632 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.418564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.429987] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.430373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:20347 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.430393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.441794] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.442207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:21154 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.442226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.453543] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.453934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:15003 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.453953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.465404] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.465815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:14717 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.465834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.477295] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.477567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:21737 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.477586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.489207] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.489613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:16309 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.489633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.500999] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.501413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:23255 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.501432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.512788] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.513177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:2657 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.513196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.524570] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.525014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:14983 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.525034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.536396] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.536790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:10105 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.536809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.548218] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.548510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:14842 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.548530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.560021] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.560385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:8594 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.560405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.571763] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.572092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:16447 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.572112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.583577] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.583995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:8834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.584015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.595434] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.595781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:421 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.595801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.294 [2024-04-26 20:47:00.607236] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.294 [2024-04-26 20:47:00.607660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:15644 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.294 [2024-04-26 20:47:00.607679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.295 [2024-04-26 20:47:00.619026] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.295 [2024-04-26 20:47:00.619413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:12010 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.295 [2024-04-26 20:47:00.619432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.295 [2024-04-26 20:47:00.630809] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.295 [2024-04-26 20:47:00.631198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:3542 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.295 [2024-04-26 20:47:00.631217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.642630] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.643031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:23402 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.643050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.654661] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.654926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:1664 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.654946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.666476] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.666863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:13905 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.666883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.678316] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.678716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:23787 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.678735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.690059] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.690410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:17099 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.690432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.701817] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.702083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:23719 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.702102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.713587] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.713981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:14127 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.714000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.725379] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.725650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:11174 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.725670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.737193] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.737554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:11065 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.737574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.748991] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.749396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:17906 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.749415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.760781] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.761134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:12589 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.761153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.772598] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.772866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:4188 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.772885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.784361] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.784634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:21012 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.784654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.796156] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.796567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:18989 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.796586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.807922] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.808180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:8419 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.808200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.819726] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.820139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:25043 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.820158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.831491] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.557 [2024-04-26 20:47:00.831881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:6320 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.557 [2024-04-26 20:47:00.831900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.557 [2024-04-26 20:47:00.843298] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.558 [2024-04-26 20:47:00.843760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:150 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.558 [2024-04-26 20:47:00.843780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.558 [2024-04-26 20:47:00.855112] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.558 [2024-04-26 20:47:00.855378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:15836 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.558 [2024-04-26 20:47:00.855398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.558 [2024-04-26 20:47:00.866914] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.558 [2024-04-26 20:47:00.867284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:9537 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.558 [2024-04-26 20:47:00.867303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.558 [2024-04-26 20:47:00.878729] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.558 [2024-04-26 20:47:00.879127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:5708 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.558 [2024-04-26 20:47:00.879147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.558 [2024-04-26 20:47:00.890541] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.558 [2024-04-26 20:47:00.890971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:11737 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.558 [2024-04-26 20:47:00.890990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.819 [2024-04-26 20:47:00.902324] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.819 [2024-04-26 20:47:00.902733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:16529 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.819 [2024-04-26 20:47:00.902752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.819 [2024-04-26 20:47:00.914098] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.819 [2024-04-26 20:47:00.914479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:74 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.819 [2024-04-26 20:47:00.914498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.819 [2024-04-26 20:47:00.925960] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.819 [2024-04-26 20:47:00.926366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:19996 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.819 [2024-04-26 20:47:00.926385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.819 [2024-04-26 20:47:00.937784] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.819 [2024-04-26 20:47:00.938169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:534 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.819 [2024-04-26 20:47:00.938188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.819 [2024-04-26 20:47:00.949568] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.819 [2024-04-26 20:47:00.949840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:108 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.819 [2024-04-26 20:47:00.949859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.819 [2024-04-26 20:47:00.961270] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.819 [2024-04-26 20:47:00.961647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:6917 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.819 [2024-04-26 20:47:00.961666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.819 [2024-04-26 20:47:00.973119] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.819 [2024-04-26 20:47:00.973390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:6464 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.819 [2024-04-26 20:47:00.973410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.819 [2024-04-26 20:47:00.984963] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.819 [2024-04-26 20:47:00.985347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:22233 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.819 [2024-04-26 20:47:00.985366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.819 [2024-04-26 20:47:00.996762] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.819 [2024-04-26 20:47:00.997158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:16838 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.819 [2024-04-26 20:47:00.997181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.819 [2024-04-26 20:47:01.008552] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.819 [2024-04-26 20:47:01.008809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:11768 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.819 [2024-04-26 20:47:01.008828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.819 [2024-04-26 20:47:01.020338] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.819 [2024-04-26 20:47:01.020612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:18635 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.819 [2024-04-26 20:47:01.020631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.819 [2024-04-26 20:47:01.032106] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.820 [2024-04-26 20:47:01.032541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:19743 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.820 [2024-04-26 20:47:01.032560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.820 [2024-04-26 20:47:01.043957] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.820 [2024-04-26 20:47:01.044245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:5097 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.820 [2024-04-26 20:47:01.044265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.820 [2024-04-26 20:47:01.055763] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.820 [2024-04-26 20:47:01.056036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:5142 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.820 [2024-04-26 20:47:01.056055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.820 [2024-04-26 20:47:01.067553] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.820 [2024-04-26 20:47:01.067828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:21435 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.820 [2024-04-26 20:47:01.067848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.820 [2024-04-26 20:47:01.079363] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.820 [2024-04-26 20:47:01.079643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:5975 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.820 [2024-04-26 20:47:01.079662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.820 [2024-04-26 20:47:01.091189] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.820 [2024-04-26 20:47:01.091591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:3853 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.820 [2024-04-26 20:47:01.091611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.820 [2024-04-26 20:47:01.102938] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.820 [2024-04-26 20:47:01.103252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:19654 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.820 [2024-04-26 20:47:01.103274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.820 [2024-04-26 20:47:01.114764] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.820 [2024-04-26 20:47:01.115028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:13574 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.820 [2024-04-26 20:47:01.115047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.820 [2024-04-26 20:47:01.126533] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.820 [2024-04-26 20:47:01.126937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:5982 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.820 [2024-04-26 20:47:01.126957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.820 [2024-04-26 20:47:01.138344] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.820 [2024-04-26 20:47:01.138603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:21086 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.820 [2024-04-26 20:47:01.138622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.820 [2024-04-26 20:47:01.150172] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.820 [2024-04-26 20:47:01.150530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:3550 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.820 [2024-04-26 20:47:01.150549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:42.820 [2024-04-26 20:47:01.162113] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:42.820 [2024-04-26 20:47:01.162380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:16779 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:42.820 [2024-04-26 20:47:01.162400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.082 [2024-04-26 20:47:01.173905] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.082 [2024-04-26 20:47:01.174350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:18560 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.082 [2024-04-26 20:47:01.174370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.082 [2024-04-26 20:47:01.185719] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.082 [2024-04-26 20:47:01.185985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:14834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.082 [2024-04-26 20:47:01.186005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.082 [2024-04-26 20:47:01.197588] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.082 [2024-04-26 20:47:01.198002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:10659 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.082 [2024-04-26 20:47:01.198021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.082 [2024-04-26 20:47:01.209383] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.082 [2024-04-26 20:47:01.209765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:5659 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.082 [2024-04-26 20:47:01.209784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.082 [2024-04-26 20:47:01.221211] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.082 [2024-04-26 20:47:01.221608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:21885 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.082 [2024-04-26 20:47:01.221628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.082 [2024-04-26 20:47:01.233013] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.082 [2024-04-26 20:47:01.233367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:10455 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.082 [2024-04-26 20:47:01.233386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.082 [2024-04-26 20:47:01.244871] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.082 [2024-04-26 20:47:01.245296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:2250 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.082 [2024-04-26 20:47:01.245316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.082 [2024-04-26 20:47:01.256666] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.082 [2024-04-26 20:47:01.256926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:18808 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.082 [2024-04-26 20:47:01.256944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.082 [2024-04-26 20:47:01.268461] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.082 [2024-04-26 20:47:01.268898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:12928 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.082 [2024-04-26 20:47:01.268917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.082 [2024-04-26 20:47:01.280225] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.082 [2024-04-26 20:47:01.280667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:14082 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.082 [2024-04-26 20:47:01.280686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.082 [2024-04-26 20:47:01.292061] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.082 [2024-04-26 20:47:01.292473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:6266 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.082 [2024-04-26 20:47:01.292493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.082 [2024-04-26 20:47:01.303919] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.082 [2024-04-26 20:47:01.304187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:3669 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.082 [2024-04-26 20:47:01.304207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.082 [2024-04-26 20:47:01.315659] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.082 [2024-04-26 20:47:01.316079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:15145 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.083 [2024-04-26 20:47:01.316098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.083 [2024-04-26 20:47:01.327452] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.083 [2024-04-26 20:47:01.327797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:4960 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.083 [2024-04-26 20:47:01.327817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.083 [2024-04-26 20:47:01.339222] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.083 [2024-04-26 20:47:01.339549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:8263 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.083 [2024-04-26 20:47:01.339569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.083 [2024-04-26 20:47:01.351028] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.083 [2024-04-26 20:47:01.351319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:1362 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.083 [2024-04-26 20:47:01.351338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.083 [2024-04-26 20:47:01.362916] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.083 [2024-04-26 20:47:01.363282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:18564 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.083 [2024-04-26 20:47:01.363302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.083 [2024-04-26 20:47:01.374767] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.083 [2024-04-26 20:47:01.375034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:13769 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.083 [2024-04-26 20:47:01.375054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.083 [2024-04-26 20:47:01.386537] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.083 [2024-04-26 20:47:01.386957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:1079 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.083 [2024-04-26 20:47:01.386977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.083 [2024-04-26 20:47:01.398317] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.083 [2024-04-26 20:47:01.398701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:2817 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.083 [2024-04-26 20:47:01.398720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.083 [2024-04-26 20:47:01.410144] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.083 [2024-04-26 20:47:01.410554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:7950 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.083 [2024-04-26 20:47:01.410577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.083 [2024-04-26 20:47:01.421924] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.083 [2024-04-26 20:47:01.422335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:4358 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.083 [2024-04-26 20:47:01.422355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.345 [2024-04-26 20:47:01.433728] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2368c10) with pdu=0x2000190e95a0 00:29:43.345 [2024-04-26 20:47:01.434043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:17087 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:43.345 [2024-04-26 20:47:01.434062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:43.345 00:29:43.345 Latency(us) 00:29:43.345 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:43.345 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:43.345 nvme0n1 : 2.01 21621.82 84.46 0.00 0.00 5908.47 3112.96 21080.75 00:29:43.345 =================================================================================================================== 00:29:43.345 Total : 21621.82 84.46 0.00 0.00 5908.47 3112.96 21080.75 00:29:43.345 0 00:29:43.345 20:47:01 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:43.345 20:47:01 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:43.345 20:47:01 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:43.345 | .driver_specific 00:29:43.345 | .nvme_error 00:29:43.345 | .status_code 00:29:43.345 | .command_transient_transport_error' 00:29:43.345 20:47:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:43.345 20:47:01 -- host/digest.sh@71 -- # (( 170 > 0 )) 00:29:43.345 20:47:01 -- host/digest.sh@73 -- # killprocess 46892 00:29:43.345 20:47:01 -- common/autotest_common.sh@926 -- # '[' -z 46892 ']' 00:29:43.345 20:47:01 -- common/autotest_common.sh@930 -- # kill -0 46892 00:29:43.345 20:47:01 -- common/autotest_common.sh@931 -- # uname 00:29:43.345 20:47:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:43.345 20:47:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 46892 00:29:43.345 20:47:01 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:43.345 20:47:01 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:43.345 20:47:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 46892' 00:29:43.345 killing process with pid 46892 00:29:43.345 20:47:01 -- common/autotest_common.sh@945 -- # kill 46892 00:29:43.345 Received shutdown signal, test time was about 2.000000 seconds 00:29:43.345 00:29:43.345 Latency(us) 00:29:43.345 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:43.345 =================================================================================================================== 00:29:43.345 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:43.345 20:47:01 -- common/autotest_common.sh@950 -- # wait 46892 00:29:43.608 20:47:01 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:29:43.608 20:47:01 -- host/digest.sh@54 -- # local rw bs qd 00:29:43.608 20:47:01 -- host/digest.sh@56 -- # rw=randwrite 00:29:43.608 20:47:01 -- host/digest.sh@56 -- # bs=131072 00:29:43.608 20:47:01 -- host/digest.sh@56 -- # qd=16 00:29:43.608 20:47:01 -- host/digest.sh@58 -- # bperfpid=47710 00:29:43.608 20:47:01 -- host/digest.sh@60 -- # waitforlisten 47710 /var/tmp/bperf.sock 00:29:43.608 20:47:01 -- common/autotest_common.sh@819 -- # '[' -z 47710 ']' 00:29:43.608 20:47:01 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:29:43.608 20:47:01 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:43.608 20:47:01 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:43.608 20:47:01 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:43.608 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:43.608 20:47:01 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:43.608 20:47:01 -- common/autotest_common.sh@10 -- # set +x 00:29:43.608 [2024-04-26 20:47:01.842102] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:43.608 [2024-04-26 20:47:01.842156] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid47710 ] 00:29:43.608 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:43.608 Zero copy mechanism will not be used. 00:29:43.608 EAL: No free 2048 kB hugepages reported on node 1 00:29:43.608 [2024-04-26 20:47:01.899505] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:43.870 [2024-04-26 20:47:01.960961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:44.442 20:47:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:44.442 20:47:02 -- common/autotest_common.sh@852 -- # return 0 00:29:44.443 20:47:02 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:44.443 20:47:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:44.443 20:47:02 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:44.443 20:47:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:44.443 20:47:02 -- common/autotest_common.sh@10 -- # set +x 00:29:44.443 20:47:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:44.443 20:47:02 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:44.443 20:47:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:44.703 nvme0n1 00:29:44.703 20:47:03 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:44.703 20:47:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:44.703 20:47:03 -- common/autotest_common.sh@10 -- # set +x 00:29:44.703 20:47:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:44.703 20:47:03 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:44.703 20:47:03 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:44.964 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:44.964 Zero copy mechanism will not be used. 00:29:44.964 Running I/O for 2 seconds... 00:29:44.964 [2024-04-26 20:47:03.148271] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:44.964 [2024-04-26 20:47:03.148669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.964 [2024-04-26 20:47:03.148700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.964 [2024-04-26 20:47:03.167294] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:44.964 [2024-04-26 20:47:03.167740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.964 [2024-04-26 20:47:03.167764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.964 [2024-04-26 20:47:03.182091] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:44.964 [2024-04-26 20:47:03.182453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.964 [2024-04-26 20:47:03.182475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.964 [2024-04-26 20:47:03.195403] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:44.964 [2024-04-26 20:47:03.195714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.964 [2024-04-26 20:47:03.195735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.964 [2024-04-26 20:47:03.208423] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:44.965 [2024-04-26 20:47:03.208824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.965 [2024-04-26 20:47:03.208845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.965 [2024-04-26 20:47:03.221710] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:44.965 [2024-04-26 20:47:03.222076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.965 [2024-04-26 20:47:03.222097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.965 [2024-04-26 20:47:03.235013] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:44.965 [2024-04-26 20:47:03.235388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.965 [2024-04-26 20:47:03.235409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.965 [2024-04-26 20:47:03.247928] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:44.965 [2024-04-26 20:47:03.248505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.965 [2024-04-26 20:47:03.248528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.965 [2024-04-26 20:47:03.259852] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:44.965 [2024-04-26 20:47:03.260190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.965 [2024-04-26 20:47:03.260211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.965 [2024-04-26 20:47:03.272104] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:44.965 [2024-04-26 20:47:03.272324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.965 [2024-04-26 20:47:03.272343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.965 [2024-04-26 20:47:03.284621] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:44.965 [2024-04-26 20:47:03.284947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.965 [2024-04-26 20:47:03.284967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.965 [2024-04-26 20:47:03.297576] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:44.965 [2024-04-26 20:47:03.297812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.965 [2024-04-26 20:47:03.297831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.310212] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.310669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.310689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.322777] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.323062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.323082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.334428] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.334631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.334651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.346459] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.346801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.346822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.359624] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.360035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.360056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.372846] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.373150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.373171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.386462] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.386829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.386849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.399854] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.400103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.400126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.413821] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.414213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.414232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.426921] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.427243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.427264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.440228] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.440640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.440661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.453560] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.453985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.454006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.466750] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.467036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.467057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.480039] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.480217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.480236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.490743] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.490936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.490955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.501655] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.502057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.502078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.513755] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.513983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.514003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.525987] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.526396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.526417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.537597] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.537955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.537975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.550321] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.550703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.550724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.226 [2024-04-26 20:47:03.563131] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.226 [2024-04-26 20:47:03.563481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.226 [2024-04-26 20:47:03.563502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.575409] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.575874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.575894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.589108] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.589462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.589482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.602554] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.602912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.602932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.615907] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.616116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.616138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.628766] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.629085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.629105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.641335] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.641599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.641620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.654939] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.655261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.655286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.667274] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.667584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.667604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.679997] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.680289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.680309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.693507] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.693813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.693833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.706371] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.706627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.706647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.718646] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.719000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.719019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.730873] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.731221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.731241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.743853] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.744067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.744086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.755631] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.756016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.756037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.767224] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.767460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.767479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.779589] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.779863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.779882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.488 [2024-04-26 20:47:03.793030] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.488 [2024-04-26 20:47:03.793290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.488 [2024-04-26 20:47:03.793311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.489 [2024-04-26 20:47:03.805044] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.489 [2024-04-26 20:47:03.805353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.489 [2024-04-26 20:47:03.805373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.489 [2024-04-26 20:47:03.817790] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.489 [2024-04-26 20:47:03.818119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.489 [2024-04-26 20:47:03.818140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.489 [2024-04-26 20:47:03.830042] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.489 [2024-04-26 20:47:03.830364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.489 [2024-04-26 20:47:03.830384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.750 [2024-04-26 20:47:03.842864] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.750 [2024-04-26 20:47:03.843071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.750 [2024-04-26 20:47:03.843090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.750 [2024-04-26 20:47:03.856997] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.750 [2024-04-26 20:47:03.857391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.750 [2024-04-26 20:47:03.857412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.750 [2024-04-26 20:47:03.870985] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.750 [2024-04-26 20:47:03.871307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.750 [2024-04-26 20:47:03.871328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.750 [2024-04-26 20:47:03.883931] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.750 [2024-04-26 20:47:03.884369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.750 [2024-04-26 20:47:03.884388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.750 [2024-04-26 20:47:03.896109] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.750 [2024-04-26 20:47:03.896528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.750 [2024-04-26 20:47:03.896548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.750 [2024-04-26 20:47:03.909100] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:03.909322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:03.909341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:03.921904] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:03.922126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:03.922146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:03.934457] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:03.934626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:03.934645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:03.946454] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:03.946653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:03.946676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:03.958953] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:03.959439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:03.959460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:03.972429] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:03.972886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:03.972906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:03.985603] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:03.985809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:03.985828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:03.999017] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:03.999208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:03.999228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:04.010691] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:04.011103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:04.011123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:04.023006] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:04.023164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:04.023183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:04.034499] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:04.034810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:04.034829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:04.046544] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:04.046872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:04.046893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:04.058147] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:04.058389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:04.058409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:04.069710] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:04.070199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:04.070220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:04.081330] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:04.081701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:04.081722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.751 [2024-04-26 20:47:04.093057] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:45.751 [2024-04-26 20:47:04.093289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.751 [2024-04-26 20:47:04.093309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.012 [2024-04-26 20:47:04.103808] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.012 [2024-04-26 20:47:04.104076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.012 [2024-04-26 20:47:04.104097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.012 [2024-04-26 20:47:04.116031] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.012 [2024-04-26 20:47:04.116357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.012 [2024-04-26 20:47:04.116377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.012 [2024-04-26 20:47:04.127592] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.012 [2024-04-26 20:47:04.127998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.012 [2024-04-26 20:47:04.128018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.012 [2024-04-26 20:47:04.140062] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.012 [2024-04-26 20:47:04.140373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.012 [2024-04-26 20:47:04.140393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.012 [2024-04-26 20:47:04.152227] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.012 [2024-04-26 20:47:04.152545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.012 [2024-04-26 20:47:04.152565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.012 [2024-04-26 20:47:04.164731] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.012 [2024-04-26 20:47:04.165073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.165094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.176603] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.176787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.176806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.188424] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.188731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.188751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.199749] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.200025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.200046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.211060] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.211482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.211502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.223801] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.224117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.224137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.236227] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.236634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.236655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.248524] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.248934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.248955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.260728] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.261014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.261038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.274310] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.274554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.274573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.287336] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.287604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.287624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.300539] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.300745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.300764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.313207] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.313522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.313541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.326005] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.326415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.326435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.338244] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.338362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.338381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.013 [2024-04-26 20:47:04.349380] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.013 [2024-04-26 20:47:04.349711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.013 [2024-04-26 20:47:04.349732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.275 [2024-04-26 20:47:04.362694] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.275 [2024-04-26 20:47:04.362917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.275 [2024-04-26 20:47:04.362937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.275 [2024-04-26 20:47:04.375713] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.275 [2024-04-26 20:47:04.376119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.275 [2024-04-26 20:47:04.376139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.275 [2024-04-26 20:47:04.388977] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.275 [2024-04-26 20:47:04.389195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.275 [2024-04-26 20:47:04.389214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.275 [2024-04-26 20:47:04.401578] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.401848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.401868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.414475] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.415026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.415046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.428536] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.428889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.428910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.442446] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.442814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.442834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.456119] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.456545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.456567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.468918] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.469112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.469131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.481339] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.481786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.481807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.495386] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.495748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.495768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.508762] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.509081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.509101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.522920] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.523294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.523317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.536664] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.536937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.536959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.549532] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.549915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.549936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.563124] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.563557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.563578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.576948] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.577251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.577271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.591000] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.591247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.591267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.604642] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.604820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.604840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.276 [2024-04-26 20:47:04.616844] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.276 [2024-04-26 20:47:04.617186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.276 [2024-04-26 20:47:04.617206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.538 [2024-04-26 20:47:04.629723] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.538 [2024-04-26 20:47:04.629959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.538 [2024-04-26 20:47:04.629980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.538 [2024-04-26 20:47:04.643642] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.538 [2024-04-26 20:47:04.644048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.538 [2024-04-26 20:47:04.644067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.538 [2024-04-26 20:47:04.657107] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.538 [2024-04-26 20:47:04.657341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.538 [2024-04-26 20:47:04.657360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.538 [2024-04-26 20:47:04.670816] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.538 [2024-04-26 20:47:04.671104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.538 [2024-04-26 20:47:04.671125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.538 [2024-04-26 20:47:04.683993] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.538 [2024-04-26 20:47:04.684412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.538 [2024-04-26 20:47:04.684432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.538 [2024-04-26 20:47:04.697901] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.538 [2024-04-26 20:47:04.698205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.538 [2024-04-26 20:47:04.698225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.538 [2024-04-26 20:47:04.711706] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.538 [2024-04-26 20:47:04.711965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.538 [2024-04-26 20:47:04.711985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.538 [2024-04-26 20:47:04.724355] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.538 [2024-04-26 20:47:04.724653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.538 [2024-04-26 20:47:04.724673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.538 [2024-04-26 20:47:04.737014] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.538 [2024-04-26 20:47:04.737284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.538 [2024-04-26 20:47:04.737304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.538 [2024-04-26 20:47:04.749571] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.538 [2024-04-26 20:47:04.749929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.538 [2024-04-26 20:47:04.749949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.538 [2024-04-26 20:47:04.762726] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.538 [2024-04-26 20:47:04.762914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.538 [2024-04-26 20:47:04.762933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.538 [2024-04-26 20:47:04.774878] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.539 [2024-04-26 20:47:04.775089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.539 [2024-04-26 20:47:04.775109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.539 [2024-04-26 20:47:04.787163] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.539 [2024-04-26 20:47:04.787428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.539 [2024-04-26 20:47:04.787449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.539 [2024-04-26 20:47:04.799588] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.539 [2024-04-26 20:47:04.799888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.539 [2024-04-26 20:47:04.799907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.539 [2024-04-26 20:47:04.813067] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.539 [2024-04-26 20:47:04.813250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.539 [2024-04-26 20:47:04.813270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.539 [2024-04-26 20:47:04.825902] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.539 [2024-04-26 20:47:04.826229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.539 [2024-04-26 20:47:04.826252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.539 [2024-04-26 20:47:04.839123] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.539 [2024-04-26 20:47:04.839343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.539 [2024-04-26 20:47:04.839363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.539 [2024-04-26 20:47:04.851368] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.539 [2024-04-26 20:47:04.851626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.539 [2024-04-26 20:47:04.851648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.539 [2024-04-26 20:47:04.863605] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.539 [2024-04-26 20:47:04.863982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.539 [2024-04-26 20:47:04.864002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.539 [2024-04-26 20:47:04.876615] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.539 [2024-04-26 20:47:04.876999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.539 [2024-04-26 20:47:04.877019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:04.888960] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:04.889256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:04.889283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:04.901273] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:04.901493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:04.901513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:04.913671] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:04.913848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:04.913867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:04.926640] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:04.926998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:04.927019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:04.939383] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:04.939700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:04.939720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:04.951937] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:04.952151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:04.952171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:04.964677] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:04.964948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:04.964969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:04.977451] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:04.977849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:04.977869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:04.991542] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:04.991725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:04.991745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:05.004758] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:05.004923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:05.004943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:05.016210] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:05.016515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:05.016535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:05.029089] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:05.029290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:05.029310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:05.041111] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:05.041338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:05.041357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:05.051917] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:05.052253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:05.052273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:05.063164] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:05.063429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:05.063449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:05.075161] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:05.075659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:05.075680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:05.087886] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:05.088460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:05.088481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:05.099917] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:05.100163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:05.100184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.801 [2024-04-26 20:47:05.111571] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x2369080) with pdu=0x2000190fef90 00:29:46.801 [2024-04-26 20:47:05.111946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.801 [2024-04-26 20:47:05.111966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.801 00:29:46.801 Latency(us) 00:29:46.801 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:46.801 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:46.801 nvme0n1 : 2.01 2401.79 300.22 0.00 0.00 6647.45 4778.67 27962.03 00:29:46.801 =================================================================================================================== 00:29:46.801 Total : 2401.79 300.22 0.00 0.00 6647.45 4778.67 27962.03 00:29:46.801 0 00:29:46.801 20:47:05 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:47.062 20:47:05 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:47.062 | .driver_specific 00:29:47.062 | .nvme_error 00:29:47.062 | .status_code 00:29:47.062 | .command_transient_transport_error' 00:29:47.062 20:47:05 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:47.063 20:47:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:47.063 20:47:05 -- host/digest.sh@71 -- # (( 155 > 0 )) 00:29:47.063 20:47:05 -- host/digest.sh@73 -- # killprocess 47710 00:29:47.063 20:47:05 -- common/autotest_common.sh@926 -- # '[' -z 47710 ']' 00:29:47.063 20:47:05 -- common/autotest_common.sh@930 -- # kill -0 47710 00:29:47.063 20:47:05 -- common/autotest_common.sh@931 -- # uname 00:29:47.063 20:47:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:47.063 20:47:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 47710 00:29:47.063 20:47:05 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:47.063 20:47:05 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:47.063 20:47:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 47710' 00:29:47.063 killing process with pid 47710 00:29:47.063 20:47:05 -- common/autotest_common.sh@945 -- # kill 47710 00:29:47.063 Received shutdown signal, test time was about 2.000000 seconds 00:29:47.063 00:29:47.063 Latency(us) 00:29:47.063 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:47.063 =================================================================================================================== 00:29:47.063 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:47.063 20:47:05 -- common/autotest_common.sh@950 -- # wait 47710 00:29:47.324 20:47:05 -- host/digest.sh@115 -- # killprocess 45266 00:29:47.324 20:47:05 -- common/autotest_common.sh@926 -- # '[' -z 45266 ']' 00:29:47.324 20:47:05 -- common/autotest_common.sh@930 -- # kill -0 45266 00:29:47.324 20:47:05 -- common/autotest_common.sh@931 -- # uname 00:29:47.324 20:47:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:47.324 20:47:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 45266 00:29:47.324 20:47:05 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:47.324 20:47:05 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:47.324 20:47:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 45266' 00:29:47.324 killing process with pid 45266 00:29:47.324 20:47:05 -- common/autotest_common.sh@945 -- # kill 45266 00:29:47.324 20:47:05 -- common/autotest_common.sh@950 -- # wait 45266 00:29:47.584 00:29:47.584 real 0m16.167s 00:29:47.584 user 0m31.104s 00:29:47.584 sys 0m3.292s 00:29:47.585 20:47:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:47.585 20:47:05 -- common/autotest_common.sh@10 -- # set +x 00:29:47.585 ************************************ 00:29:47.585 END TEST nvmf_digest_error 00:29:47.585 ************************************ 00:29:47.585 20:47:05 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:29:47.585 20:47:05 -- host/digest.sh@139 -- # nvmftestfini 00:29:47.585 20:47:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:47.585 20:47:05 -- nvmf/common.sh@116 -- # sync 00:29:47.585 20:47:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:47.585 20:47:05 -- nvmf/common.sh@119 -- # set +e 00:29:47.585 20:47:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:47.585 20:47:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:47.585 rmmod nvme_tcp 00:29:47.585 rmmod nvme_fabrics 00:29:47.585 rmmod nvme_keyring 00:29:47.585 20:47:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:47.585 20:47:05 -- nvmf/common.sh@123 -- # set -e 00:29:47.585 20:47:05 -- nvmf/common.sh@124 -- # return 0 00:29:47.585 20:47:05 -- nvmf/common.sh@477 -- # '[' -n 45266 ']' 00:29:47.585 20:47:05 -- nvmf/common.sh@478 -- # killprocess 45266 00:29:47.585 20:47:05 -- common/autotest_common.sh@926 -- # '[' -z 45266 ']' 00:29:47.585 20:47:05 -- common/autotest_common.sh@930 -- # kill -0 45266 00:29:47.585 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (45266) - No such process 00:29:47.585 20:47:05 -- common/autotest_common.sh@953 -- # echo 'Process with pid 45266 is not found' 00:29:47.585 Process with pid 45266 is not found 00:29:47.585 20:47:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:47.585 20:47:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:47.585 20:47:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:47.585 20:47:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:47.585 20:47:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:47.585 20:47:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:47.585 20:47:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:47.585 20:47:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:50.135 20:47:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:50.135 00:29:50.135 real 0m41.710s 00:29:50.135 user 1m4.473s 00:29:50.135 sys 0m11.870s 00:29:50.135 20:47:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:50.135 20:47:07 -- common/autotest_common.sh@10 -- # set +x 00:29:50.135 ************************************ 00:29:50.135 END TEST nvmf_digest 00:29:50.135 ************************************ 00:29:50.135 20:47:07 -- nvmf/nvmf.sh@109 -- # [[ 0 -eq 1 ]] 00:29:50.135 20:47:07 -- nvmf/nvmf.sh@114 -- # [[ 0 -eq 1 ]] 00:29:50.135 20:47:07 -- nvmf/nvmf.sh@119 -- # [[ phy == phy ]] 00:29:50.135 20:47:07 -- nvmf/nvmf.sh@121 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:50.135 20:47:07 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:50.135 20:47:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:50.135 20:47:07 -- common/autotest_common.sh@10 -- # set +x 00:29:50.135 ************************************ 00:29:50.135 START TEST nvmf_bdevperf 00:29:50.135 ************************************ 00:29:50.135 20:47:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:50.135 * Looking for test storage... 00:29:50.135 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:50.135 20:47:07 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:50.135 20:47:07 -- nvmf/common.sh@7 -- # uname -s 00:29:50.135 20:47:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:50.135 20:47:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:50.135 20:47:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:50.135 20:47:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:50.135 20:47:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:50.135 20:47:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:50.135 20:47:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:50.135 20:47:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:50.135 20:47:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:50.135 20:47:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:50.135 20:47:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:29:50.135 20:47:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:29:50.135 20:47:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:50.135 20:47:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:50.135 20:47:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:50.135 20:47:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:50.135 20:47:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:50.135 20:47:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:50.135 20:47:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:50.136 20:47:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:50.136 20:47:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:50.136 20:47:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:50.136 20:47:08 -- paths/export.sh@5 -- # export PATH 00:29:50.136 20:47:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:50.136 20:47:08 -- nvmf/common.sh@46 -- # : 0 00:29:50.136 20:47:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:50.136 20:47:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:50.136 20:47:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:50.136 20:47:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:50.136 20:47:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:50.136 20:47:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:50.136 20:47:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:50.136 20:47:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:50.136 20:47:08 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:29:50.136 20:47:08 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:29:50.136 20:47:08 -- host/bdevperf.sh@24 -- # nvmftestinit 00:29:50.136 20:47:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:50.136 20:47:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:50.136 20:47:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:50.136 20:47:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:50.136 20:47:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:50.136 20:47:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:50.136 20:47:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:50.136 20:47:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:50.136 20:47:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:50.136 20:47:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:50.136 20:47:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:50.136 20:47:08 -- common/autotest_common.sh@10 -- # set +x 00:29:56.728 20:47:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:56.728 20:47:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:56.728 20:47:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:56.728 20:47:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:56.728 20:47:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:56.728 20:47:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:56.728 20:47:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:56.728 20:47:14 -- nvmf/common.sh@294 -- # net_devs=() 00:29:56.728 20:47:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:56.728 20:47:14 -- nvmf/common.sh@295 -- # e810=() 00:29:56.728 20:47:14 -- nvmf/common.sh@295 -- # local -ga e810 00:29:56.728 20:47:14 -- nvmf/common.sh@296 -- # x722=() 00:29:56.728 20:47:14 -- nvmf/common.sh@296 -- # local -ga x722 00:29:56.728 20:47:14 -- nvmf/common.sh@297 -- # mlx=() 00:29:56.728 20:47:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:56.728 20:47:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:56.728 20:47:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:56.728 20:47:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:56.728 20:47:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:56.728 20:47:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:56.728 20:47:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:56.728 20:47:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:56.728 20:47:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:56.728 20:47:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:56.728 20:47:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:56.728 20:47:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:56.728 20:47:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:56.728 20:47:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:56.728 20:47:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:56.728 20:47:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:56.728 20:47:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:29:56.728 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:29:56.728 20:47:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:56.728 20:47:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:29:56.728 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:29:56.728 20:47:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:56.728 20:47:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:56.728 20:47:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:56.728 20:47:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:56.728 20:47:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:56.728 20:47:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:29:56.728 Found net devices under 0000:4b:00.0: cvl_0_0 00:29:56.728 20:47:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:56.728 20:47:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:56.728 20:47:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:56.728 20:47:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:56.728 20:47:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:56.728 20:47:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:29:56.728 Found net devices under 0000:4b:00.1: cvl_0_1 00:29:56.728 20:47:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:56.728 20:47:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:56.728 20:47:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:56.728 20:47:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:56.728 20:47:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:56.728 20:47:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:56.728 20:47:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:56.728 20:47:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:56.728 20:47:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:56.728 20:47:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:56.728 20:47:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:56.728 20:47:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:56.728 20:47:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:56.728 20:47:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:56.728 20:47:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:56.728 20:47:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:56.728 20:47:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:56.728 20:47:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:56.728 20:47:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:56.728 20:47:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:56.728 20:47:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:56.728 20:47:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:56.989 20:47:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:56.989 20:47:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:56.989 20:47:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:56.989 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:56.989 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.474 ms 00:29:56.989 00:29:56.989 --- 10.0.0.2 ping statistics --- 00:29:56.989 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:56.989 rtt min/avg/max/mdev = 0.474/0.474/0.474/0.000 ms 00:29:56.989 20:47:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:56.989 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:56.989 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.406 ms 00:29:56.989 00:29:56.989 --- 10.0.0.1 ping statistics --- 00:29:56.989 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:56.989 rtt min/avg/max/mdev = 0.406/0.406/0.406/0.000 ms 00:29:56.989 20:47:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:56.989 20:47:15 -- nvmf/common.sh@410 -- # return 0 00:29:56.989 20:47:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:56.989 20:47:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:56.989 20:47:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:56.989 20:47:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:56.989 20:47:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:56.989 20:47:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:56.989 20:47:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:56.989 20:47:15 -- host/bdevperf.sh@25 -- # tgt_init 00:29:56.989 20:47:15 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:56.989 20:47:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:56.989 20:47:15 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:56.989 20:47:15 -- common/autotest_common.sh@10 -- # set +x 00:29:56.989 20:47:15 -- nvmf/common.sh@469 -- # nvmfpid=52528 00:29:56.989 20:47:15 -- nvmf/common.sh@470 -- # waitforlisten 52528 00:29:56.989 20:47:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:56.989 20:47:15 -- common/autotest_common.sh@819 -- # '[' -z 52528 ']' 00:29:56.989 20:47:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:56.989 20:47:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:56.989 20:47:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:56.989 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:56.989 20:47:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:56.989 20:47:15 -- common/autotest_common.sh@10 -- # set +x 00:29:56.989 [2024-04-26 20:47:15.247467] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:56.989 [2024-04-26 20:47:15.247532] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:56.989 EAL: No free 2048 kB hugepages reported on node 1 00:29:56.989 [2024-04-26 20:47:15.317542] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:57.250 [2024-04-26 20:47:15.389890] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:57.250 [2024-04-26 20:47:15.390015] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:57.250 [2024-04-26 20:47:15.390028] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:57.250 [2024-04-26 20:47:15.390035] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:57.250 [2024-04-26 20:47:15.390142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:57.250 [2024-04-26 20:47:15.390289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:57.250 [2024-04-26 20:47:15.390291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:57.821 20:47:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:57.821 20:47:16 -- common/autotest_common.sh@852 -- # return 0 00:29:57.821 20:47:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:57.821 20:47:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:57.821 20:47:16 -- common/autotest_common.sh@10 -- # set +x 00:29:57.821 20:47:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:57.821 20:47:16 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:57.821 20:47:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:57.821 20:47:16 -- common/autotest_common.sh@10 -- # set +x 00:29:57.821 [2024-04-26 20:47:16.053954] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:57.821 20:47:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:57.821 20:47:16 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:57.821 20:47:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:57.821 20:47:16 -- common/autotest_common.sh@10 -- # set +x 00:29:57.821 Malloc0 00:29:57.821 20:47:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:57.821 20:47:16 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:57.821 20:47:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:57.821 20:47:16 -- common/autotest_common.sh@10 -- # set +x 00:29:57.821 20:47:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:57.821 20:47:16 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:57.821 20:47:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:57.821 20:47:16 -- common/autotest_common.sh@10 -- # set +x 00:29:57.821 20:47:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:57.821 20:47:16 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:57.821 20:47:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:57.821 20:47:16 -- common/autotest_common.sh@10 -- # set +x 00:29:57.821 [2024-04-26 20:47:16.120613] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:57.821 20:47:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:57.821 20:47:16 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:29:57.821 20:47:16 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:29:57.821 20:47:16 -- nvmf/common.sh@520 -- # config=() 00:29:57.821 20:47:16 -- nvmf/common.sh@520 -- # local subsystem config 00:29:57.821 20:47:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:57.821 20:47:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:57.821 { 00:29:57.821 "params": { 00:29:57.821 "name": "Nvme$subsystem", 00:29:57.821 "trtype": "$TEST_TRANSPORT", 00:29:57.821 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:57.821 "adrfam": "ipv4", 00:29:57.821 "trsvcid": "$NVMF_PORT", 00:29:57.821 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:57.821 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:57.821 "hdgst": ${hdgst:-false}, 00:29:57.821 "ddgst": ${ddgst:-false} 00:29:57.821 }, 00:29:57.821 "method": "bdev_nvme_attach_controller" 00:29:57.821 } 00:29:57.821 EOF 00:29:57.821 )") 00:29:57.821 20:47:16 -- nvmf/common.sh@542 -- # cat 00:29:57.821 20:47:16 -- nvmf/common.sh@544 -- # jq . 00:29:57.821 20:47:16 -- nvmf/common.sh@545 -- # IFS=, 00:29:57.821 20:47:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:57.821 "params": { 00:29:57.821 "name": "Nvme1", 00:29:57.821 "trtype": "tcp", 00:29:57.821 "traddr": "10.0.0.2", 00:29:57.821 "adrfam": "ipv4", 00:29:57.821 "trsvcid": "4420", 00:29:57.821 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:57.821 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:57.821 "hdgst": false, 00:29:57.821 "ddgst": false 00:29:57.821 }, 00:29:57.821 "method": "bdev_nvme_attach_controller" 00:29:57.821 }' 00:29:58.082 [2024-04-26 20:47:16.170027] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:58.082 [2024-04-26 20:47:16.170074] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid52847 ] 00:29:58.082 EAL: No free 2048 kB hugepages reported on node 1 00:29:58.082 [2024-04-26 20:47:16.227974] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:58.082 [2024-04-26 20:47:16.290268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:58.342 Running I/O for 1 seconds... 00:29:59.284 00:29:59.284 Latency(us) 00:29:59.284 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:59.284 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:59.284 Verification LBA range: start 0x0 length 0x4000 00:29:59.284 Nvme1n1 : 1.01 13923.77 54.39 0.00 0.00 9147.53 1829.55 17367.04 00:29:59.284 =================================================================================================================== 00:29:59.284 Total : 13923.77 54.39 0.00 0.00 9147.53 1829.55 17367.04 00:29:59.284 20:47:17 -- host/bdevperf.sh@30 -- # bdevperfpid=53058 00:29:59.284 20:47:17 -- host/bdevperf.sh@32 -- # sleep 3 00:29:59.284 20:47:17 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:29:59.284 20:47:17 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:29:59.284 20:47:17 -- nvmf/common.sh@520 -- # config=() 00:29:59.284 20:47:17 -- nvmf/common.sh@520 -- # local subsystem config 00:29:59.284 20:47:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:59.284 20:47:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:59.284 { 00:29:59.284 "params": { 00:29:59.284 "name": "Nvme$subsystem", 00:29:59.284 "trtype": "$TEST_TRANSPORT", 00:29:59.284 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:59.284 "adrfam": "ipv4", 00:29:59.284 "trsvcid": "$NVMF_PORT", 00:29:59.284 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:59.284 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:59.284 "hdgst": ${hdgst:-false}, 00:29:59.284 "ddgst": ${ddgst:-false} 00:29:59.284 }, 00:29:59.284 "method": "bdev_nvme_attach_controller" 00:29:59.284 } 00:29:59.284 EOF 00:29:59.284 )") 00:29:59.284 20:47:17 -- nvmf/common.sh@542 -- # cat 00:29:59.284 20:47:17 -- nvmf/common.sh@544 -- # jq . 00:29:59.284 20:47:17 -- nvmf/common.sh@545 -- # IFS=, 00:29:59.284 20:47:17 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:59.284 "params": { 00:29:59.284 "name": "Nvme1", 00:29:59.284 "trtype": "tcp", 00:29:59.284 "traddr": "10.0.0.2", 00:29:59.284 "adrfam": "ipv4", 00:29:59.284 "trsvcid": "4420", 00:29:59.284 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:59.284 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:59.284 "hdgst": false, 00:29:59.284 "ddgst": false 00:29:59.284 }, 00:29:59.284 "method": "bdev_nvme_attach_controller" 00:29:59.284 }' 00:29:59.284 [2024-04-26 20:47:17.618291] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:29:59.284 [2024-04-26 20:47:17.618347] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid53058 ] 00:29:59.545 EAL: No free 2048 kB hugepages reported on node 1 00:29:59.545 [2024-04-26 20:47:17.676646] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:59.545 [2024-04-26 20:47:17.739407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:59.545 Running I/O for 15 seconds... 00:30:02.854 20:47:20 -- host/bdevperf.sh@33 -- # kill -9 52528 00:30:02.854 20:47:20 -- host/bdevperf.sh@35 -- # sleep 3 00:30:02.854 [2024-04-26 20:47:20.589495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:40000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:40008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:40016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:40040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:40064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:39408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:39416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:39440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:39448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:39456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:39480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:39496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:40072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:40096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:40104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:40128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:39504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:39512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.589983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.589993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:39520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.590001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.590010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:39528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.590017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.590026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:39536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.590034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.590043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:39552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.590050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.590060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:39576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.590067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.590076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:39584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.590084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.590093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:40136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.590100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.590109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:40144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.590116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.590126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:40176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.590133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.590142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:40192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.854 [2024-04-26 20:47:20.590149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.854 [2024-04-26 20:47:20.590158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:40208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:40224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:40240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.855 [2024-04-26 20:47:20.590200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:40248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:40256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.855 [2024-04-26 20:47:20.590234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:40264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:39632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:39648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:39680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:39688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:39704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:39728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:40272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.855 [2024-04-26 20:47:20.590478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:40280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.855 [2024-04-26 20:47:20.590495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:40288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.855 [2024-04-26 20:47:20.590512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:40296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.855 [2024-04-26 20:47:20.590527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:40312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:40320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.855 [2024-04-26 20:47:20.590578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:40328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.855 [2024-04-26 20:47:20.590595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:39760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:39776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:39784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:39800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:39816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:39840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:39848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:39880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.855 [2024-04-26 20:47:20.590786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.855 [2024-04-26 20:47:20.590793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.590803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:39912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.590810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.590819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:39928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.590826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.590836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:39944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.590844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.590853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:39952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.590861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.590870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:40336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.590879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.590888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:40344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.590896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.590906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:40352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.590913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.590922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:40360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.856 [2024-04-26 20:47:20.590929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.590938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.590946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.590955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:40376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.856 [2024-04-26 20:47:20.590962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.590972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:40384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.590979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.590989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:40392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.590996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:40400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.591012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:40408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.591029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:40416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.856 [2024-04-26 20:47:20.591046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:40424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.591062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:40432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.591078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:40440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.856 [2024-04-26 20:47:20.591097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:40448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.856 [2024-04-26 20:47:20.591113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:40456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.591130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:40464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.591147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:40472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.856 [2024-04-26 20:47:20.591164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:40480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.591180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:40488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.591198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:40496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.856 [2024-04-26 20:47:20.591215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:40504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.856 [2024-04-26 20:47:20.591231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:40512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.856 [2024-04-26 20:47:20.591248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:40520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.856 [2024-04-26 20:47:20.591265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:40528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.591285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:40536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.856 [2024-04-26 20:47:20.591304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:40544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.591320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:39976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.856 [2024-04-26 20:47:20.591338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.856 [2024-04-26 20:47:20.591348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:39984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:40024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:40032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:40048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:40056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:40080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:40552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:40560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.857 [2024-04-26 20:47:20.591492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:40568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:40576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.857 [2024-04-26 20:47:20.591530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:40584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.857 [2024-04-26 20:47:20.591547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:40592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.857 [2024-04-26 20:47:20.591564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:40600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:40608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:40616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.857 [2024-04-26 20:47:20.591614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:40624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:40632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.857 [2024-04-26 20:47:20.591647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:40640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:40648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:40656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.857 [2024-04-26 20:47:20.591702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:40664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:40672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.857 [2024-04-26 20:47:20.591735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:40120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:40152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:40160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:40168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:40184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:40200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:40216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.857 [2024-04-26 20:47:20.591857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.857 [2024-04-26 20:47:20.591867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa85ab0 is same with the state(5) to be set 00:30:02.857 [2024-04-26 20:47:20.591876] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:02.857 [2024-04-26 20:47:20.591882] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:02.857 [2024-04-26 20:47:20.591888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40232 len:8 PRP1 0x0 PRP2 0x0 00:30:02.857 [2024-04-26 20:47:20.591896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.858 [2024-04-26 20:47:20.591931] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xa85ab0 was disconnected and freed. reset controller. 00:30:02.858 [2024-04-26 20:47:20.594160] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.858 [2024-04-26 20:47:20.594206] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.858 [2024-04-26 20:47:20.594989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.595564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.595601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.858 [2024-04-26 20:47:20.595613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.858 [2024-04-26 20:47:20.595724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.858 [2024-04-26 20:47:20.595893] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.858 [2024-04-26 20:47:20.595902] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.858 [2024-04-26 20:47:20.595910] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.858 [2024-04-26 20:47:20.598360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.858 [2024-04-26 20:47:20.606592] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.858 [2024-04-26 20:47:20.607123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.607609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.607647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.858 [2024-04-26 20:47:20.607659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.858 [2024-04-26 20:47:20.607823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.858 [2024-04-26 20:47:20.607951] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.858 [2024-04-26 20:47:20.607960] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.858 [2024-04-26 20:47:20.607968] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.858 [2024-04-26 20:47:20.610272] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.858 [2024-04-26 20:47:20.619076] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.858 [2024-04-26 20:47:20.619667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.620179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.620193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.858 [2024-04-26 20:47:20.620202] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.858 [2024-04-26 20:47:20.620353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.858 [2024-04-26 20:47:20.620499] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.858 [2024-04-26 20:47:20.620508] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.858 [2024-04-26 20:47:20.620516] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.858 [2024-04-26 20:47:20.622822] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.858 [2024-04-26 20:47:20.631627] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.858 [2024-04-26 20:47:20.632239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.632773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.632811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.858 [2024-04-26 20:47:20.632822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.858 [2024-04-26 20:47:20.633001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.858 [2024-04-26 20:47:20.633129] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.858 [2024-04-26 20:47:20.633143] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.858 [2024-04-26 20:47:20.633151] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.858 [2024-04-26 20:47:20.635310] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.858 [2024-04-26 20:47:20.644238] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.858 [2024-04-26 20:47:20.644979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.645591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.645628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.858 [2024-04-26 20:47:20.645639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.858 [2024-04-26 20:47:20.645800] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.858 [2024-04-26 20:47:20.645965] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.858 [2024-04-26 20:47:20.645973] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.858 [2024-04-26 20:47:20.645981] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.858 [2024-04-26 20:47:20.648189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.858 [2024-04-26 20:47:20.656586] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.858 [2024-04-26 20:47:20.657324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.657852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.657866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.858 [2024-04-26 20:47:20.657875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.858 [2024-04-26 20:47:20.658018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.858 [2024-04-26 20:47:20.658164] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.858 [2024-04-26 20:47:20.658173] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.858 [2024-04-26 20:47:20.658180] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.858 [2024-04-26 20:47:20.660502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.858 [2024-04-26 20:47:20.669123] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.858 [2024-04-26 20:47:20.669839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.670534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.670572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.858 [2024-04-26 20:47:20.670582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.858 [2024-04-26 20:47:20.670744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.858 [2024-04-26 20:47:20.670853] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.858 [2024-04-26 20:47:20.670862] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.858 [2024-04-26 20:47:20.670874] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.858 [2024-04-26 20:47:20.673083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.858 [2024-04-26 20:47:20.681604] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.858 [2024-04-26 20:47:20.682296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.682828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.858 [2024-04-26 20:47:20.682841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.859 [2024-04-26 20:47:20.682850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.859 [2024-04-26 20:47:20.683047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.859 [2024-04-26 20:47:20.683194] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.859 [2024-04-26 20:47:20.683203] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.859 [2024-04-26 20:47:20.683210] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.859 [2024-04-26 20:47:20.685549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.859 [2024-04-26 20:47:20.694193] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.859 [2024-04-26 20:47:20.694886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.859 [2024-04-26 20:47:20.695374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.859 [2024-04-26 20:47:20.695388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.859 [2024-04-26 20:47:20.695398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.859 [2024-04-26 20:47:20.695595] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.859 [2024-04-26 20:47:20.695778] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.859 [2024-04-26 20:47:20.695789] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.859 [2024-04-26 20:47:20.695797] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.859 [2024-04-26 20:47:20.698108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.859 [2024-04-26 20:47:20.706752] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.859 [2024-04-26 20:47:20.707385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.859 [2024-04-26 20:47:20.707675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.859 [2024-04-26 20:47:20.707686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.859 [2024-04-26 20:47:20.707694] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.859 [2024-04-26 20:47:20.707818] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.859 [2024-04-26 20:47:20.707997] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.859 [2024-04-26 20:47:20.708006] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.859 [2024-04-26 20:47:20.708013] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.859 [2024-04-26 20:47:20.710211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.859 [2024-04-26 20:47:20.719318] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.859 [2024-04-26 20:47:20.720012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.859 [2024-04-26 20:47:20.720525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.859 [2024-04-26 20:47:20.720540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.859 [2024-04-26 20:47:20.720550] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.859 [2024-04-26 20:47:20.720729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.859 [2024-04-26 20:47:20.720930] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.859 [2024-04-26 20:47:20.720941] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.859 [2024-04-26 20:47:20.720948] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.859 [2024-04-26 20:47:20.723217] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.859 [2024-04-26 20:47:20.731941] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.859 [2024-04-26 20:47:20.732636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.859 [2024-04-26 20:47:20.733079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.859 [2024-04-26 20:47:20.733090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.859 [2024-04-26 20:47:20.733098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.859 [2024-04-26 20:47:20.733205] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.859 [2024-04-26 20:47:20.733333] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.859 [2024-04-26 20:47:20.733341] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.859 [2024-04-26 20:47:20.733348] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.859 [2024-04-26 20:47:20.735674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.859 [2024-04-26 20:47:20.744173] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.859 [2024-04-26 20:47:20.744774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.859 [2024-04-26 20:47:20.745281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.859 [2024-04-26 20:47:20.745292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.859 [2024-04-26 20:47:20.745299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.859 [2024-04-26 20:47:20.745459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.859 [2024-04-26 20:47:20.745583] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.859 [2024-04-26 20:47:20.745592] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.859 [2024-04-26 20:47:20.745598] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.860 [2024-04-26 20:47:20.747867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.860 [2024-04-26 20:47:20.756755] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.860 [2024-04-26 20:47:20.757472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.757934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.757945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.860 [2024-04-26 20:47:20.757953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.860 [2024-04-26 20:47:20.758082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.860 [2024-04-26 20:47:20.758207] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.860 [2024-04-26 20:47:20.758216] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.860 [2024-04-26 20:47:20.758223] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.860 [2024-04-26 20:47:20.760431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.860 [2024-04-26 20:47:20.769186] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.860 [2024-04-26 20:47:20.769746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.770231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.770241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.860 [2024-04-26 20:47:20.770249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.860 [2024-04-26 20:47:20.770378] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.860 [2024-04-26 20:47:20.770558] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.860 [2024-04-26 20:47:20.770566] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.860 [2024-04-26 20:47:20.770573] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.860 [2024-04-26 20:47:20.772895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.860 [2024-04-26 20:47:20.781549] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.860 [2024-04-26 20:47:20.782152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.782643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.782655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.860 [2024-04-26 20:47:20.782663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.860 [2024-04-26 20:47:20.782787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.860 [2024-04-26 20:47:20.782930] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.860 [2024-04-26 20:47:20.782939] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.860 [2024-04-26 20:47:20.782946] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.860 [2024-04-26 20:47:20.785291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.860 [2024-04-26 20:47:20.794065] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.860 [2024-04-26 20:47:20.794496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.795010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.795027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.860 [2024-04-26 20:47:20.795036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.860 [2024-04-26 20:47:20.795202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.860 [2024-04-26 20:47:20.795352] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.860 [2024-04-26 20:47:20.795362] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.860 [2024-04-26 20:47:20.795369] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.860 [2024-04-26 20:47:20.797480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.860 [2024-04-26 20:47:20.806579] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.860 [2024-04-26 20:47:20.807365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.807888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.807902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.860 [2024-04-26 20:47:20.807911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.860 [2024-04-26 20:47:20.808073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.860 [2024-04-26 20:47:20.808201] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.860 [2024-04-26 20:47:20.808210] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.860 [2024-04-26 20:47:20.808217] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.860 [2024-04-26 20:47:20.810591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.860 [2024-04-26 20:47:20.818996] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.860 [2024-04-26 20:47:20.819493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.819985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.819996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.860 [2024-04-26 20:47:20.820004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.860 [2024-04-26 20:47:20.820129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.860 [2024-04-26 20:47:20.820311] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.860 [2024-04-26 20:47:20.820320] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.860 [2024-04-26 20:47:20.820327] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.860 [2024-04-26 20:47:20.822586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.860 [2024-04-26 20:47:20.831499] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.860 [2024-04-26 20:47:20.832078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.832465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.860 [2024-04-26 20:47:20.832477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.860 [2024-04-26 20:47:20.832489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.860 [2024-04-26 20:47:20.832632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.860 [2024-04-26 20:47:20.832774] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.860 [2024-04-26 20:47:20.832783] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.860 [2024-04-26 20:47:20.832790] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.860 [2024-04-26 20:47:20.835133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.860 [2024-04-26 20:47:20.843951] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.860 [2024-04-26 20:47:20.844429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.844898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.844909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.861 [2024-04-26 20:47:20.844916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.861 [2024-04-26 20:47:20.845059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.861 [2024-04-26 20:47:20.845147] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.861 [2024-04-26 20:47:20.845156] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.861 [2024-04-26 20:47:20.845163] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.861 [2024-04-26 20:47:20.847384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.861 [2024-04-26 20:47:20.856238] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.861 [2024-04-26 20:47:20.856876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.857374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.857385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.861 [2024-04-26 20:47:20.857392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.861 [2024-04-26 20:47:20.857516] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.861 [2024-04-26 20:47:20.857695] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.861 [2024-04-26 20:47:20.857704] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.861 [2024-04-26 20:47:20.857711] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.861 [2024-04-26 20:47:20.860089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.861 [2024-04-26 20:47:20.868801] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.861 [2024-04-26 20:47:20.869397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.869854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.869864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.861 [2024-04-26 20:47:20.869872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.861 [2024-04-26 20:47:20.870005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.861 [2024-04-26 20:47:20.870147] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.861 [2024-04-26 20:47:20.870156] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.861 [2024-04-26 20:47:20.870163] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.861 [2024-04-26 20:47:20.872382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.861 [2024-04-26 20:47:20.881364] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.861 [2024-04-26 20:47:20.882014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.882511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.882522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.861 [2024-04-26 20:47:20.882529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.861 [2024-04-26 20:47:20.882689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.861 [2024-04-26 20:47:20.882813] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.861 [2024-04-26 20:47:20.882822] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.861 [2024-04-26 20:47:20.882829] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.861 [2024-04-26 20:47:20.885187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.861 [2024-04-26 20:47:20.893853] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.861 [2024-04-26 20:47:20.894510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.895027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.895041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.861 [2024-04-26 20:47:20.895050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.861 [2024-04-26 20:47:20.895211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.861 [2024-04-26 20:47:20.895346] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.861 [2024-04-26 20:47:20.895356] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.861 [2024-04-26 20:47:20.895363] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.861 [2024-04-26 20:47:20.897567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.861 [2024-04-26 20:47:20.906326] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.861 [2024-04-26 20:47:20.907087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.907218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.907228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.861 [2024-04-26 20:47:20.907236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.861 [2024-04-26 20:47:20.907437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.861 [2024-04-26 20:47:20.907586] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.861 [2024-04-26 20:47:20.907595] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.861 [2024-04-26 20:47:20.907602] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.861 [2024-04-26 20:47:20.909840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.861 [2024-04-26 20:47:20.918822] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.861 [2024-04-26 20:47:20.919170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.919617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.919655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.861 [2024-04-26 20:47:20.919665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.861 [2024-04-26 20:47:20.919807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.861 [2024-04-26 20:47:20.919954] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.861 [2024-04-26 20:47:20.919963] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.861 [2024-04-26 20:47:20.919971] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.861 [2024-04-26 20:47:20.922252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.861 [2024-04-26 20:47:20.931142] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.861 [2024-04-26 20:47:20.931728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.932221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.861 [2024-04-26 20:47:20.932233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.861 [2024-04-26 20:47:20.932241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.861 [2024-04-26 20:47:20.932370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.861 [2024-04-26 20:47:20.932477] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.861 [2024-04-26 20:47:20.932485] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.861 [2024-04-26 20:47:20.932492] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.861 [2024-04-26 20:47:20.934835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.862 [2024-04-26 20:47:20.943643] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.862 [2024-04-26 20:47:20.944269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:20.944728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:20.944766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.862 [2024-04-26 20:47:20.944777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.862 [2024-04-26 20:47:20.944940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.862 [2024-04-26 20:47:20.945068] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.862 [2024-04-26 20:47:20.945082] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.862 [2024-04-26 20:47:20.945091] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.862 [2024-04-26 20:47:20.947279] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.862 [2024-04-26 20:47:20.955892] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.862 [2024-04-26 20:47:20.956560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:20.957050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:20.957063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.862 [2024-04-26 20:47:20.957072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.862 [2024-04-26 20:47:20.957178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.862 [2024-04-26 20:47:20.957269] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.862 [2024-04-26 20:47:20.957283] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.862 [2024-04-26 20:47:20.957291] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.862 [2024-04-26 20:47:20.959423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.862 [2024-04-26 20:47:20.968200] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.862 [2024-04-26 20:47:20.968844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:20.969506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:20.969543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.862 [2024-04-26 20:47:20.969554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.862 [2024-04-26 20:47:20.969751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.862 [2024-04-26 20:47:20.969879] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.862 [2024-04-26 20:47:20.969889] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.862 [2024-04-26 20:47:20.969896] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.862 [2024-04-26 20:47:20.972140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.862 [2024-04-26 20:47:20.980681] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.862 [2024-04-26 20:47:20.981514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:20.982029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:20.982043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.862 [2024-04-26 20:47:20.982052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.862 [2024-04-26 20:47:20.982268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.862 [2024-04-26 20:47:20.982421] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.862 [2024-04-26 20:47:20.982430] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.862 [2024-04-26 20:47:20.982442] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.862 [2024-04-26 20:47:20.984555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.862 [2024-04-26 20:47:20.993237] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.862 [2024-04-26 20:47:20.993923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:20.994463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:20.994478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.862 [2024-04-26 20:47:20.994488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.862 [2024-04-26 20:47:20.994686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.862 [2024-04-26 20:47:20.994887] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.862 [2024-04-26 20:47:20.994897] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.862 [2024-04-26 20:47:20.994904] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.862 [2024-04-26 20:47:20.997201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.862 [2024-04-26 20:47:21.005630] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.862 [2024-04-26 20:47:21.006138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:21.006778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:21.006816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.862 [2024-04-26 20:47:21.006826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.862 [2024-04-26 20:47:21.006951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.862 [2024-04-26 20:47:21.007115] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.862 [2024-04-26 20:47:21.007124] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.862 [2024-04-26 20:47:21.007132] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.862 [2024-04-26 20:47:21.009267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.862 [2024-04-26 20:47:21.018125] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.862 [2024-04-26 20:47:21.018543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:21.019006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:21.019017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.862 [2024-04-26 20:47:21.019024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.862 [2024-04-26 20:47:21.019167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.862 [2024-04-26 20:47:21.019296] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.862 [2024-04-26 20:47:21.019305] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.862 [2024-04-26 20:47:21.019311] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.862 [2024-04-26 20:47:21.021625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.862 [2024-04-26 20:47:21.030727] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.862 [2024-04-26 20:47:21.031407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:21.031919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.862 [2024-04-26 20:47:21.031932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.862 [2024-04-26 20:47:21.031946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.863 [2024-04-26 20:47:21.032131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.863 [2024-04-26 20:47:21.032259] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.863 [2024-04-26 20:47:21.032268] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.863 [2024-04-26 20:47:21.032283] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.863 [2024-04-26 20:47:21.034397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.863 [2024-04-26 20:47:21.043209] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.863 [2024-04-26 20:47:21.043934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.044432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.044447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.863 [2024-04-26 20:47:21.044456] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.863 [2024-04-26 20:47:21.044636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.863 [2024-04-26 20:47:21.044746] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.863 [2024-04-26 20:47:21.044755] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.863 [2024-04-26 20:47:21.044763] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.863 [2024-04-26 20:47:21.047040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.863 [2024-04-26 20:47:21.055685] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.863 [2024-04-26 20:47:21.056270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.056424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.056441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.863 [2024-04-26 20:47:21.056449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.863 [2024-04-26 20:47:21.056613] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.863 [2024-04-26 20:47:21.056775] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.863 [2024-04-26 20:47:21.056784] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.863 [2024-04-26 20:47:21.056791] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.863 [2024-04-26 20:47:21.059139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.863 [2024-04-26 20:47:21.068147] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.863 [2024-04-26 20:47:21.068663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.069142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.069153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.863 [2024-04-26 20:47:21.069160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.863 [2024-04-26 20:47:21.069290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.863 [2024-04-26 20:47:21.069469] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.863 [2024-04-26 20:47:21.069478] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.863 [2024-04-26 20:47:21.069485] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.863 [2024-04-26 20:47:21.071609] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.863 [2024-04-26 20:47:21.080629] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.863 [2024-04-26 20:47:21.081267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.081652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.081662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.863 [2024-04-26 20:47:21.081670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.863 [2024-04-26 20:47:21.081812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.863 [2024-04-26 20:47:21.081955] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.863 [2024-04-26 20:47:21.081963] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.863 [2024-04-26 20:47:21.081970] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.863 [2024-04-26 20:47:21.084078] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.863 [2024-04-26 20:47:21.093180] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.863 [2024-04-26 20:47:21.093801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.094201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.094212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.863 [2024-04-26 20:47:21.094220] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.863 [2024-04-26 20:47:21.094367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.863 [2024-04-26 20:47:21.094528] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.863 [2024-04-26 20:47:21.094537] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.863 [2024-04-26 20:47:21.094545] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.863 [2024-04-26 20:47:21.096744] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.863 [2024-04-26 20:47:21.105667] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.863 [2024-04-26 20:47:21.106257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.107168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.107201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.863 [2024-04-26 20:47:21.107212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.863 [2024-04-26 20:47:21.107366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.863 [2024-04-26 20:47:21.107496] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.863 [2024-04-26 20:47:21.107506] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.863 [2024-04-26 20:47:21.107513] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.863 [2024-04-26 20:47:21.109663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.863 [2024-04-26 20:47:21.118347] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.863 [2024-04-26 20:47:21.118932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.119369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.863 [2024-04-26 20:47:21.119381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.863 [2024-04-26 20:47:21.119389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.863 [2024-04-26 20:47:21.119532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.863 [2024-04-26 20:47:21.119712] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.863 [2024-04-26 20:47:21.119720] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.863 [2024-04-26 20:47:21.119727] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.863 [2024-04-26 20:47:21.121944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.863 [2024-04-26 20:47:21.130752] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.864 [2024-04-26 20:47:21.131376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.864 [2024-04-26 20:47:21.131820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.864 [2024-04-26 20:47:21.131833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.864 [2024-04-26 20:47:21.131841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.864 [2024-04-26 20:47:21.131983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.864 [2024-04-26 20:47:21.132131] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.864 [2024-04-26 20:47:21.132142] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.864 [2024-04-26 20:47:21.132149] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.864 [2024-04-26 20:47:21.134641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.864 [2024-04-26 20:47:21.143353] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.864 [2024-04-26 20:47:21.143958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.864 [2024-04-26 20:47:21.145064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.864 [2024-04-26 20:47:21.145089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.864 [2024-04-26 20:47:21.145097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.864 [2024-04-26 20:47:21.145208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.864 [2024-04-26 20:47:21.145376] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.864 [2024-04-26 20:47:21.145386] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.864 [2024-04-26 20:47:21.145393] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.864 [2024-04-26 20:47:21.147540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.864 [2024-04-26 20:47:21.155706] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.864 [2024-04-26 20:47:21.156175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.864 [2024-04-26 20:47:21.156654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.864 [2024-04-26 20:47:21.156666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.864 [2024-04-26 20:47:21.156674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.864 [2024-04-26 20:47:21.156780] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.864 [2024-04-26 20:47:21.156923] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.864 [2024-04-26 20:47:21.156931] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.864 [2024-04-26 20:47:21.156938] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.864 [2024-04-26 20:47:21.159009] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.864 [2024-04-26 20:47:21.168050] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.864 [2024-04-26 20:47:21.168670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.864 [2024-04-26 20:47:21.169126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.864 [2024-04-26 20:47:21.169137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.864 [2024-04-26 20:47:21.169145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.864 [2024-04-26 20:47:21.169308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.864 [2024-04-26 20:47:21.169470] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.864 [2024-04-26 20:47:21.169478] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.864 [2024-04-26 20:47:21.169485] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.864 [2024-04-26 20:47:21.171829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:02.864 [2024-04-26 20:47:21.180489] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:02.864 [2024-04-26 20:47:21.181170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.864 [2024-04-26 20:47:21.181514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.864 [2024-04-26 20:47:21.181529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:02.864 [2024-04-26 20:47:21.181543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:02.864 [2024-04-26 20:47:21.181687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:02.864 [2024-04-26 20:47:21.181888] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:02.864 [2024-04-26 20:47:21.181898] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:02.864 [2024-04-26 20:47:21.181906] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:02.864 [2024-04-26 20:47:21.184113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.127 [2024-04-26 20:47:21.192869] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.127 [2024-04-26 20:47:21.193589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.127 [2024-04-26 20:47:21.194101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.127 [2024-04-26 20:47:21.194115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.127 [2024-04-26 20:47:21.194124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.127 [2024-04-26 20:47:21.194328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.127 [2024-04-26 20:47:21.194493] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.127 [2024-04-26 20:47:21.194503] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.127 [2024-04-26 20:47:21.194511] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.127 [2024-04-26 20:47:21.196716] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.127 [2024-04-26 20:47:21.205370] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.127 [2024-04-26 20:47:21.206115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.127 [2024-04-26 20:47:21.206600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.127 [2024-04-26 20:47:21.206616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.127 [2024-04-26 20:47:21.206625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.127 [2024-04-26 20:47:21.206787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.127 [2024-04-26 20:47:21.206951] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.127 [2024-04-26 20:47:21.206961] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.127 [2024-04-26 20:47:21.206969] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.127 [2024-04-26 20:47:21.209176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.127 [2024-04-26 20:47:21.217622] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.127 [2024-04-26 20:47:21.218154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.127 [2024-04-26 20:47:21.218643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.127 [2024-04-26 20:47:21.218655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.127 [2024-04-26 20:47:21.218662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.127 [2024-04-26 20:47:21.218846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.127 [2024-04-26 20:47:21.218971] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.127 [2024-04-26 20:47:21.218979] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.127 [2024-04-26 20:47:21.218986] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.127 [2024-04-26 20:47:21.221202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.127 [2024-04-26 20:47:21.230267] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.127 [2024-04-26 20:47:21.230981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.127 [2024-04-26 20:47:21.231484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.127 [2024-04-26 20:47:21.231499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.128 [2024-04-26 20:47:21.231508] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.128 [2024-04-26 20:47:21.231651] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.128 [2024-04-26 20:47:21.231797] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.128 [2024-04-26 20:47:21.231806] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.128 [2024-04-26 20:47:21.231815] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.128 [2024-04-26 20:47:21.234031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.128 [2024-04-26 20:47:21.242661] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.128 [2024-04-26 20:47:21.243506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.244062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.244075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.128 [2024-04-26 20:47:21.244085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.128 [2024-04-26 20:47:21.244245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.128 [2024-04-26 20:47:21.244398] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.128 [2024-04-26 20:47:21.244407] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.128 [2024-04-26 20:47:21.244415] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.128 [2024-04-26 20:47:21.246418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.128 [2024-04-26 20:47:21.255163] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.128 [2024-04-26 20:47:21.255648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.256129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.256140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.128 [2024-04-26 20:47:21.256148] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.128 [2024-04-26 20:47:21.256333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.128 [2024-04-26 20:47:21.256481] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.128 [2024-04-26 20:47:21.256490] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.128 [2024-04-26 20:47:21.256497] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.128 [2024-04-26 20:47:21.258690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.128 [2024-04-26 20:47:21.267551] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.128 [2024-04-26 20:47:21.268177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.268653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.268664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.128 [2024-04-26 20:47:21.268672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.128 [2024-04-26 20:47:21.268796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.128 [2024-04-26 20:47:21.268957] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.128 [2024-04-26 20:47:21.268966] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.128 [2024-04-26 20:47:21.268973] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.128 [2024-04-26 20:47:21.271153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.128 [2024-04-26 20:47:21.280089] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.128 [2024-04-26 20:47:21.280615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.281100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.281110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.128 [2024-04-26 20:47:21.281118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.128 [2024-04-26 20:47:21.281260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.128 [2024-04-26 20:47:21.281445] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.128 [2024-04-26 20:47:21.281454] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.128 [2024-04-26 20:47:21.281461] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.128 [2024-04-26 20:47:21.283678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.128 [2024-04-26 20:47:21.292691] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.128 [2024-04-26 20:47:21.293383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.293834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.293847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.128 [2024-04-26 20:47:21.293856] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.128 [2024-04-26 20:47:21.293999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.128 [2024-04-26 20:47:21.294164] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.128 [2024-04-26 20:47:21.294178] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.128 [2024-04-26 20:47:21.294185] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.128 [2024-04-26 20:47:21.296416] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.128 [2024-04-26 20:47:21.305192] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.128 [2024-04-26 20:47:21.305789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.306270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.306285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.128 [2024-04-26 20:47:21.306293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.128 [2024-04-26 20:47:21.306417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.128 [2024-04-26 20:47:21.306578] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.128 [2024-04-26 20:47:21.306588] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.128 [2024-04-26 20:47:21.306595] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.128 [2024-04-26 20:47:21.308757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.128 [2024-04-26 20:47:21.317724] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.128 [2024-04-26 20:47:21.318239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.318806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.318844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.128 [2024-04-26 20:47:21.318854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.128 [2024-04-26 20:47:21.318997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.128 [2024-04-26 20:47:21.319107] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.128 [2024-04-26 20:47:21.319116] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.128 [2024-04-26 20:47:21.319123] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.128 [2024-04-26 20:47:21.321300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.128 [2024-04-26 20:47:21.330328] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.128 [2024-04-26 20:47:21.331077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.331592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.331608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.128 [2024-04-26 20:47:21.331617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.128 [2024-04-26 20:47:21.331723] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.128 [2024-04-26 20:47:21.331869] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.128 [2024-04-26 20:47:21.331879] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.128 [2024-04-26 20:47:21.331891] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.128 [2024-04-26 20:47:21.334192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.128 [2024-04-26 20:47:21.342923] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.128 [2024-04-26 20:47:21.343632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.344146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.128 [2024-04-26 20:47:21.344160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.128 [2024-04-26 20:47:21.344169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.128 [2024-04-26 20:47:21.344301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.128 [2024-04-26 20:47:21.344502] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.128 [2024-04-26 20:47:21.344511] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.129 [2024-04-26 20:47:21.344518] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.129 [2024-04-26 20:47:21.346686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.129 [2024-04-26 20:47:21.355285] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.129 [2024-04-26 20:47:21.355852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.356369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.356383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.129 [2024-04-26 20:47:21.356393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.129 [2024-04-26 20:47:21.356554] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.129 [2024-04-26 20:47:21.356681] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.129 [2024-04-26 20:47:21.356690] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.129 [2024-04-26 20:47:21.356698] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.129 [2024-04-26 20:47:21.358847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.129 [2024-04-26 20:47:21.367845] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.129 [2024-04-26 20:47:21.368581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.368943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.368958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.129 [2024-04-26 20:47:21.368968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.129 [2024-04-26 20:47:21.369166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.129 [2024-04-26 20:47:21.369336] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.129 [2024-04-26 20:47:21.369345] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.129 [2024-04-26 20:47:21.369353] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.129 [2024-04-26 20:47:21.371627] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.129 [2024-04-26 20:47:21.380132] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.129 [2024-04-26 20:47:21.380753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.381240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.381251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.129 [2024-04-26 20:47:21.381258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.129 [2024-04-26 20:47:21.381405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.129 [2024-04-26 20:47:21.381566] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.129 [2024-04-26 20:47:21.381574] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.129 [2024-04-26 20:47:21.381581] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.129 [2024-04-26 20:47:21.383724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.129 [2024-04-26 20:47:21.392596] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.129 [2024-04-26 20:47:21.393162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.393641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.393655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.129 [2024-04-26 20:47:21.393665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.129 [2024-04-26 20:47:21.393826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.129 [2024-04-26 20:47:21.393990] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.129 [2024-04-26 20:47:21.393999] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.129 [2024-04-26 20:47:21.394007] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.129 [2024-04-26 20:47:21.396268] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.129 [2024-04-26 20:47:21.405054] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.129 [2024-04-26 20:47:21.405675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.406165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.406176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.129 [2024-04-26 20:47:21.406184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.129 [2024-04-26 20:47:21.406314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.129 [2024-04-26 20:47:21.406421] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.129 [2024-04-26 20:47:21.406428] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.129 [2024-04-26 20:47:21.406435] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.129 [2024-04-26 20:47:21.408724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.129 [2024-04-26 20:47:21.417506] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.129 [2024-04-26 20:47:21.418245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.418622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.418636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.129 [2024-04-26 20:47:21.418646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.129 [2024-04-26 20:47:21.418788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.129 [2024-04-26 20:47:21.418971] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.129 [2024-04-26 20:47:21.418981] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.129 [2024-04-26 20:47:21.418989] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.129 [2024-04-26 20:47:21.421324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.129 [2024-04-26 20:47:21.429933] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.129 [2024-04-26 20:47:21.430620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.431131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.431144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.129 [2024-04-26 20:47:21.431153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.129 [2024-04-26 20:47:21.431323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.129 [2024-04-26 20:47:21.431470] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.129 [2024-04-26 20:47:21.431479] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.129 [2024-04-26 20:47:21.431487] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.129 [2024-04-26 20:47:21.433461] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.129 [2024-04-26 20:47:21.442393] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.129 [2024-04-26 20:47:21.443021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.443505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.443521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.129 [2024-04-26 20:47:21.443530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.129 [2024-04-26 20:47:21.443710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.129 [2024-04-26 20:47:21.443819] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.129 [2024-04-26 20:47:21.443828] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.129 [2024-04-26 20:47:21.443836] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.129 [2024-04-26 20:47:21.445879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.129 [2024-04-26 20:47:21.455015] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.129 [2024-04-26 20:47:21.455689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.456127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.456140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.129 [2024-04-26 20:47:21.456149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.129 [2024-04-26 20:47:21.456319] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.129 [2024-04-26 20:47:21.456448] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.129 [2024-04-26 20:47:21.456457] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.129 [2024-04-26 20:47:21.456465] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.129 [2024-04-26 20:47:21.458887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.129 [2024-04-26 20:47:21.467453] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.129 [2024-04-26 20:47:21.468170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.129 [2024-04-26 20:47:21.468648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.130 [2024-04-26 20:47:21.468662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.130 [2024-04-26 20:47:21.468672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.130 [2024-04-26 20:47:21.468869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.130 [2024-04-26 20:47:21.468997] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.130 [2024-04-26 20:47:21.469006] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.130 [2024-04-26 20:47:21.469014] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.393 [2024-04-26 20:47:21.471317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.393 [2024-04-26 20:47:21.479776] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.393 [2024-04-26 20:47:21.480290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.393 [2024-04-26 20:47:21.480791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.393 [2024-04-26 20:47:21.480802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.393 [2024-04-26 20:47:21.480810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.393 [2024-04-26 20:47:21.480953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.393 [2024-04-26 20:47:21.481096] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.393 [2024-04-26 20:47:21.481104] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.393 [2024-04-26 20:47:21.481111] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.393 [2024-04-26 20:47:21.483260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.393 [2024-04-26 20:47:21.492218] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.393 [2024-04-26 20:47:21.492904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.393 [2024-04-26 20:47:21.493414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.393 [2024-04-26 20:47:21.493429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.393 [2024-04-26 20:47:21.493442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.393 [2024-04-26 20:47:21.493622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.393 [2024-04-26 20:47:21.493823] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.393 [2024-04-26 20:47:21.493832] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.393 [2024-04-26 20:47:21.493839] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.393 [2024-04-26 20:47:21.496135] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.393 [2024-04-26 20:47:21.504610] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.393 [2024-04-26 20:47:21.505195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.393 [2024-04-26 20:47:21.505649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.393 [2024-04-26 20:47:21.505660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.393 [2024-04-26 20:47:21.505668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.393 [2024-04-26 20:47:21.505792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.393 [2024-04-26 20:47:21.505916] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.393 [2024-04-26 20:47:21.505924] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.393 [2024-04-26 20:47:21.505931] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.393 [2024-04-26 20:47:21.508298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.393 [2024-04-26 20:47:21.517207] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.393 [2024-04-26 20:47:21.517892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.393 [2024-04-26 20:47:21.518360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.393 [2024-04-26 20:47:21.518374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.393 [2024-04-26 20:47:21.518384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.393 [2024-04-26 20:47:21.518545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.393 [2024-04-26 20:47:21.518692] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.393 [2024-04-26 20:47:21.518701] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.393 [2024-04-26 20:47:21.518708] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.393 [2024-04-26 20:47:21.520896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.393 [2024-04-26 20:47:21.529696] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.393 [2024-04-26 20:47:21.530439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.393 [2024-04-26 20:47:21.530947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.393 [2024-04-26 20:47:21.530961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.393 [2024-04-26 20:47:21.530970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.393 [2024-04-26 20:47:21.531116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.393 [2024-04-26 20:47:21.531308] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.393 [2024-04-26 20:47:21.531317] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.393 [2024-04-26 20:47:21.531325] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.393 [2024-04-26 20:47:21.533697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.393 [2024-04-26 20:47:21.542159] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.393 [2024-04-26 20:47:21.542892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.393 [2024-04-26 20:47:21.543367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.393 [2024-04-26 20:47:21.543381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.393 [2024-04-26 20:47:21.543391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.393 [2024-04-26 20:47:21.543552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.393 [2024-04-26 20:47:21.543699] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.393 [2024-04-26 20:47:21.543708] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.393 [2024-04-26 20:47:21.543715] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.394 [2024-04-26 20:47:21.546084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.394 [2024-04-26 20:47:21.554654] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.394 [2024-04-26 20:47:21.555212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.555668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.555679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.394 [2024-04-26 20:47:21.555687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.394 [2024-04-26 20:47:21.555830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.394 [2024-04-26 20:47:21.555990] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.394 [2024-04-26 20:47:21.556000] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.394 [2024-04-26 20:47:21.556006] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.394 [2024-04-26 20:47:21.558170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.394 [2024-04-26 20:47:21.567152] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.394 [2024-04-26 20:47:21.567917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.568334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.568348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.394 [2024-04-26 20:47:21.568358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.394 [2024-04-26 20:47:21.568500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.394 [2024-04-26 20:47:21.568705] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.394 [2024-04-26 20:47:21.568715] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.394 [2024-04-26 20:47:21.568722] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.394 [2024-04-26 20:47:21.570952] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.394 [2024-04-26 20:47:21.579637] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.394 [2024-04-26 20:47:21.580220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.580672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.580684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.394 [2024-04-26 20:47:21.580691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.394 [2024-04-26 20:47:21.580798] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.394 [2024-04-26 20:47:21.580922] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.394 [2024-04-26 20:47:21.580931] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.394 [2024-04-26 20:47:21.580938] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.394 [2024-04-26 20:47:21.583155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.394 [2024-04-26 20:47:21.592014] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.394 [2024-04-26 20:47:21.592728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.593203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.593217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.394 [2024-04-26 20:47:21.593227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.394 [2024-04-26 20:47:21.593379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.394 [2024-04-26 20:47:21.593563] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.394 [2024-04-26 20:47:21.593572] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.394 [2024-04-26 20:47:21.593580] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.394 [2024-04-26 20:47:21.595800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.394 [2024-04-26 20:47:21.604472] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.394 [2024-04-26 20:47:21.604995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.605603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.605642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.394 [2024-04-26 20:47:21.605652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.394 [2024-04-26 20:47:21.605832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.394 [2024-04-26 20:47:21.605978] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.394 [2024-04-26 20:47:21.605992] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.394 [2024-04-26 20:47:21.605999] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.394 [2024-04-26 20:47:21.608119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.394 [2024-04-26 20:47:21.616975] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.394 [2024-04-26 20:47:21.617605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.618099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.618112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.394 [2024-04-26 20:47:21.618122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.394 [2024-04-26 20:47:21.618327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.394 [2024-04-26 20:47:21.618492] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.394 [2024-04-26 20:47:21.618502] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.394 [2024-04-26 20:47:21.618509] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.394 [2024-04-26 20:47:21.620768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.394 [2024-04-26 20:47:21.629681] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.394 [2024-04-26 20:47:21.630282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.630782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.630820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.394 [2024-04-26 20:47:21.630830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.394 [2024-04-26 20:47:21.630955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.394 [2024-04-26 20:47:21.631065] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.394 [2024-04-26 20:47:21.631074] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.394 [2024-04-26 20:47:21.631081] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.394 [2024-04-26 20:47:21.633467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.394 [2024-04-26 20:47:21.642151] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.394 [2024-04-26 20:47:21.642731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.643205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.643218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.394 [2024-04-26 20:47:21.643227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.394 [2024-04-26 20:47:21.643380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.394 [2024-04-26 20:47:21.643563] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.394 [2024-04-26 20:47:21.643572] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.394 [2024-04-26 20:47:21.643584] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.394 [2024-04-26 20:47:21.645861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.394 [2024-04-26 20:47:21.654516] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.394 [2024-04-26 20:47:21.655219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.655827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.655864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.394 [2024-04-26 20:47:21.655875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.394 [2024-04-26 20:47:21.656055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.394 [2024-04-26 20:47:21.656220] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.394 [2024-04-26 20:47:21.656229] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.394 [2024-04-26 20:47:21.656237] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.394 [2024-04-26 20:47:21.658594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.394 [2024-04-26 20:47:21.667033] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.394 [2024-04-26 20:47:21.667726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.394 [2024-04-26 20:47:21.668114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.395 [2024-04-26 20:47:21.668128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.395 [2024-04-26 20:47:21.668137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.395 [2024-04-26 20:47:21.668347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.395 [2024-04-26 20:47:21.668439] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.395 [2024-04-26 20:47:21.668447] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.395 [2024-04-26 20:47:21.668454] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.395 [2024-04-26 20:47:21.670568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.395 [2024-04-26 20:47:21.679610] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.395 [2024-04-26 20:47:21.680315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.395 [2024-04-26 20:47:21.680791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.395 [2024-04-26 20:47:21.680804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.395 [2024-04-26 20:47:21.680814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.395 [2024-04-26 20:47:21.680975] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.395 [2024-04-26 20:47:21.681121] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.395 [2024-04-26 20:47:21.681130] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.395 [2024-04-26 20:47:21.681138] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.395 [2024-04-26 20:47:21.683394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.395 [2024-04-26 20:47:21.692149] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.395 [2024-04-26 20:47:21.692914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.395 [2024-04-26 20:47:21.693537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.395 [2024-04-26 20:47:21.693575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.395 [2024-04-26 20:47:21.693585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.395 [2024-04-26 20:47:21.693728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.395 [2024-04-26 20:47:21.693893] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.395 [2024-04-26 20:47:21.693902] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.395 [2024-04-26 20:47:21.693910] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.395 [2024-04-26 20:47:21.696120] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.395 [2024-04-26 20:47:21.704668] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.395 [2024-04-26 20:47:21.705320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.395 [2024-04-26 20:47:21.705685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.395 [2024-04-26 20:47:21.705696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.395 [2024-04-26 20:47:21.705704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.395 [2024-04-26 20:47:21.705815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.395 [2024-04-26 20:47:21.705940] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.395 [2024-04-26 20:47:21.705948] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.395 [2024-04-26 20:47:21.705955] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.395 [2024-04-26 20:47:21.708327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.395 [2024-04-26 20:47:21.717169] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.395 [2024-04-26 20:47:21.717812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.395 [2024-04-26 20:47:21.718329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.395 [2024-04-26 20:47:21.718344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.395 [2024-04-26 20:47:21.718353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.395 [2024-04-26 20:47:21.718551] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.395 [2024-04-26 20:47:21.718679] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.395 [2024-04-26 20:47:21.718688] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.395 [2024-04-26 20:47:21.718695] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.395 [2024-04-26 20:47:21.721064] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.395 [2024-04-26 20:47:21.729785] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.395 [2024-04-26 20:47:21.730441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.395 [2024-04-26 20:47:21.730625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.395 [2024-04-26 20:47:21.730636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.395 [2024-04-26 20:47:21.730644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.395 [2024-04-26 20:47:21.730750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.395 [2024-04-26 20:47:21.730893] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.395 [2024-04-26 20:47:21.730902] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.395 [2024-04-26 20:47:21.730909] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.395 [2024-04-26 20:47:21.733283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.658 [2024-04-26 20:47:21.742173] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.658 [2024-04-26 20:47:21.742855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.658 [2024-04-26 20:47:21.743363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.658 [2024-04-26 20:47:21.743377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.658 [2024-04-26 20:47:21.743387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.658 [2024-04-26 20:47:21.743530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.658 [2024-04-26 20:47:21.743657] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.658 [2024-04-26 20:47:21.743666] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.658 [2024-04-26 20:47:21.743674] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.658 [2024-04-26 20:47:21.746061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.658 [2024-04-26 20:47:21.754680] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.658 [2024-04-26 20:47:21.755443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.658 [2024-04-26 20:47:21.755971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.658 [2024-04-26 20:47:21.755984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.658 [2024-04-26 20:47:21.755993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.658 [2024-04-26 20:47:21.756136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.658 [2024-04-26 20:47:21.756227] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.658 [2024-04-26 20:47:21.756236] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.658 [2024-04-26 20:47:21.756244] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.658 [2024-04-26 20:47:21.758548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.658 [2024-04-26 20:47:21.766987] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.658 [2024-04-26 20:47:21.767637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.658 [2024-04-26 20:47:21.768147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.658 [2024-04-26 20:47:21.768160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.658 [2024-04-26 20:47:21.768170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.659 [2024-04-26 20:47:21.768359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.659 [2024-04-26 20:47:21.768505] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.659 [2024-04-26 20:47:21.768515] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.659 [2024-04-26 20:47:21.768522] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.659 [2024-04-26 20:47:21.770725] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.659 [2024-04-26 20:47:21.779398] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.659 [2024-04-26 20:47:21.780152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.780637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.780652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.659 [2024-04-26 20:47:21.780661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.659 [2024-04-26 20:47:21.780786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.659 [2024-04-26 20:47:21.780877] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.659 [2024-04-26 20:47:21.780885] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.659 [2024-04-26 20:47:21.780893] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.659 [2024-04-26 20:47:21.783100] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.659 [2024-04-26 20:47:21.791782] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.659 [2024-04-26 20:47:21.792382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.792822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.792833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.659 [2024-04-26 20:47:21.792840] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.659 [2024-04-26 20:47:21.793019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.659 [2024-04-26 20:47:21.793180] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.659 [2024-04-26 20:47:21.793189] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.659 [2024-04-26 20:47:21.793197] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.659 [2024-04-26 20:47:21.795345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.659 [2024-04-26 20:47:21.804270] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.659 [2024-04-26 20:47:21.804846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.805315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.805334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.659 [2024-04-26 20:47:21.805344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.659 [2024-04-26 20:47:21.805523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.659 [2024-04-26 20:47:21.805688] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.659 [2024-04-26 20:47:21.805696] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.659 [2024-04-26 20:47:21.805704] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.659 [2024-04-26 20:47:21.807983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.659 [2024-04-26 20:47:21.816805] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.659 [2024-04-26 20:47:21.817530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.818010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.818023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.659 [2024-04-26 20:47:21.818033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.659 [2024-04-26 20:47:21.818194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.659 [2024-04-26 20:47:21.818367] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.659 [2024-04-26 20:47:21.818376] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.659 [2024-04-26 20:47:21.818384] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.659 [2024-04-26 20:47:21.820605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.659 [2024-04-26 20:47:21.829432] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.659 [2024-04-26 20:47:21.830172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.830709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.830724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.659 [2024-04-26 20:47:21.830733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.659 [2024-04-26 20:47:21.830875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.659 [2024-04-26 20:47:21.831003] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.659 [2024-04-26 20:47:21.831012] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.659 [2024-04-26 20:47:21.831020] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.659 [2024-04-26 20:47:21.833400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.659 [2024-04-26 20:47:21.841949] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.659 [2024-04-26 20:47:21.842560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.843002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.843013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.659 [2024-04-26 20:47:21.843025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.659 [2024-04-26 20:47:21.843187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.659 [2024-04-26 20:47:21.843354] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.659 [2024-04-26 20:47:21.843363] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.659 [2024-04-26 20:47:21.843370] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.659 [2024-04-26 20:47:21.845550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.659 [2024-04-26 20:47:21.854464] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.659 [2024-04-26 20:47:21.855056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.855572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.855587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.659 [2024-04-26 20:47:21.855596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.659 [2024-04-26 20:47:21.855739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.659 [2024-04-26 20:47:21.855904] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.659 [2024-04-26 20:47:21.855912] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.659 [2024-04-26 20:47:21.855920] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.659 [2024-04-26 20:47:21.858130] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.659 [2024-04-26 20:47:21.867149] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.659 [2024-04-26 20:47:21.867769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.868123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.868134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.659 [2024-04-26 20:47:21.868142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.659 [2024-04-26 20:47:21.868328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.659 [2024-04-26 20:47:21.868453] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.659 [2024-04-26 20:47:21.868463] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.659 [2024-04-26 20:47:21.868470] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.659 [2024-04-26 20:47:21.870779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.659 [2024-04-26 20:47:21.879685] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.659 [2024-04-26 20:47:21.880328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.880648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.659 [2024-04-26 20:47:21.880658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.659 [2024-04-26 20:47:21.880666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.659 [2024-04-26 20:47:21.880836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.659 [2024-04-26 20:47:21.880998] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.659 [2024-04-26 20:47:21.881006] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.659 [2024-04-26 20:47:21.881013] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.660 [2024-04-26 20:47:21.883286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.660 [2024-04-26 20:47:21.892023] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.660 [2024-04-26 20:47:21.892745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.893221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.893234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.660 [2024-04-26 20:47:21.893244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.660 [2024-04-26 20:47:21.893451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.660 [2024-04-26 20:47:21.893635] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.660 [2024-04-26 20:47:21.893646] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.660 [2024-04-26 20:47:21.893653] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.660 [2024-04-26 20:47:21.895839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.660 [2024-04-26 20:47:21.904513] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.660 [2024-04-26 20:47:21.905214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.905711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.905726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.660 [2024-04-26 20:47:21.905735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.660 [2024-04-26 20:47:21.905859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.660 [2024-04-26 20:47:21.906024] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.660 [2024-04-26 20:47:21.906033] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.660 [2024-04-26 20:47:21.906040] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.660 [2024-04-26 20:47:21.908376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.660 [2024-04-26 20:47:21.917056] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.660 [2024-04-26 20:47:21.917601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.917970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.917981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.660 [2024-04-26 20:47:21.917989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.660 [2024-04-26 20:47:21.918167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.660 [2024-04-26 20:47:21.918303] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.660 [2024-04-26 20:47:21.918313] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.660 [2024-04-26 20:47:21.918320] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.660 [2024-04-26 20:47:21.920571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.660 [2024-04-26 20:47:21.929391] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.660 [2024-04-26 20:47:21.929946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.930461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.930476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.660 [2024-04-26 20:47:21.930485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.660 [2024-04-26 20:47:21.930665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.660 [2024-04-26 20:47:21.930847] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.660 [2024-04-26 20:47:21.930856] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.660 [2024-04-26 20:47:21.930864] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.660 [2024-04-26 20:47:21.933259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.660 [2024-04-26 20:47:21.941863] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.660 [2024-04-26 20:47:21.942604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.943072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.943085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.660 [2024-04-26 20:47:21.943094] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.660 [2024-04-26 20:47:21.943300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.660 [2024-04-26 20:47:21.943429] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.660 [2024-04-26 20:47:21.943438] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.660 [2024-04-26 20:47:21.943445] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.660 [2024-04-26 20:47:21.945756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.660 [2024-04-26 20:47:21.954325] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.660 [2024-04-26 20:47:21.955027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.955545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.955559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.660 [2024-04-26 20:47:21.955569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.660 [2024-04-26 20:47:21.955730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.660 [2024-04-26 20:47:21.955876] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.660 [2024-04-26 20:47:21.955889] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.660 [2024-04-26 20:47:21.955896] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.660 [2024-04-26 20:47:21.958086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.660 [2024-04-26 20:47:21.966747] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.660 [2024-04-26 20:47:21.967468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.967949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.967962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.660 [2024-04-26 20:47:21.967971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.660 [2024-04-26 20:47:21.968096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.660 [2024-04-26 20:47:21.968260] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.660 [2024-04-26 20:47:21.968269] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.660 [2024-04-26 20:47:21.968286] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.660 [2024-04-26 20:47:21.970598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.660 [2024-04-26 20:47:21.979189] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.660 [2024-04-26 20:47:21.979838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.980301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.980315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.660 [2024-04-26 20:47:21.980324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.660 [2024-04-26 20:47:21.980431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.660 [2024-04-26 20:47:21.980558] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.660 [2024-04-26 20:47:21.980567] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.660 [2024-04-26 20:47:21.980574] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.660 [2024-04-26 20:47:21.982762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.660 [2024-04-26 20:47:21.991638] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.660 [2024-04-26 20:47:21.992226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.992671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.660 [2024-04-26 20:47:21.992683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.660 [2024-04-26 20:47:21.992691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.661 [2024-04-26 20:47:21.992852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.661 [2024-04-26 20:47:21.992976] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.661 [2024-04-26 20:47:21.992985] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.661 [2024-04-26 20:47:21.992996] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.661 [2024-04-26 20:47:21.995252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.925 [2024-04-26 20:47:22.004036] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.925 [2024-04-26 20:47:22.004689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.005199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.005212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.925 [2024-04-26 20:47:22.005222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.925 [2024-04-26 20:47:22.005428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.925 [2024-04-26 20:47:22.005593] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.925 [2024-04-26 20:47:22.005602] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.925 [2024-04-26 20:47:22.005609] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.925 [2024-04-26 20:47:22.007925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.925 [2024-04-26 20:47:22.016586] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.925 [2024-04-26 20:47:22.017113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.017503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.017518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.925 [2024-04-26 20:47:22.017527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.925 [2024-04-26 20:47:22.017724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.925 [2024-04-26 20:47:22.017834] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.925 [2024-04-26 20:47:22.017843] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.925 [2024-04-26 20:47:22.017850] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.925 [2024-04-26 20:47:22.020074] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.925 [2024-04-26 20:47:22.029053] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.925 [2024-04-26 20:47:22.029670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.030153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.030164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.925 [2024-04-26 20:47:22.030172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.925 [2024-04-26 20:47:22.030320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.925 [2024-04-26 20:47:22.030464] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.925 [2024-04-26 20:47:22.030473] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.925 [2024-04-26 20:47:22.030481] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.925 [2024-04-26 20:47:22.032634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.925 [2024-04-26 20:47:22.041513] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.925 [2024-04-26 20:47:22.042150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.042625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.042636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.925 [2024-04-26 20:47:22.042643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.925 [2024-04-26 20:47:22.042822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.925 [2024-04-26 20:47:22.043001] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.925 [2024-04-26 20:47:22.043010] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.925 [2024-04-26 20:47:22.043016] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.925 [2024-04-26 20:47:22.045343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.925 [2024-04-26 20:47:22.053834] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.925 [2024-04-26 20:47:22.054524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.055043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.055057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.925 [2024-04-26 20:47:22.055066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.925 [2024-04-26 20:47:22.055246] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.925 [2024-04-26 20:47:22.055417] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.925 [2024-04-26 20:47:22.055428] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.925 [2024-04-26 20:47:22.055435] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.925 [2024-04-26 20:47:22.057673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.925 [2024-04-26 20:47:22.066423] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.925 [2024-04-26 20:47:22.067186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.067667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.067683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.925 [2024-04-26 20:47:22.067693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.925 [2024-04-26 20:47:22.067853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.925 [2024-04-26 20:47:22.067981] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.925 [2024-04-26 20:47:22.067990] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.925 [2024-04-26 20:47:22.067998] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.925 [2024-04-26 20:47:22.070314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.925 [2024-04-26 20:47:22.078906] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.925 [2024-04-26 20:47:22.079449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.079757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.079768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.925 [2024-04-26 20:47:22.079776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.925 [2024-04-26 20:47:22.079919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.925 [2024-04-26 20:47:22.080098] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.925 [2024-04-26 20:47:22.080107] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.925 [2024-04-26 20:47:22.080113] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.925 [2024-04-26 20:47:22.082426] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.925 [2024-04-26 20:47:22.091552] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.925 [2024-04-26 20:47:22.092232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.092771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.092786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.925 [2024-04-26 20:47:22.092795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.925 [2024-04-26 20:47:22.093011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.925 [2024-04-26 20:47:22.093175] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.925 [2024-04-26 20:47:22.093186] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.925 [2024-04-26 20:47:22.093194] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.925 [2024-04-26 20:47:22.095387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.925 [2024-04-26 20:47:22.104043] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.925 [2024-04-26 20:47:22.104725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.105237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.105250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.925 [2024-04-26 20:47:22.105260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.925 [2024-04-26 20:47:22.105451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.925 [2024-04-26 20:47:22.105581] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.925 [2024-04-26 20:47:22.105590] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.925 [2024-04-26 20:47:22.105597] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.925 [2024-04-26 20:47:22.107840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.925 [2024-04-26 20:47:22.116476] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.925 [2024-04-26 20:47:22.117143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.925 [2024-04-26 20:47:22.117520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.117534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.926 [2024-04-26 20:47:22.117544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.926 [2024-04-26 20:47:22.117741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.926 [2024-04-26 20:47:22.117869] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.926 [2024-04-26 20:47:22.117878] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.926 [2024-04-26 20:47:22.117886] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.926 [2024-04-26 20:47:22.120293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.926 [2024-04-26 20:47:22.128767] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.926 [2024-04-26 20:47:22.129395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.129858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.129868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.926 [2024-04-26 20:47:22.129876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.926 [2024-04-26 20:47:22.130037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.926 [2024-04-26 20:47:22.130216] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.926 [2024-04-26 20:47:22.130225] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.926 [2024-04-26 20:47:22.130232] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.926 [2024-04-26 20:47:22.132596] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.926 [2024-04-26 20:47:22.141097] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.926 [2024-04-26 20:47:22.141732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.142225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.142235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.926 [2024-04-26 20:47:22.142243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.926 [2024-04-26 20:47:22.142353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.926 [2024-04-26 20:47:22.142532] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.926 [2024-04-26 20:47:22.142541] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.926 [2024-04-26 20:47:22.142548] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.926 [2024-04-26 20:47:22.144747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.926 [2024-04-26 20:47:22.153458] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.926 [2024-04-26 20:47:22.154129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.154635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.154651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.926 [2024-04-26 20:47:22.154665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.926 [2024-04-26 20:47:22.154826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.926 [2024-04-26 20:47:22.154991] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.926 [2024-04-26 20:47:22.155000] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.926 [2024-04-26 20:47:22.155008] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.926 [2024-04-26 20:47:22.157343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.926 [2024-04-26 20:47:22.166110] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.926 [2024-04-26 20:47:22.166837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.167340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.167355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.926 [2024-04-26 20:47:22.167365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.926 [2024-04-26 20:47:22.167562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.926 [2024-04-26 20:47:22.167745] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.926 [2024-04-26 20:47:22.167754] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.926 [2024-04-26 20:47:22.167761] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.926 [2024-04-26 20:47:22.170058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.926 [2024-04-26 20:47:22.178593] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.926 [2024-04-26 20:47:22.179157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.179646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.179658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.926 [2024-04-26 20:47:22.179665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.926 [2024-04-26 20:47:22.179826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.926 [2024-04-26 20:47:22.179951] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.926 [2024-04-26 20:47:22.179960] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.926 [2024-04-26 20:47:22.179967] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.926 [2024-04-26 20:47:22.182077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.926 [2024-04-26 20:47:22.191210] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.926 [2024-04-26 20:47:22.191909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.192458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.192473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.926 [2024-04-26 20:47:22.192482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.926 [2024-04-26 20:47:22.192666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.926 [2024-04-26 20:47:22.192776] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.926 [2024-04-26 20:47:22.192785] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.926 [2024-04-26 20:47:22.192792] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.926 [2024-04-26 20:47:22.194857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.926 [2024-04-26 20:47:22.203637] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.926 [2024-04-26 20:47:22.204355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.204822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.204836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.926 [2024-04-26 20:47:22.204845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.926 [2024-04-26 20:47:22.204988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.926 [2024-04-26 20:47:22.205134] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.926 [2024-04-26 20:47:22.205143] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.926 [2024-04-26 20:47:22.205150] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.926 [2024-04-26 20:47:22.207378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.926 [2024-04-26 20:47:22.215938] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.926 [2024-04-26 20:47:22.216669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.217133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.217147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.926 [2024-04-26 20:47:22.217157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.926 [2024-04-26 20:47:22.217309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.926 [2024-04-26 20:47:22.217492] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.926 [2024-04-26 20:47:22.217500] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.926 [2024-04-26 20:47:22.217508] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.926 [2024-04-26 20:47:22.219639] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.926 [2024-04-26 20:47:22.228328] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.926 [2024-04-26 20:47:22.229072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.229603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.926 [2024-04-26 20:47:22.229618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.926 [2024-04-26 20:47:22.229628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.926 [2024-04-26 20:47:22.229789] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.927 [2024-04-26 20:47:22.229958] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.927 [2024-04-26 20:47:22.229968] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.927 [2024-04-26 20:47:22.229975] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.927 [2024-04-26 20:47:22.232218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.927 [2024-04-26 20:47:22.240815] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.927 [2024-04-26 20:47:22.241534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.927 [2024-04-26 20:47:22.242044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.927 [2024-04-26 20:47:22.242058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.927 [2024-04-26 20:47:22.242067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.927 [2024-04-26 20:47:22.242264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.927 [2024-04-26 20:47:22.242383] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.927 [2024-04-26 20:47:22.242394] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.927 [2024-04-26 20:47:22.242401] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.927 [2024-04-26 20:47:22.244859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.927 [2024-04-26 20:47:22.253053] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:03.927 [2024-04-26 20:47:22.253745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.927 [2024-04-26 20:47:22.254227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:03.927 [2024-04-26 20:47:22.254241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:03.927 [2024-04-26 20:47:22.254250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:03.927 [2024-04-26 20:47:22.254421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:03.927 [2024-04-26 20:47:22.254623] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:03.927 [2024-04-26 20:47:22.254632] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:03.927 [2024-04-26 20:47:22.254640] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:03.927 [2024-04-26 20:47:22.256810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:03.927 [2024-04-26 20:47:22.265448] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.190 [2024-04-26 20:47:22.267382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.190 [2024-04-26 20:47:22.267889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.190 [2024-04-26 20:47:22.267903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.190 [2024-04-26 20:47:22.267913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.190 [2024-04-26 20:47:22.268075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.190 [2024-04-26 20:47:22.268184] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.190 [2024-04-26 20:47:22.268200] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.190 [2024-04-26 20:47:22.268207] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.190 [2024-04-26 20:47:22.270476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.190 [2024-04-26 20:47:22.277876] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.190 [2024-04-26 20:47:22.278573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.190 [2024-04-26 20:47:22.279085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.190 [2024-04-26 20:47:22.279098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.190 [2024-04-26 20:47:22.279108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.190 [2024-04-26 20:47:22.279233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.190 [2024-04-26 20:47:22.279368] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.190 [2024-04-26 20:47:22.279378] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.190 [2024-04-26 20:47:22.279386] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.190 [2024-04-26 20:47:22.281734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.190 [2024-04-26 20:47:22.290238] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.190 [2024-04-26 20:47:22.291274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.190 [2024-04-26 20:47:22.291743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.190 [2024-04-26 20:47:22.291754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.190 [2024-04-26 20:47:22.291763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.190 [2024-04-26 20:47:22.291911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.190 [2024-04-26 20:47:22.292037] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.190 [2024-04-26 20:47:22.292046] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.190 [2024-04-26 20:47:22.292054] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.190 [2024-04-26 20:47:22.294299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.190 [2024-04-26 20:47:22.302590] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.190 [2024-04-26 20:47:22.303329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.190 [2024-04-26 20:47:22.303813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.190 [2024-04-26 20:47:22.303827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.191 [2024-04-26 20:47:22.303836] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.191 [2024-04-26 20:47:22.304034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.191 [2024-04-26 20:47:22.304235] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.191 [2024-04-26 20:47:22.304244] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.191 [2024-04-26 20:47:22.304256] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.191 [2024-04-26 20:47:22.306501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.191 [2024-04-26 20:47:22.315143] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.191 [2024-04-26 20:47:22.315801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.316317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.316333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.191 [2024-04-26 20:47:22.316342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.191 [2024-04-26 20:47:22.316503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.191 [2024-04-26 20:47:22.316668] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.191 [2024-04-26 20:47:22.316677] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.191 [2024-04-26 20:47:22.316685] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.191 [2024-04-26 20:47:22.319002] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.191 [2024-04-26 20:47:22.327567] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.191 [2024-04-26 20:47:22.328195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.329394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.329415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.191 [2024-04-26 20:47:22.329424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.191 [2024-04-26 20:47:22.329592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.191 [2024-04-26 20:47:22.329718] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.191 [2024-04-26 20:47:22.329727] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.191 [2024-04-26 20:47:22.329734] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.191 [2024-04-26 20:47:22.331811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.191 [2024-04-26 20:47:22.340064] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.191 [2024-04-26 20:47:22.340770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.341168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.341181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.191 [2024-04-26 20:47:22.341191] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.191 [2024-04-26 20:47:22.341396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.191 [2024-04-26 20:47:22.341525] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.191 [2024-04-26 20:47:22.341534] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.191 [2024-04-26 20:47:22.341541] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.191 [2024-04-26 20:47:22.343839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.191 [2024-04-26 20:47:22.352346] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.191 [2024-04-26 20:47:22.353093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.353584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.353599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.191 [2024-04-26 20:47:22.353609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.191 [2024-04-26 20:47:22.353752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.191 [2024-04-26 20:47:22.353898] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.191 [2024-04-26 20:47:22.353907] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.191 [2024-04-26 20:47:22.353914] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.191 [2024-04-26 20:47:22.356341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.191 [2024-04-26 20:47:22.364685] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.191 [2024-04-26 20:47:22.365318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.365792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.365803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.191 [2024-04-26 20:47:22.365810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.191 [2024-04-26 20:47:22.365971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.191 [2024-04-26 20:47:22.366132] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.191 [2024-04-26 20:47:22.366141] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.191 [2024-04-26 20:47:22.366148] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.191 [2024-04-26 20:47:22.368293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.191 [2024-04-26 20:47:22.377071] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.191 [2024-04-26 20:47:22.377664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.378152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.378162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.191 [2024-04-26 20:47:22.378170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.191 [2024-04-26 20:47:22.378316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.191 [2024-04-26 20:47:22.378477] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.191 [2024-04-26 20:47:22.378486] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.191 [2024-04-26 20:47:22.378492] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.191 [2024-04-26 20:47:22.380781] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.191 [2024-04-26 20:47:22.389458] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.191 [2024-04-26 20:47:22.390233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.390706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.390718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.191 [2024-04-26 20:47:22.390728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.191 [2024-04-26 20:47:22.390912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.191 [2024-04-26 20:47:22.391075] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.191 [2024-04-26 20:47:22.391084] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.191 [2024-04-26 20:47:22.391091] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.191 [2024-04-26 20:47:22.393316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.191 [2024-04-26 20:47:22.401903] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.191 [2024-04-26 20:47:22.402574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.403092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.403106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.191 [2024-04-26 20:47:22.403115] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.191 [2024-04-26 20:47:22.403283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.191 [2024-04-26 20:47:22.403430] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.191 [2024-04-26 20:47:22.403439] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.191 [2024-04-26 20:47:22.403447] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.191 [2024-04-26 20:47:22.405793] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.191 [2024-04-26 20:47:22.414336] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.191 [2024-04-26 20:47:22.414956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.415444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.191 [2024-04-26 20:47:22.415455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.191 [2024-04-26 20:47:22.415463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.191 [2024-04-26 20:47:22.415552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.191 [2024-04-26 20:47:22.415694] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.191 [2024-04-26 20:47:22.415703] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.191 [2024-04-26 20:47:22.415710] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.192 [2024-04-26 20:47:22.417854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.192 [2024-04-26 20:47:22.426668] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.192 [2024-04-26 20:47:22.427266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.427703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.427714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.192 [2024-04-26 20:47:22.427722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.192 [2024-04-26 20:47:22.427883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.192 [2024-04-26 20:47:22.428026] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.192 [2024-04-26 20:47:22.428035] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.192 [2024-04-26 20:47:22.428042] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.192 [2024-04-26 20:47:22.430298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.192 [2024-04-26 20:47:22.439252] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.192 [2024-04-26 20:47:22.439936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.440432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.440448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.192 [2024-04-26 20:47:22.440458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.192 [2024-04-26 20:47:22.440637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.192 [2024-04-26 20:47:22.440802] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.192 [2024-04-26 20:47:22.440811] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.192 [2024-04-26 20:47:22.440819] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.192 [2024-04-26 20:47:22.443173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.192 [2024-04-26 20:47:22.451653] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.192 [2024-04-26 20:47:22.452221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.452467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.452480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.192 [2024-04-26 20:47:22.452488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.192 [2024-04-26 20:47:22.452686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.192 [2024-04-26 20:47:22.452848] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.192 [2024-04-26 20:47:22.452858] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.192 [2024-04-26 20:47:22.452865] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.192 [2024-04-26 20:47:22.455355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.192 [2024-04-26 20:47:22.464251] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.192 [2024-04-26 20:47:22.464960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.465799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.465827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.192 [2024-04-26 20:47:22.465838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.192 [2024-04-26 20:47:22.465981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.192 [2024-04-26 20:47:22.466110] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.192 [2024-04-26 20:47:22.466119] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.192 [2024-04-26 20:47:22.466127] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.192 [2024-04-26 20:47:22.468190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.192 [2024-04-26 20:47:22.476705] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.192 [2024-04-26 20:47:22.477356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.477811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.477822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.192 [2024-04-26 20:47:22.477830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.192 [2024-04-26 20:47:22.477991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.192 [2024-04-26 20:47:22.478188] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.192 [2024-04-26 20:47:22.478196] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.192 [2024-04-26 20:47:22.478204] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.192 [2024-04-26 20:47:22.480314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.192 [2024-04-26 20:47:22.489224] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.192 [2024-04-26 20:47:22.489833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.490360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.490380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.192 [2024-04-26 20:47:22.490387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.192 [2024-04-26 20:47:22.490584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.192 [2024-04-26 20:47:22.490745] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.192 [2024-04-26 20:47:22.490754] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.192 [2024-04-26 20:47:22.490761] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.192 [2024-04-26 20:47:22.493032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.192 [2024-04-26 20:47:22.501740] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.192 [2024-04-26 20:47:22.502310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.502766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.502776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.192 [2024-04-26 20:47:22.502787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.192 [2024-04-26 20:47:22.502893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.192 [2024-04-26 20:47:22.503054] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.192 [2024-04-26 20:47:22.503062] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.192 [2024-04-26 20:47:22.503069] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.192 [2024-04-26 20:47:22.505342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.192 [2024-04-26 20:47:22.514144] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.192 [2024-04-26 20:47:22.514779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.515263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.515274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.192 [2024-04-26 20:47:22.515287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.192 [2024-04-26 20:47:22.515411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.192 [2024-04-26 20:47:22.515535] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.192 [2024-04-26 20:47:22.515543] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.192 [2024-04-26 20:47:22.515550] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.192 [2024-04-26 20:47:22.518018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.192 [2024-04-26 20:47:22.526658] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.192 [2024-04-26 20:47:22.527826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.528316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.192 [2024-04-26 20:47:22.528331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.192 [2024-04-26 20:47:22.528341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.192 [2024-04-26 20:47:22.528503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.192 [2024-04-26 20:47:22.528668] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.192 [2024-04-26 20:47:22.528676] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.192 [2024-04-26 20:47:22.528684] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.192 [2024-04-26 20:47:22.531109] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.456 [2024-04-26 20:47:22.539061] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.456 [2024-04-26 20:47:22.539691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.540178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.540190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.456 [2024-04-26 20:47:22.540198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.456 [2024-04-26 20:47:22.540350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.456 [2024-04-26 20:47:22.540475] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.456 [2024-04-26 20:47:22.540484] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.456 [2024-04-26 20:47:22.540491] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.456 [2024-04-26 20:47:22.542852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.456 [2024-04-26 20:47:22.551424] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.456 [2024-04-26 20:47:22.552005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.552530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.552568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.456 [2024-04-26 20:47:22.552578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.456 [2024-04-26 20:47:22.552740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.456 [2024-04-26 20:47:22.552868] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.456 [2024-04-26 20:47:22.552878] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.456 [2024-04-26 20:47:22.552885] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.456 [2024-04-26 20:47:22.555131] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.456 [2024-04-26 20:47:22.563761] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.456 [2024-04-26 20:47:22.564242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.564591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.564603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.456 [2024-04-26 20:47:22.564611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.456 [2024-04-26 20:47:22.564754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.456 [2024-04-26 20:47:22.564842] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.456 [2024-04-26 20:47:22.564851] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.456 [2024-04-26 20:47:22.564857] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.456 [2024-04-26 20:47:22.567004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.456 [2024-04-26 20:47:22.576186] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.456 [2024-04-26 20:47:22.576732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.577092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.577103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.456 [2024-04-26 20:47:22.577111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.456 [2024-04-26 20:47:22.577217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.456 [2024-04-26 20:47:22.577368] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.456 [2024-04-26 20:47:22.577378] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.456 [2024-04-26 20:47:22.577386] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.456 [2024-04-26 20:47:22.579854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.456 [2024-04-26 20:47:22.588566] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.456 [2024-04-26 20:47:22.589169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.589518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.589529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.456 [2024-04-26 20:47:22.589536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.456 [2024-04-26 20:47:22.589642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.456 [2024-04-26 20:47:22.589802] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.456 [2024-04-26 20:47:22.589811] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.456 [2024-04-26 20:47:22.589818] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.456 [2024-04-26 20:47:22.592251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.456 [2024-04-26 20:47:22.601014] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.456 [2024-04-26 20:47:22.601710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.602069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.602083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.456 [2024-04-26 20:47:22.602092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.456 [2024-04-26 20:47:22.602235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.456 [2024-04-26 20:47:22.602334] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.456 [2024-04-26 20:47:22.602344] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.456 [2024-04-26 20:47:22.602352] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.456 [2024-04-26 20:47:22.604681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.456 [2024-04-26 20:47:22.613414] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.456 [2024-04-26 20:47:22.614073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.614646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.614685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.456 [2024-04-26 20:47:22.614695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.456 [2024-04-26 20:47:22.614820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.456 [2024-04-26 20:47:22.615003] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.456 [2024-04-26 20:47:22.615017] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.456 [2024-04-26 20:47:22.615025] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.456 [2024-04-26 20:47:22.617035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.456 [2024-04-26 20:47:22.625951] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.456 [2024-04-26 20:47:22.626547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.626839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.626850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.456 [2024-04-26 20:47:22.626858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.456 [2024-04-26 20:47:22.626982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.456 [2024-04-26 20:47:22.627125] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.456 [2024-04-26 20:47:22.627133] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.456 [2024-04-26 20:47:22.627141] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.456 [2024-04-26 20:47:22.629437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.456 [2024-04-26 20:47:22.638612] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.456 [2024-04-26 20:47:22.639195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.639724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.456 [2024-04-26 20:47:22.639735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.456 [2024-04-26 20:47:22.639743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.457 [2024-04-26 20:47:22.639902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.457 [2024-04-26 20:47:22.640099] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.457 [2024-04-26 20:47:22.640107] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.457 [2024-04-26 20:47:22.640114] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.457 [2024-04-26 20:47:22.642408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.457 [2024-04-26 20:47:22.651049] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.457 [2024-04-26 20:47:22.651797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.652205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.652220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.457 [2024-04-26 20:47:22.652230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.457 [2024-04-26 20:47:22.652416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.457 [2024-04-26 20:47:22.652581] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.457 [2024-04-26 20:47:22.652590] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.457 [2024-04-26 20:47:22.652602] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.457 [2024-04-26 20:47:22.654843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.457 [2024-04-26 20:47:22.663604] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.457 [2024-04-26 20:47:22.664154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.664613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.664625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.457 [2024-04-26 20:47:22.664633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.457 [2024-04-26 20:47:22.664739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.457 [2024-04-26 20:47:22.664846] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.457 [2024-04-26 20:47:22.664854] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.457 [2024-04-26 20:47:22.664863] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.457 [2024-04-26 20:47:22.667169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.457 [2024-04-26 20:47:22.676206] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.457 [2024-04-26 20:47:22.676663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.677136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.677146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.457 [2024-04-26 20:47:22.677154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.457 [2024-04-26 20:47:22.677283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.457 [2024-04-26 20:47:22.677407] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.457 [2024-04-26 20:47:22.677416] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.457 [2024-04-26 20:47:22.677423] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.457 [2024-04-26 20:47:22.679674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.457 [2024-04-26 20:47:22.688790] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.457 [2024-04-26 20:47:22.689542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.690059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.690073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.457 [2024-04-26 20:47:22.690082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.457 [2024-04-26 20:47:22.690188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.457 [2024-04-26 20:47:22.690341] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.457 [2024-04-26 20:47:22.690350] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.457 [2024-04-26 20:47:22.690357] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.457 [2024-04-26 20:47:22.692730] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.457 [2024-04-26 20:47:22.701186] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.457 [2024-04-26 20:47:22.701463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.701909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.701921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.457 [2024-04-26 20:47:22.701929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.457 [2024-04-26 20:47:22.702093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.457 [2024-04-26 20:47:22.702273] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.457 [2024-04-26 20:47:22.702289] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.457 [2024-04-26 20:47:22.702296] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.457 [2024-04-26 20:47:22.704444] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.457 [2024-04-26 20:47:22.713614] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.457 [2024-04-26 20:47:22.714257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.714658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.714669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.457 [2024-04-26 20:47:22.714677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.457 [2024-04-26 20:47:22.714891] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.457 [2024-04-26 20:47:22.714961] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.457 [2024-04-26 20:47:22.714969] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.457 [2024-04-26 20:47:22.714975] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.457 [2024-04-26 20:47:22.717016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.457 [2024-04-26 20:47:22.726059] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.457 [2024-04-26 20:47:22.726561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.727030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.727040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.457 [2024-04-26 20:47:22.727047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.457 [2024-04-26 20:47:22.727171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.457 [2024-04-26 20:47:22.727318] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.457 [2024-04-26 20:47:22.727328] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.457 [2024-04-26 20:47:22.727335] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.457 [2024-04-26 20:47:22.729713] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.457 [2024-04-26 20:47:22.738427] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.457 [2024-04-26 20:47:22.739070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.739572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.739610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.457 [2024-04-26 20:47:22.739621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.457 [2024-04-26 20:47:22.739745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.457 [2024-04-26 20:47:22.739891] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.457 [2024-04-26 20:47:22.739901] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.457 [2024-04-26 20:47:22.739909] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.457 [2024-04-26 20:47:22.742081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.457 [2024-04-26 20:47:22.750977] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.457 [2024-04-26 20:47:22.751581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.752042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.457 [2024-04-26 20:47:22.752052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.457 [2024-04-26 20:47:22.752060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.457 [2024-04-26 20:47:22.752186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.457 [2024-04-26 20:47:22.752297] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.457 [2024-04-26 20:47:22.752306] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.457 [2024-04-26 20:47:22.752313] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.457 [2024-04-26 20:47:22.754602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.458 [2024-04-26 20:47:22.763687] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.458 [2024-04-26 20:47:22.764398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.458 [2024-04-26 20:47:22.764782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.458 [2024-04-26 20:47:22.764796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.458 [2024-04-26 20:47:22.764805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.458 [2024-04-26 20:47:22.765022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.458 [2024-04-26 20:47:22.765204] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.458 [2024-04-26 20:47:22.765214] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.458 [2024-04-26 20:47:22.765221] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.458 [2024-04-26 20:47:22.767451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.458 [2024-04-26 20:47:22.776216] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.458 [2024-04-26 20:47:22.776895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.458 [2024-04-26 20:47:22.777436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.458 [2024-04-26 20:47:22.777452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.458 [2024-04-26 20:47:22.777461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.458 [2024-04-26 20:47:22.777641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.458 [2024-04-26 20:47:22.777787] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.458 [2024-04-26 20:47:22.777796] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.458 [2024-04-26 20:47:22.777804] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.458 [2024-04-26 20:47:22.780121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.458 [2024-04-26 20:47:22.788767] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.458 [2024-04-26 20:47:22.789516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.458 [2024-04-26 20:47:22.790003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.458 [2024-04-26 20:47:22.790016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.458 [2024-04-26 20:47:22.790026] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.458 [2024-04-26 20:47:22.790187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.458 [2024-04-26 20:47:22.790357] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.458 [2024-04-26 20:47:22.790367] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.458 [2024-04-26 20:47:22.790374] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.458 [2024-04-26 20:47:22.792692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.721 [2024-04-26 20:47:22.801367] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.721 [2024-04-26 20:47:22.801986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.721 [2024-04-26 20:47:22.802498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.721 [2024-04-26 20:47:22.802544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.721 [2024-04-26 20:47:22.802554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.721 [2024-04-26 20:47:22.802715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.721 [2024-04-26 20:47:22.802880] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.721 [2024-04-26 20:47:22.802890] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.721 [2024-04-26 20:47:22.802897] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.721 [2024-04-26 20:47:22.805196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.721 [2024-04-26 20:47:22.813754] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.721 [2024-04-26 20:47:22.814508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.721 [2024-04-26 20:47:22.815373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.721 [2024-04-26 20:47:22.815401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.721 [2024-04-26 20:47:22.815411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.721 [2024-04-26 20:47:22.815554] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.721 [2024-04-26 20:47:22.815700] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.721 [2024-04-26 20:47:22.815709] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.721 [2024-04-26 20:47:22.815717] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.721 [2024-04-26 20:47:22.818070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.721 [2024-04-26 20:47:22.826094] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.721 [2024-04-26 20:47:22.826709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.721 [2024-04-26 20:47:22.827191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.721 [2024-04-26 20:47:22.827202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.721 [2024-04-26 20:47:22.827210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.721 [2024-04-26 20:47:22.827356] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.721 [2024-04-26 20:47:22.827500] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.721 [2024-04-26 20:47:22.827509] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.721 [2024-04-26 20:47:22.827515] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.721 [2024-04-26 20:47:22.829949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.721 [2024-04-26 20:47:22.838424] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.721 [2024-04-26 20:47:22.839055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.721 [2024-04-26 20:47:22.839590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.721 [2024-04-26 20:47:22.839629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.721 [2024-04-26 20:47:22.839640] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.721 [2024-04-26 20:47:22.839783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.721 [2024-04-26 20:47:22.839947] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.721 [2024-04-26 20:47:22.839956] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.721 [2024-04-26 20:47:22.839964] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.721 [2024-04-26 20:47:22.842210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.721 [2024-04-26 20:47:22.850669] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.721 [2024-04-26 20:47:22.851288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.721 [2024-04-26 20:47:22.851735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.721 [2024-04-26 20:47:22.851746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.721 [2024-04-26 20:47:22.851758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.721 [2024-04-26 20:47:22.851956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.721 [2024-04-26 20:47:22.852118] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.722 [2024-04-26 20:47:22.852127] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.722 [2024-04-26 20:47:22.852134] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.722 [2024-04-26 20:47:22.854302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.722 [2024-04-26 20:47:22.863015] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.722 [2024-04-26 20:47:22.863543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.864055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.864068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.722 [2024-04-26 20:47:22.864077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.722 [2024-04-26 20:47:22.864299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.722 [2024-04-26 20:47:22.864482] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.722 [2024-04-26 20:47:22.864493] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.722 [2024-04-26 20:47:22.864500] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.722 [2024-04-26 20:47:22.866759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.722 [2024-04-26 20:47:22.875602] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.722 [2024-04-26 20:47:22.876176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.876654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.876666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.722 [2024-04-26 20:47:22.876674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.722 [2024-04-26 20:47:22.876817] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.722 [2024-04-26 20:47:22.876996] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.722 [2024-04-26 20:47:22.877004] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.722 [2024-04-26 20:47:22.877011] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.722 [2024-04-26 20:47:22.879100] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.722 [2024-04-26 20:47:22.888065] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.722 [2024-04-26 20:47:22.888594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.889040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.889050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.722 [2024-04-26 20:47:22.889058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.722 [2024-04-26 20:47:22.889186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.722 [2024-04-26 20:47:22.889314] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.722 [2024-04-26 20:47:22.889324] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.722 [2024-04-26 20:47:22.889331] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.722 [2024-04-26 20:47:22.891474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.722 [2024-04-26 20:47:22.900681] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.722 [2024-04-26 20:47:22.901327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.901825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.901835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.722 [2024-04-26 20:47:22.901843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.722 [2024-04-26 20:47:22.901989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.722 [2024-04-26 20:47:22.902097] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.722 [2024-04-26 20:47:22.902105] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.722 [2024-04-26 20:47:22.902112] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.722 [2024-04-26 20:47:22.904536] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.722 [2024-04-26 20:47:22.913089] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.722 [2024-04-26 20:47:22.913643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.914053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.914063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.722 [2024-04-26 20:47:22.914071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.722 [2024-04-26 20:47:22.914158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.722 [2024-04-26 20:47:22.914304] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.722 [2024-04-26 20:47:22.914312] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.722 [2024-04-26 20:47:22.914320] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.722 [2024-04-26 20:47:22.916663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.722 [2024-04-26 20:47:22.925630] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.722 [2024-04-26 20:47:22.926351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.926819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.926831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.722 [2024-04-26 20:47:22.926841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.722 [2024-04-26 20:47:22.927002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.722 [2024-04-26 20:47:22.927147] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.722 [2024-04-26 20:47:22.927160] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.722 [2024-04-26 20:47:22.927167] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.722 [2024-04-26 20:47:22.929578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.722 [2024-04-26 20:47:22.938117] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.722 [2024-04-26 20:47:22.938766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.939257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.939270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.722 [2024-04-26 20:47:22.939285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.722 [2024-04-26 20:47:22.939429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.722 [2024-04-26 20:47:22.939611] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.722 [2024-04-26 20:47:22.939619] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.722 [2024-04-26 20:47:22.939626] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.722 [2024-04-26 20:47:22.941904] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.722 [2024-04-26 20:47:22.950668] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.722 [2024-04-26 20:47:22.951336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.951802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.951812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.722 [2024-04-26 20:47:22.951820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.722 [2024-04-26 20:47:22.951986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.722 [2024-04-26 20:47:22.952093] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.722 [2024-04-26 20:47:22.952100] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.722 [2024-04-26 20:47:22.952107] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.722 [2024-04-26 20:47:22.954273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.722 [2024-04-26 20:47:22.963085] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.722 [2024-04-26 20:47:22.963753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.964253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.722 [2024-04-26 20:47:22.964266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.722 [2024-04-26 20:47:22.964275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.722 [2024-04-26 20:47:22.964407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.722 [2024-04-26 20:47:22.964517] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.722 [2024-04-26 20:47:22.964525] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.722 [2024-04-26 20:47:22.964537] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.722 [2024-04-26 20:47:22.966668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.722 [2024-04-26 20:47:22.975597] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.723 [2024-04-26 20:47:22.976245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:22.976764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:22.976801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.723 [2024-04-26 20:47:22.976811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.723 [2024-04-26 20:47:22.976972] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.723 [2024-04-26 20:47:22.977137] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.723 [2024-04-26 20:47:22.977146] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.723 [2024-04-26 20:47:22.977153] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.723 [2024-04-26 20:47:22.979581] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.723 [2024-04-26 20:47:22.987979] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.723 [2024-04-26 20:47:22.988692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:22.989212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:22.989225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.723 [2024-04-26 20:47:22.989234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.723 [2024-04-26 20:47:22.989437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.723 [2024-04-26 20:47:22.989529] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.723 [2024-04-26 20:47:22.989537] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.723 [2024-04-26 20:47:22.989545] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.723 [2024-04-26 20:47:22.991640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.723 [2024-04-26 20:47:23.000399] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.723 [2024-04-26 20:47:23.001069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:23.001458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:23.001480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.723 [2024-04-26 20:47:23.001490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.723 [2024-04-26 20:47:23.001669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.723 [2024-04-26 20:47:23.001851] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.723 [2024-04-26 20:47:23.001860] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.723 [2024-04-26 20:47:23.001867] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.723 [2024-04-26 20:47:23.004080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.723 [2024-04-26 20:47:23.013006] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.723 [2024-04-26 20:47:23.013585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:23.013851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:23.013868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.723 [2024-04-26 20:47:23.013877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.723 [2024-04-26 20:47:23.014057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.723 [2024-04-26 20:47:23.014240] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.723 [2024-04-26 20:47:23.014248] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.723 [2024-04-26 20:47:23.014255] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.723 [2024-04-26 20:47:23.016559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.723 [2024-04-26 20:47:23.025445] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.723 [2024-04-26 20:47:23.026049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:23.026541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:23.026556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.723 [2024-04-26 20:47:23.026565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.723 [2024-04-26 20:47:23.026707] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.723 [2024-04-26 20:47:23.026816] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.723 [2024-04-26 20:47:23.026825] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.723 [2024-04-26 20:47:23.026832] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.723 [2024-04-26 20:47:23.029183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.723 [2024-04-26 20:47:23.038246] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.723 [2024-04-26 20:47:23.038870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:23.039209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:23.039219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.723 [2024-04-26 20:47:23.039226] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.723 [2024-04-26 20:47:23.039375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.723 [2024-04-26 20:47:23.039572] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.723 [2024-04-26 20:47:23.039579] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.723 [2024-04-26 20:47:23.039586] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.723 [2024-04-26 20:47:23.041855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.723 [2024-04-26 20:47:23.050696] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.723 [2024-04-26 20:47:23.051341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:23.051846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.723 [2024-04-26 20:47:23.051858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.723 [2024-04-26 20:47:23.051867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.723 [2024-04-26 20:47:23.052065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.723 [2024-04-26 20:47:23.052247] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.723 [2024-04-26 20:47:23.052255] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.723 [2024-04-26 20:47:23.052262] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.723 [2024-04-26 20:47:23.054403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.723 [2024-04-26 20:47:23.063015] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.986 [2024-04-26 20:47:23.063672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.986 [2024-04-26 20:47:23.064177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.986 [2024-04-26 20:47:23.064190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.986 [2024-04-26 20:47:23.064199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.986 [2024-04-26 20:47:23.064386] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.986 [2024-04-26 20:47:23.064514] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.986 [2024-04-26 20:47:23.064522] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.986 [2024-04-26 20:47:23.064530] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.986 [2024-04-26 20:47:23.066607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.986 [2024-04-26 20:47:23.075327] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.986 [2024-04-26 20:47:23.076026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.986 [2024-04-26 20:47:23.076625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.986 [2024-04-26 20:47:23.076662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.986 [2024-04-26 20:47:23.076672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.986 [2024-04-26 20:47:23.076815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.986 [2024-04-26 20:47:23.076979] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.986 [2024-04-26 20:47:23.076988] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.986 [2024-04-26 20:47:23.076996] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.986 [2024-04-26 20:47:23.079239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.986 [2024-04-26 20:47:23.088009] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.986 [2024-04-26 20:47:23.088598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.986 [2024-04-26 20:47:23.089097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.986 [2024-04-26 20:47:23.089109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.986 [2024-04-26 20:47:23.089118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.986 [2024-04-26 20:47:23.089304] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.986 [2024-04-26 20:47:23.089450] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.986 [2024-04-26 20:47:23.089458] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.986 [2024-04-26 20:47:23.089466] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.986 [2024-04-26 20:47:23.091631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.986 [2024-04-26 20:47:23.100467] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.986 [2024-04-26 20:47:23.101232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.986 [2024-04-26 20:47:23.101764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.986 [2024-04-26 20:47:23.101778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.986 [2024-04-26 20:47:23.101787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.986 [2024-04-26 20:47:23.101948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.986 [2024-04-26 20:47:23.102075] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.986 [2024-04-26 20:47:23.102083] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.986 [2024-04-26 20:47:23.102091] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.986 [2024-04-26 20:47:23.104282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.986 [2024-04-26 20:47:23.113055] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.986 [2024-04-26 20:47:23.113759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.986 [2024-04-26 20:47:23.114225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.986 [2024-04-26 20:47:23.114238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.986 [2024-04-26 20:47:23.114248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.986 [2024-04-26 20:47:23.114435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.987 [2024-04-26 20:47:23.114644] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.987 [2024-04-26 20:47:23.114652] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.987 [2024-04-26 20:47:23.114659] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.987 [2024-04-26 20:47:23.117045] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.987 [2024-04-26 20:47:23.125660] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.987 [2024-04-26 20:47:23.126377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.126885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.126902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.987 [2024-04-26 20:47:23.126911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.987 [2024-04-26 20:47:23.127072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.987 [2024-04-26 20:47:23.127236] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.987 [2024-04-26 20:47:23.127244] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.987 [2024-04-26 20:47:23.127252] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.987 [2024-04-26 20:47:23.129461] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.987 [2024-04-26 20:47:23.138104] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.987 [2024-04-26 20:47:23.138745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.139212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.139222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.987 [2024-04-26 20:47:23.139229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.987 [2024-04-26 20:47:23.139478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.987 [2024-04-26 20:47:23.139621] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.987 [2024-04-26 20:47:23.139629] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.987 [2024-04-26 20:47:23.139636] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.987 [2024-04-26 20:47:23.141905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.987 [2024-04-26 20:47:23.150681] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.987 [2024-04-26 20:47:23.151364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.151857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.151870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.987 [2024-04-26 20:47:23.151879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.987 [2024-04-26 20:47:23.152077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.987 [2024-04-26 20:47:23.152240] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.987 [2024-04-26 20:47:23.152248] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.987 [2024-04-26 20:47:23.152255] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.987 [2024-04-26 20:47:23.154539] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.987 [2024-04-26 20:47:23.163201] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.987 [2024-04-26 20:47:23.163919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.164411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.164425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.987 [2024-04-26 20:47:23.164438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.987 [2024-04-26 20:47:23.164563] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.987 [2024-04-26 20:47:23.164708] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.987 [2024-04-26 20:47:23.164716] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.987 [2024-04-26 20:47:23.164723] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.987 [2024-04-26 20:47:23.167182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.987 [2024-04-26 20:47:23.175853] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.987 [2024-04-26 20:47:23.176388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.176884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.176897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.987 [2024-04-26 20:47:23.176906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.987 [2024-04-26 20:47:23.177067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.987 [2024-04-26 20:47:23.177231] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.987 [2024-04-26 20:47:23.177239] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.987 [2024-04-26 20:47:23.177247] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.987 [2024-04-26 20:47:23.179656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.987 [2024-04-26 20:47:23.188342] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.987 [2024-04-26 20:47:23.189022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.189604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.189641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.987 [2024-04-26 20:47:23.189651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.987 [2024-04-26 20:47:23.189830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.987 [2024-04-26 20:47:23.189976] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.987 [2024-04-26 20:47:23.189984] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.987 [2024-04-26 20:47:23.189991] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.987 [2024-04-26 20:47:23.192269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.987 [2024-04-26 20:47:23.200872] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.987 [2024-04-26 20:47:23.201641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.202003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.202015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.987 [2024-04-26 20:47:23.202025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.987 [2024-04-26 20:47:23.202171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.987 [2024-04-26 20:47:23.202326] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.987 [2024-04-26 20:47:23.202335] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.987 [2024-04-26 20:47:23.202342] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.987 [2024-04-26 20:47:23.204691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.987 [2024-04-26 20:47:23.213248] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.987 [2024-04-26 20:47:23.213943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.214489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.214526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.987 [2024-04-26 20:47:23.214536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.987 [2024-04-26 20:47:23.214697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.987 [2024-04-26 20:47:23.214843] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.987 [2024-04-26 20:47:23.214851] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.987 [2024-04-26 20:47:23.214859] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.987 [2024-04-26 20:47:23.216939] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.987 [2024-04-26 20:47:23.225753] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.987 [2024-04-26 20:47:23.226393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.226862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.987 [2024-04-26 20:47:23.226871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.987 [2024-04-26 20:47:23.226879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.987 [2024-04-26 20:47:23.227022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.987 [2024-04-26 20:47:23.227110] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.987 [2024-04-26 20:47:23.227117] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.987 [2024-04-26 20:47:23.227123] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.987 [2024-04-26 20:47:23.229359] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.988 [2024-04-26 20:47:23.238283] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.988 [2024-04-26 20:47:23.238960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.239336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.239350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.988 [2024-04-26 20:47:23.239359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.988 [2024-04-26 20:47:23.239502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.988 [2024-04-26 20:47:23.239633] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.988 [2024-04-26 20:47:23.239641] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.988 [2024-04-26 20:47:23.239648] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.988 [2024-04-26 20:47:23.241907] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.988 [2024-04-26 20:47:23.250705] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.988 [2024-04-26 20:47:23.251332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.251811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.251824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.988 [2024-04-26 20:47:23.251833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.988 [2024-04-26 20:47:23.251975] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.988 [2024-04-26 20:47:23.252121] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.988 [2024-04-26 20:47:23.252129] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.988 [2024-04-26 20:47:23.252136] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.988 [2024-04-26 20:47:23.254437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.988 [2024-04-26 20:47:23.263226] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.988 [2024-04-26 20:47:23.263911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.264482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.264519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.988 [2024-04-26 20:47:23.264531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.988 [2024-04-26 20:47:23.264712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.988 [2024-04-26 20:47:23.264821] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.988 [2024-04-26 20:47:23.264829] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.988 [2024-04-26 20:47:23.264837] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.988 [2024-04-26 20:47:23.267153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.988 [2024-04-26 20:47:23.275549] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.988 [2024-04-26 20:47:23.276247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.276740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.276753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.988 [2024-04-26 20:47:23.276763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.988 [2024-04-26 20:47:23.276942] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.988 [2024-04-26 20:47:23.277069] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.988 [2024-04-26 20:47:23.277082] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.988 [2024-04-26 20:47:23.277089] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.988 [2024-04-26 20:47:23.279353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.988 [2024-04-26 20:47:23.288075] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.988 [2024-04-26 20:47:23.288737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.289224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.289237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.988 [2024-04-26 20:47:23.289246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.988 [2024-04-26 20:47:23.289452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.988 [2024-04-26 20:47:23.289580] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.988 [2024-04-26 20:47:23.289588] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.988 [2024-04-26 20:47:23.289595] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.988 [2024-04-26 20:47:23.291833] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.988 [2024-04-26 20:47:23.300628] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.988 [2024-04-26 20:47:23.301255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.301808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.301821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.988 [2024-04-26 20:47:23.301830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.988 [2024-04-26 20:47:23.302009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.988 [2024-04-26 20:47:23.302173] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.988 [2024-04-26 20:47:23.302181] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.988 [2024-04-26 20:47:23.302188] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.988 [2024-04-26 20:47:23.304342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.988 [2024-04-26 20:47:23.313007] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.988 [2024-04-26 20:47:23.313621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.314110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.314123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.988 [2024-04-26 20:47:23.314132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.988 [2024-04-26 20:47:23.314318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.988 [2024-04-26 20:47:23.314446] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.988 [2024-04-26 20:47:23.314454] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.988 [2024-04-26 20:47:23.314465] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:04.988 [2024-04-26 20:47:23.316742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:04.988 [2024-04-26 20:47:23.325523] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:04.988 [2024-04-26 20:47:23.326223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.326594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.988 [2024-04-26 20:47:23.326607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:04.988 [2024-04-26 20:47:23.326617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:04.988 [2024-04-26 20:47:23.326759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:04.988 [2024-04-26 20:47:23.326905] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:04.988 [2024-04-26 20:47:23.326913] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:04.988 [2024-04-26 20:47:23.326920] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.250 [2024-04-26 20:47:23.329069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.250 [2024-04-26 20:47:23.337826] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.250 [2024-04-26 20:47:23.338507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.250 [2024-04-26 20:47:23.338859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.250 [2024-04-26 20:47:23.338868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.250 [2024-04-26 20:47:23.338876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.250 [2024-04-26 20:47:23.339038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.250 [2024-04-26 20:47:23.339144] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.250 [2024-04-26 20:47:23.339151] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.250 [2024-04-26 20:47:23.339158] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.250 [2024-04-26 20:47:23.341396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.251 [2024-04-26 20:47:23.350385] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.251 [2024-04-26 20:47:23.350969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.351435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.351445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.251 [2024-04-26 20:47:23.351453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.251 [2024-04-26 20:47:23.351576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.251 [2024-04-26 20:47:23.351718] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.251 [2024-04-26 20:47:23.351725] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.251 [2024-04-26 20:47:23.351732] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.251 [2024-04-26 20:47:23.354008] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.251 [2024-04-26 20:47:23.362856] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.251 [2024-04-26 20:47:23.363469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.363799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.363808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.251 [2024-04-26 20:47:23.363815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.251 [2024-04-26 20:47:23.363993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.251 [2024-04-26 20:47:23.364153] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.251 [2024-04-26 20:47:23.364160] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.251 [2024-04-26 20:47:23.364166] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.251 [2024-04-26 20:47:23.366381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.251 [2024-04-26 20:47:23.375112] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.251 [2024-04-26 20:47:23.375700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.376063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.376073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.251 [2024-04-26 20:47:23.376080] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.251 [2024-04-26 20:47:23.376275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.251 [2024-04-26 20:47:23.376403] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.251 [2024-04-26 20:47:23.376410] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.251 [2024-04-26 20:47:23.376417] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.251 [2024-04-26 20:47:23.378632] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.251 [2024-04-26 20:47:23.387432] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.251 [2024-04-26 20:47:23.388180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.388658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.388672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.251 [2024-04-26 20:47:23.388681] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.251 [2024-04-26 20:47:23.388861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.251 [2024-04-26 20:47:23.389025] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.251 [2024-04-26 20:47:23.389033] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.251 [2024-04-26 20:47:23.389040] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.251 [2024-04-26 20:47:23.391302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.251 [2024-04-26 20:47:23.399906] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.251 [2024-04-26 20:47:23.400285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.400775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.400784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.251 [2024-04-26 20:47:23.400792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.251 [2024-04-26 20:47:23.400934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.251 [2024-04-26 20:47:23.401095] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.251 [2024-04-26 20:47:23.401102] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.251 [2024-04-26 20:47:23.401109] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.251 [2024-04-26 20:47:23.403330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.251 [2024-04-26 20:47:23.412513] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.251 [2024-04-26 20:47:23.413193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.413623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.413637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.251 [2024-04-26 20:47:23.413646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.251 [2024-04-26 20:47:23.413807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.251 [2024-04-26 20:47:23.413935] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.251 [2024-04-26 20:47:23.413943] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.251 [2024-04-26 20:47:23.413950] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.251 [2024-04-26 20:47:23.416046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.251 [2024-04-26 20:47:23.425109] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.251 [2024-04-26 20:47:23.425838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.426334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.426348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.251 [2024-04-26 20:47:23.426357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.251 [2024-04-26 20:47:23.426536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.251 [2024-04-26 20:47:23.426682] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.251 [2024-04-26 20:47:23.426689] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.251 [2024-04-26 20:47:23.426697] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.251 [2024-04-26 20:47:23.429027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.251 [2024-04-26 20:47:23.437516] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.251 [2024-04-26 20:47:23.438126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.438737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.438773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.251 [2024-04-26 20:47:23.438783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.251 [2024-04-26 20:47:23.438926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.251 [2024-04-26 20:47:23.439090] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.251 [2024-04-26 20:47:23.439098] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.251 [2024-04-26 20:47:23.439106] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.251 [2024-04-26 20:47:23.441226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.251 [2024-04-26 20:47:23.450005] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.251 [2024-04-26 20:47:23.450691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.451197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.451209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.251 [2024-04-26 20:47:23.451218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.251 [2024-04-26 20:47:23.451405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.251 [2024-04-26 20:47:23.451588] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.251 [2024-04-26 20:47:23.451596] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.251 [2024-04-26 20:47:23.451603] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.251 [2024-04-26 20:47:23.453825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.251 [2024-04-26 20:47:23.462463] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.251 [2024-04-26 20:47:23.463144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.463730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.251 [2024-04-26 20:47:23.463766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.252 [2024-04-26 20:47:23.463777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.252 [2024-04-26 20:47:23.463902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.252 [2024-04-26 20:47:23.464011] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.252 [2024-04-26 20:47:23.464019] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.252 [2024-04-26 20:47:23.464027] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.252 [2024-04-26 20:47:23.466142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.252 [2024-04-26 20:47:23.475047] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.252 [2024-04-26 20:47:23.475721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.476210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.476226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.252 [2024-04-26 20:47:23.476236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.252 [2024-04-26 20:47:23.476387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.252 [2024-04-26 20:47:23.476571] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.252 [2024-04-26 20:47:23.476578] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.252 [2024-04-26 20:47:23.476586] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.252 [2024-04-26 20:47:23.478933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.252 [2024-04-26 20:47:23.487334] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.252 [2024-04-26 20:47:23.488013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.488526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.488562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.252 [2024-04-26 20:47:23.488573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.252 [2024-04-26 20:47:23.488697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.252 [2024-04-26 20:47:23.488842] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.252 [2024-04-26 20:47:23.488851] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.252 [2024-04-26 20:47:23.488858] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.252 [2024-04-26 20:47:23.491101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.252 [2024-04-26 20:47:23.499927] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.252 [2024-04-26 20:47:23.500605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.501094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.501107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.252 [2024-04-26 20:47:23.501116] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.252 [2024-04-26 20:47:23.501285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.252 [2024-04-26 20:47:23.501394] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.252 [2024-04-26 20:47:23.501402] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.252 [2024-04-26 20:47:23.501409] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.252 [2024-04-26 20:47:23.503702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.252 [2024-04-26 20:47:23.512200] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.252 [2024-04-26 20:47:23.512904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.513486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.513523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.252 [2024-04-26 20:47:23.513539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.252 [2024-04-26 20:47:23.513740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.252 [2024-04-26 20:47:23.513886] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.252 [2024-04-26 20:47:23.513894] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.252 [2024-04-26 20:47:23.513901] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.252 [2024-04-26 20:47:23.516199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.252 [2024-04-26 20:47:23.524740] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.252 [2024-04-26 20:47:23.525451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.525935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.525948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.252 [2024-04-26 20:47:23.525957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.252 [2024-04-26 20:47:23.526118] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.252 [2024-04-26 20:47:23.526245] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.252 [2024-04-26 20:47:23.526253] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.252 [2024-04-26 20:47:23.526260] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.252 [2024-04-26 20:47:23.528561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.252 [2024-04-26 20:47:23.537201] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.252 [2024-04-26 20:47:23.537774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.538261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.538273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.252 [2024-04-26 20:47:23.538290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.252 [2024-04-26 20:47:23.538470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.252 [2024-04-26 20:47:23.538579] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.252 [2024-04-26 20:47:23.538586] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.252 [2024-04-26 20:47:23.538593] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.252 [2024-04-26 20:47:23.540633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.252 [2024-04-26 20:47:23.549887] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.252 [2024-04-26 20:47:23.550603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.551103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.551115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.252 [2024-04-26 20:47:23.551124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.252 [2024-04-26 20:47:23.551253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.252 [2024-04-26 20:47:23.551407] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.252 [2024-04-26 20:47:23.551416] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.252 [2024-04-26 20:47:23.551423] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.252 [2024-04-26 20:47:23.553789] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.252 [2024-04-26 20:47:23.562265] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.252 [2024-04-26 20:47:23.562942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.563313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.563327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.252 [2024-04-26 20:47:23.563337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.252 [2024-04-26 20:47:23.563479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.252 [2024-04-26 20:47:23.563607] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.252 [2024-04-26 20:47:23.563614] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.252 [2024-04-26 20:47:23.563622] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.252 [2024-04-26 20:47:23.565970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.252 [2024-04-26 20:47:23.574769] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.252 [2024-04-26 20:47:23.575485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.575969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.252 [2024-04-26 20:47:23.575981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.252 [2024-04-26 20:47:23.575990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.252 [2024-04-26 20:47:23.576169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.252 [2024-04-26 20:47:23.576285] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.252 [2024-04-26 20:47:23.576293] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.253 [2024-04-26 20:47:23.576300] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.253 [2024-04-26 20:47:23.578665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.253 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 52528 Killed "${NVMF_APP[@]}" "$@" 00:30:05.253 20:47:23 -- host/bdevperf.sh@36 -- # tgt_init 00:30:05.253 20:47:23 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:05.253 20:47:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:05.253 20:47:23 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:05.253 20:47:23 -- common/autotest_common.sh@10 -- # set +x 00:30:05.253 [2024-04-26 20:47:23.587275] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.253 [2024-04-26 20:47:23.587988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.253 [2024-04-26 20:47:23.588503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.253 [2024-04-26 20:47:23.588517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.253 [2024-04-26 20:47:23.588531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.253 [2024-04-26 20:47:23.588710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.253 [2024-04-26 20:47:23.588837] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.253 [2024-04-26 20:47:23.588845] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.253 [2024-04-26 20:47:23.588852] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.253 [2024-04-26 20:47:23.591040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.514 20:47:23 -- nvmf/common.sh@469 -- # nvmfpid=54248 00:30:05.514 20:47:23 -- nvmf/common.sh@470 -- # waitforlisten 54248 00:30:05.514 20:47:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:05.514 20:47:23 -- common/autotest_common.sh@819 -- # '[' -z 54248 ']' 00:30:05.514 20:47:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:05.514 20:47:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:05.514 20:47:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:05.514 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:05.514 20:47:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:05.514 20:47:23 -- common/autotest_common.sh@10 -- # set +x 00:30:05.514 [2024-04-26 20:47:23.599837] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.514 [2024-04-26 20:47:23.600608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.514 [2024-04-26 20:47:23.601107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.514 [2024-04-26 20:47:23.601120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.514 [2024-04-26 20:47:23.601130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.514 [2024-04-26 20:47:23.601297] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.514 [2024-04-26 20:47:23.601388] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.514 [2024-04-26 20:47:23.601395] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.514 [2024-04-26 20:47:23.601403] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.514 [2024-04-26 20:47:23.603569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.514 [2024-04-26 20:47:23.612144] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.514 [2024-04-26 20:47:23.612889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.514 [2024-04-26 20:47:23.613271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.514 [2024-04-26 20:47:23.613290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.514 [2024-04-26 20:47:23.613299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.514 [2024-04-26 20:47:23.613460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.514 [2024-04-26 20:47:23.613624] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.514 [2024-04-26 20:47:23.613632] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.514 [2024-04-26 20:47:23.613643] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.514 [2024-04-26 20:47:23.615811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.514 [2024-04-26 20:47:23.624671] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.514 [2024-04-26 20:47:23.625290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.514 [2024-04-26 20:47:23.625763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.514 [2024-04-26 20:47:23.625799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.514 [2024-04-26 20:47:23.625810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.514 [2024-04-26 20:47:23.625934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.514 [2024-04-26 20:47:23.626098] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.514 [2024-04-26 20:47:23.626107] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.514 [2024-04-26 20:47:23.626114] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.514 [2024-04-26 20:47:23.628209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.514 [2024-04-26 20:47:23.637272] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.637972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.638471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.638486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.638496] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.638639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.638784] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.638792] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.638800] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.640371] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:05.515 [2024-04-26 20:47:23.640414] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:05.515 [2024-04-26 20:47:23.641023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.649969] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.650735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.651235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.651248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.651258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.651443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.651553] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.651565] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.651573] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.654092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.662460] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.663223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.663802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.663838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.663849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.664010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.664174] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.664183] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.664191] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.666345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 EAL: No free 2048 kB hugepages reported on node 1 00:30:05.515 [2024-04-26 20:47:23.674881] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.675325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.675764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.675775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.675784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.675931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.676093] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.676101] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.676108] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.678257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.687368] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.688042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.688548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.688562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.688571] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.688751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.688933] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.688946] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.688953] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.691125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.699798] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.700553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.700992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.701004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.701014] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.701157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.701309] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.701318] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.701326] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.703456] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.704061] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:05.515 [2024-04-26 20:47:23.712275] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.713022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.713524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.713538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.713548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.713728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.713855] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.713863] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.713871] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.715988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.724708] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.725357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.725882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.725895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.725904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.726084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.726193] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.726200] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.726212] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.728424] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.736874] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.737627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.738142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.738154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.738163] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.738315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.738457] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.738465] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.738473] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.740824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.749239] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.749860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.750497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.750534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.750544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.750778] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.750924] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.750932] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.750940] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.753202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.761773] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.762527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.762978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.762991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.763000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.763160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.763368] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.763377] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.763385] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.765811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.766122] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:05.515 [2024-04-26 20:47:23.766231] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:05.515 [2024-04-26 20:47:23.766239] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:05.515 [2024-04-26 20:47:23.766246] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:05.515 [2024-04-26 20:47:23.766352] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:05.515 [2024-04-26 20:47:23.766499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:05.515 [2024-04-26 20:47:23.766504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:05.515 [2024-04-26 20:47:23.774307] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.775010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.775290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.775304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.775313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.775475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.775621] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.775629] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.775637] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.777770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.786595] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.787198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.787658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.787695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.787706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.787887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.788051] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.788059] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.788066] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.790297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.798975] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.799736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.800216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.800229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.800239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.800413] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.800560] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.800568] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.800576] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.802978] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.811313] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.811958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.812229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.812247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.812257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.812408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.812573] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.812583] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.812590] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.814667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.823792] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.824050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.824604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.824641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.824652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.824776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.824885] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.824894] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.515 [2024-04-26 20:47:23.824901] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.515 [2024-04-26 20:47:23.827034] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.515 [2024-04-26 20:47:23.836307] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.515 [2024-04-26 20:47:23.836939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.837501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.515 [2024-04-26 20:47:23.837538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.515 [2024-04-26 20:47:23.837549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.515 [2024-04-26 20:47:23.837710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.515 [2024-04-26 20:47:23.837879] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.515 [2024-04-26 20:47:23.837887] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.516 [2024-04-26 20:47:23.837895] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.516 [2024-04-26 20:47:23.840230] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.516 [2024-04-26 20:47:23.848779] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.516 [2024-04-26 20:47:23.849527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.516 [2024-04-26 20:47:23.850002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.516 [2024-04-26 20:47:23.850015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.516 [2024-04-26 20:47:23.850024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.516 [2024-04-26 20:47:23.850185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.516 [2024-04-26 20:47:23.850393] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.516 [2024-04-26 20:47:23.850401] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.516 [2024-04-26 20:47:23.850408] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.516 [2024-04-26 20:47:23.852540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.780 [2024-04-26 20:47:23.861359] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.780 [2024-04-26 20:47:23.861964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.862190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.862200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.780 [2024-04-26 20:47:23.862208] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.780 [2024-04-26 20:47:23.862375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.780 [2024-04-26 20:47:23.862537] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.780 [2024-04-26 20:47:23.862545] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.780 [2024-04-26 20:47:23.862551] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.780 [2024-04-26 20:47:23.864966] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.780 [2024-04-26 20:47:23.873795] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.780 [2024-04-26 20:47:23.874340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.874789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.874799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.780 [2024-04-26 20:47:23.874807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.780 [2024-04-26 20:47:23.874967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.780 [2024-04-26 20:47:23.875145] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.780 [2024-04-26 20:47:23.875157] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.780 [2024-04-26 20:47:23.875164] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.780 [2024-04-26 20:47:23.877109] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.780 [2024-04-26 20:47:23.886279] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.780 [2024-04-26 20:47:23.886879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.887489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.887526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.780 [2024-04-26 20:47:23.887537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.780 [2024-04-26 20:47:23.887698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.780 [2024-04-26 20:47:23.887844] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.780 [2024-04-26 20:47:23.887852] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.780 [2024-04-26 20:47:23.887860] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.780 [2024-04-26 20:47:23.890103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.780 [2024-04-26 20:47:23.898666] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.780 [2024-04-26 20:47:23.899341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.899688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.899701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.780 [2024-04-26 20:47:23.899710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.780 [2024-04-26 20:47:23.899890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.780 [2024-04-26 20:47:23.900017] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.780 [2024-04-26 20:47:23.900025] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.780 [2024-04-26 20:47:23.900033] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.780 [2024-04-26 20:47:23.902314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.780 [2024-04-26 20:47:23.910838] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.780 [2024-04-26 20:47:23.911563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.912033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.912046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.780 [2024-04-26 20:47:23.912055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.780 [2024-04-26 20:47:23.912234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.780 [2024-04-26 20:47:23.912406] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.780 [2024-04-26 20:47:23.912415] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.780 [2024-04-26 20:47:23.912430] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.780 [2024-04-26 20:47:23.914778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.780 [2024-04-26 20:47:23.923246] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.780 [2024-04-26 20:47:23.923851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.924148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.924162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.780 [2024-04-26 20:47:23.924172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.780 [2024-04-26 20:47:23.924340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.780 [2024-04-26 20:47:23.924504] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.780 [2024-04-26 20:47:23.924512] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.780 [2024-04-26 20:47:23.924519] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.780 [2024-04-26 20:47:23.926848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.780 [2024-04-26 20:47:23.935645] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.780 [2024-04-26 20:47:23.936344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.936967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.780 [2024-04-26 20:47:23.936980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.780 [2024-04-26 20:47:23.936989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.780 [2024-04-26 20:47:23.937169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.780 [2024-04-26 20:47:23.937322] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.780 [2024-04-26 20:47:23.937332] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.780 [2024-04-26 20:47:23.937339] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.780 [2024-04-26 20:47:23.939522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.780 [2024-04-26 20:47:23.948421] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.780 [2024-04-26 20:47:23.949132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:23.949655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:23.949669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.781 [2024-04-26 20:47:23.949678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.781 [2024-04-26 20:47:23.949840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.781 [2024-04-26 20:47:23.949968] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.781 [2024-04-26 20:47:23.949976] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.781 [2024-04-26 20:47:23.949984] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.781 [2024-04-26 20:47:23.952266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.781 [2024-04-26 20:47:23.960709] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.781 [2024-04-26 20:47:23.961062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:23.961391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:23.961403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.781 [2024-04-26 20:47:23.961411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.781 [2024-04-26 20:47:23.961481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.781 [2024-04-26 20:47:23.961623] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.781 [2024-04-26 20:47:23.961631] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.781 [2024-04-26 20:47:23.961638] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.781 [2024-04-26 20:47:23.963937] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.781 [2024-04-26 20:47:23.973025] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.781 [2024-04-26 20:47:23.973626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:23.974102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:23.974115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.781 [2024-04-26 20:47:23.974125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.781 [2024-04-26 20:47:23.974292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.781 [2024-04-26 20:47:23.974439] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.781 [2024-04-26 20:47:23.974447] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.781 [2024-04-26 20:47:23.974454] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.781 [2024-04-26 20:47:23.976892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.781 [2024-04-26 20:47:23.985282] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.781 [2024-04-26 20:47:23.985958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:23.986545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:23.986582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.781 [2024-04-26 20:47:23.986593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.781 [2024-04-26 20:47:23.986759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.781 [2024-04-26 20:47:23.986886] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.781 [2024-04-26 20:47:23.986895] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.781 [2024-04-26 20:47:23.986902] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.781 [2024-04-26 20:47:23.989295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.781 [2024-04-26 20:47:23.997844] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.781 [2024-04-26 20:47:23.998546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:23.999015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:23.999028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.781 [2024-04-26 20:47:23.999037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.781 [2024-04-26 20:47:23.999217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.781 [2024-04-26 20:47:23.999370] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.781 [2024-04-26 20:47:23.999379] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.781 [2024-04-26 20:47:23.999386] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.781 [2024-04-26 20:47:24.001496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.781 [2024-04-26 20:47:24.010321] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.781 [2024-04-26 20:47:24.010957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:24.011338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:24.011353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.781 [2024-04-26 20:47:24.011362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.781 [2024-04-26 20:47:24.011505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.781 [2024-04-26 20:47:24.011669] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.781 [2024-04-26 20:47:24.011677] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.781 [2024-04-26 20:47:24.011684] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.781 [2024-04-26 20:47:24.014051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.781 [2024-04-26 20:47:24.022719] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.781 [2024-04-26 20:47:24.023486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:24.023765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:24.023778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.781 [2024-04-26 20:47:24.023787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.781 [2024-04-26 20:47:24.023930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.781 [2024-04-26 20:47:24.024094] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.781 [2024-04-26 20:47:24.024102] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.781 [2024-04-26 20:47:24.024109] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.781 [2024-04-26 20:47:24.026397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.781 [2024-04-26 20:47:24.035075] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.781 [2024-04-26 20:47:24.035686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:24.036140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:24.036151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.781 [2024-04-26 20:47:24.036160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.781 [2024-04-26 20:47:24.036307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.781 [2024-04-26 20:47:24.036449] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.781 [2024-04-26 20:47:24.036458] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.781 [2024-04-26 20:47:24.036465] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.781 [2024-04-26 20:47:24.038700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.781 [2024-04-26 20:47:24.047488] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.781 [2024-04-26 20:47:24.048160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:24.048649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:24.048663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.781 [2024-04-26 20:47:24.048673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.781 [2024-04-26 20:47:24.048797] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.781 [2024-04-26 20:47:24.048962] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.781 [2024-04-26 20:47:24.048970] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.781 [2024-04-26 20:47:24.048977] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.781 [2024-04-26 20:47:24.051181] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.781 [2024-04-26 20:47:24.059925] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.781 [2024-04-26 20:47:24.060518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:24.061001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.781 [2024-04-26 20:47:24.061010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.781 [2024-04-26 20:47:24.061018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.781 [2024-04-26 20:47:24.061142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.782 [2024-04-26 20:47:24.061229] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.782 [2024-04-26 20:47:24.061237] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.782 [2024-04-26 20:47:24.061244] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.782 [2024-04-26 20:47:24.063511] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.782 [2024-04-26 20:47:24.072398] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.782 [2024-04-26 20:47:24.072958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.782 [2024-04-26 20:47:24.073398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.782 [2024-04-26 20:47:24.073413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.782 [2024-04-26 20:47:24.073421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.782 [2024-04-26 20:47:24.073599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.782 [2024-04-26 20:47:24.073723] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.782 [2024-04-26 20:47:24.073731] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.782 [2024-04-26 20:47:24.073737] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.782 [2024-04-26 20:47:24.076097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.782 [2024-04-26 20:47:24.085120] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.782 [2024-04-26 20:47:24.085719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.782 [2024-04-26 20:47:24.085977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.782 [2024-04-26 20:47:24.085987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.782 [2024-04-26 20:47:24.085995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.782 [2024-04-26 20:47:24.086137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.782 [2024-04-26 20:47:24.086243] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.782 [2024-04-26 20:47:24.086251] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.782 [2024-04-26 20:47:24.086258] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.782 [2024-04-26 20:47:24.088368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.782 [2024-04-26 20:47:24.097636] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.782 [2024-04-26 20:47:24.098281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.782 [2024-04-26 20:47:24.098517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.782 [2024-04-26 20:47:24.098532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.782 [2024-04-26 20:47:24.098539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.782 [2024-04-26 20:47:24.098684] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.782 [2024-04-26 20:47:24.098791] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.782 [2024-04-26 20:47:24.098799] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.782 [2024-04-26 20:47:24.098806] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.782 [2024-04-26 20:47:24.100937] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:05.782 [2024-04-26 20:47:24.110177] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:05.782 [2024-04-26 20:47:24.110855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.782 [2024-04-26 20:47:24.111338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:05.782 [2024-04-26 20:47:24.111352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:05.782 [2024-04-26 20:47:24.111366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:05.782 [2024-04-26 20:47:24.111527] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:05.782 [2024-04-26 20:47:24.111672] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:05.782 [2024-04-26 20:47:24.111680] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:05.782 [2024-04-26 20:47:24.111687] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:05.782 [2024-04-26 20:47:24.113928] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.046 [2024-04-26 20:47:24.122537] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.046 [2024-04-26 20:47:24.123123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.046 [2024-04-26 20:47:24.123590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.046 [2024-04-26 20:47:24.123626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.046 [2024-04-26 20:47:24.123637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.046 [2024-04-26 20:47:24.123761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.046 [2024-04-26 20:47:24.123907] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.046 [2024-04-26 20:47:24.123915] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.046 [2024-04-26 20:47:24.123923] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.046 [2024-04-26 20:47:24.126086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.046 [2024-04-26 20:47:24.134868] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.046 [2024-04-26 20:47:24.135552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.046 [2024-04-26 20:47:24.136024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.046 [2024-04-26 20:47:24.136037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.046 [2024-04-26 20:47:24.136046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.047 [2024-04-26 20:47:24.136207] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.047 [2024-04-26 20:47:24.136341] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.047 [2024-04-26 20:47:24.136349] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.047 [2024-04-26 20:47:24.136357] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.047 [2024-04-26 20:47:24.138558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.047 [2024-04-26 20:47:24.147467] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.047 [2024-04-26 20:47:24.148127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.148685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.148722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.047 [2024-04-26 20:47:24.148732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.047 [2024-04-26 20:47:24.148880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.047 [2024-04-26 20:47:24.149008] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.047 [2024-04-26 20:47:24.149016] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.047 [2024-04-26 20:47:24.149023] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.047 [2024-04-26 20:47:24.151326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.047 [2024-04-26 20:47:24.159832] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.047 [2024-04-26 20:47:24.160543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.161005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.161017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.047 [2024-04-26 20:47:24.161026] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.047 [2024-04-26 20:47:24.161169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.047 [2024-04-26 20:47:24.161357] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.047 [2024-04-26 20:47:24.161366] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.047 [2024-04-26 20:47:24.161373] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.047 [2024-04-26 20:47:24.163450] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.047 [2024-04-26 20:47:24.172372] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.047 [2024-04-26 20:47:24.173089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.173450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.173464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.047 [2024-04-26 20:47:24.173474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.047 [2024-04-26 20:47:24.173672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.047 [2024-04-26 20:47:24.173781] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.047 [2024-04-26 20:47:24.173789] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.047 [2024-04-26 20:47:24.173796] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.047 [2024-04-26 20:47:24.176093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.047 [2024-04-26 20:47:24.184802] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.047 [2024-04-26 20:47:24.185487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.185742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.185762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.047 [2024-04-26 20:47:24.185772] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.047 [2024-04-26 20:47:24.185970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.047 [2024-04-26 20:47:24.186084] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.047 [2024-04-26 20:47:24.186091] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.047 [2024-04-26 20:47:24.186098] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.047 [2024-04-26 20:47:24.188385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.047 [2024-04-26 20:47:24.197363] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.047 [2024-04-26 20:47:24.197983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.198465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.198502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.047 [2024-04-26 20:47:24.198513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.047 [2024-04-26 20:47:24.198713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.047 [2024-04-26 20:47:24.198804] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.047 [2024-04-26 20:47:24.198812] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.047 [2024-04-26 20:47:24.198819] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.047 [2024-04-26 20:47:24.201066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.047 [2024-04-26 20:47:24.209873] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.047 [2024-04-26 20:47:24.210665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.211147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.211159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.047 [2024-04-26 20:47:24.211168] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.047 [2024-04-26 20:47:24.211336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.047 [2024-04-26 20:47:24.211483] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.047 [2024-04-26 20:47:24.211491] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.047 [2024-04-26 20:47:24.211498] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.047 [2024-04-26 20:47:24.213938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.047 [2024-04-26 20:47:24.222451] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.047 [2024-04-26 20:47:24.223126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.223614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.223628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.047 [2024-04-26 20:47:24.223637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.047 [2024-04-26 20:47:24.223798] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.047 [2024-04-26 20:47:24.223962] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.047 [2024-04-26 20:47:24.223975] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.047 [2024-04-26 20:47:24.223983] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.047 [2024-04-26 20:47:24.226234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.047 [2024-04-26 20:47:24.234941] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.047 [2024-04-26 20:47:24.235359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.235654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.235663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.047 [2024-04-26 20:47:24.235671] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.047 [2024-04-26 20:47:24.235796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.047 [2024-04-26 20:47:24.235956] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.047 [2024-04-26 20:47:24.235964] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.047 [2024-04-26 20:47:24.235971] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.047 [2024-04-26 20:47:24.238355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.047 [2024-04-26 20:47:24.247505] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.047 [2024-04-26 20:47:24.248051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.248524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.047 [2024-04-26 20:47:24.248535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.047 [2024-04-26 20:47:24.248542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.047 [2024-04-26 20:47:24.248666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.047 [2024-04-26 20:47:24.248791] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.047 [2024-04-26 20:47:24.248799] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.047 [2024-04-26 20:47:24.248806] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.048 [2024-04-26 20:47:24.251095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.048 [2024-04-26 20:47:24.259953] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.048 [2024-04-26 20:47:24.260378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.260835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.260845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.048 [2024-04-26 20:47:24.260852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.048 [2024-04-26 20:47:24.261030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.048 [2024-04-26 20:47:24.261118] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.048 [2024-04-26 20:47:24.261126] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.048 [2024-04-26 20:47:24.261137] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.048 [2024-04-26 20:47:24.263381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.048 [2024-04-26 20:47:24.272403] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.048 [2024-04-26 20:47:24.273074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.273485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.273496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.048 [2024-04-26 20:47:24.273503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.048 [2024-04-26 20:47:24.273644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.048 [2024-04-26 20:47:24.273804] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.048 [2024-04-26 20:47:24.273812] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.048 [2024-04-26 20:47:24.273818] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.048 [2024-04-26 20:47:24.275982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.048 [2024-04-26 20:47:24.284902] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.048 [2024-04-26 20:47:24.285554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.285802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.285812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.048 [2024-04-26 20:47:24.285820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.048 [2024-04-26 20:47:24.285980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.048 [2024-04-26 20:47:24.286104] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.048 [2024-04-26 20:47:24.286113] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.048 [2024-04-26 20:47:24.286119] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.048 [2024-04-26 20:47:24.288245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.048 [2024-04-26 20:47:24.297401] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.048 [2024-04-26 20:47:24.298086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.298564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.298579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.048 [2024-04-26 20:47:24.298588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.048 [2024-04-26 20:47:24.298768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.048 [2024-04-26 20:47:24.298895] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.048 [2024-04-26 20:47:24.298903] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.048 [2024-04-26 20:47:24.298910] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.048 [2024-04-26 20:47:24.301291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.048 [2024-04-26 20:47:24.310021] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.048 [2024-04-26 20:47:24.310721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.311199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.311211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.048 [2024-04-26 20:47:24.311221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.048 [2024-04-26 20:47:24.311371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.048 [2024-04-26 20:47:24.311553] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.048 [2024-04-26 20:47:24.311561] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.048 [2024-04-26 20:47:24.311568] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.048 [2024-04-26 20:47:24.313609] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.048 [2024-04-26 20:47:24.322430] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.048 [2024-04-26 20:47:24.323055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.323516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.323531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.048 [2024-04-26 20:47:24.323540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.048 [2024-04-26 20:47:24.323720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.048 [2024-04-26 20:47:24.323865] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.048 [2024-04-26 20:47:24.323873] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.048 [2024-04-26 20:47:24.323881] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.048 [2024-04-26 20:47:24.326187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.048 [2024-04-26 20:47:24.335219] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.048 [2024-04-26 20:47:24.335719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.336161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.336171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.048 [2024-04-26 20:47:24.336179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.048 [2024-04-26 20:47:24.336290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.048 [2024-04-26 20:47:24.336433] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.048 [2024-04-26 20:47:24.336441] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.048 [2024-04-26 20:47:24.336448] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.048 [2024-04-26 20:47:24.338885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.048 [2024-04-26 20:47:24.347709] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.048 [2024-04-26 20:47:24.348380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.348853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.348866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.048 [2024-04-26 20:47:24.348875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.048 [2024-04-26 20:47:24.349018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.048 [2024-04-26 20:47:24.349183] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.048 [2024-04-26 20:47:24.349192] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.048 [2024-04-26 20:47:24.349199] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.048 [2024-04-26 20:47:24.351484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.048 [2024-04-26 20:47:24.360176] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.048 [2024-04-26 20:47:24.360862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.361341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.361355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.048 [2024-04-26 20:47:24.361365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.048 [2024-04-26 20:47:24.361508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.048 [2024-04-26 20:47:24.361655] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.048 [2024-04-26 20:47:24.361663] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.048 [2024-04-26 20:47:24.361670] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.048 [2024-04-26 20:47:24.364077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.048 [2024-04-26 20:47:24.372872] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.048 [2024-04-26 20:47:24.373596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.374067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.048 [2024-04-26 20:47:24.374080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.049 [2024-04-26 20:47:24.374090] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.049 [2024-04-26 20:47:24.374270] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.049 [2024-04-26 20:47:24.374440] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.049 [2024-04-26 20:47:24.374449] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.049 [2024-04-26 20:47:24.374456] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.049 [2024-04-26 20:47:24.376533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.049 [2024-04-26 20:47:24.385169] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.049 [2024-04-26 20:47:24.385678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.049 [2024-04-26 20:47:24.386139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.049 [2024-04-26 20:47:24.386150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.049 [2024-04-26 20:47:24.386157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.049 [2024-04-26 20:47:24.386246] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.049 [2024-04-26 20:47:24.386340] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.049 [2024-04-26 20:47:24.386348] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.049 [2024-04-26 20:47:24.386354] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.312 [2024-04-26 20:47:24.388535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.312 [2024-04-26 20:47:24.397706] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.312 [2024-04-26 20:47:24.398179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.398735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.398771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.312 [2024-04-26 20:47:24.398782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.312 [2024-04-26 20:47:24.398924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.312 [2024-04-26 20:47:24.399106] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.312 [2024-04-26 20:47:24.399114] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.312 [2024-04-26 20:47:24.399122] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.312 [2024-04-26 20:47:24.401352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.312 [2024-04-26 20:47:24.409979] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.312 [2024-04-26 20:47:24.410686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.411060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.411073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.312 [2024-04-26 20:47:24.411082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.312 [2024-04-26 20:47:24.411261] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.312 [2024-04-26 20:47:24.411469] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.312 [2024-04-26 20:47:24.411477] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.312 [2024-04-26 20:47:24.411485] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.312 20:47:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:06.312 20:47:24 -- common/autotest_common.sh@852 -- # return 0 00:30:06.312 20:47:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:06.312 20:47:24 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:06.312 20:47:24 -- common/autotest_common.sh@10 -- # set +x 00:30:06.312 [2024-04-26 20:47:24.413814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.312 [2024-04-26 20:47:24.422493] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.312 [2024-04-26 20:47:24.423140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.423615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.423652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.312 [2024-04-26 20:47:24.423662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.312 [2024-04-26 20:47:24.423860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.312 [2024-04-26 20:47:24.424025] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.312 [2024-04-26 20:47:24.424040] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.312 [2024-04-26 20:47:24.424048] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.312 [2024-04-26 20:47:24.426339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.312 [2024-04-26 20:47:24.434792] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.312 [2024-04-26 20:47:24.435534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.436022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.436035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.312 [2024-04-26 20:47:24.436045] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.312 [2024-04-26 20:47:24.436243] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.312 [2024-04-26 20:47:24.436431] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.312 [2024-04-26 20:47:24.436440] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.312 [2024-04-26 20:47:24.436447] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.312 [2024-04-26 20:47:24.438963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.312 [2024-04-26 20:47:24.447399] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.312 [2024-04-26 20:47:24.448061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.448603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.448639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.312 [2024-04-26 20:47:24.448650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.312 [2024-04-26 20:47:24.448829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.312 [2024-04-26 20:47:24.448957] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.312 [2024-04-26 20:47:24.448966] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.312 [2024-04-26 20:47:24.448973] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.312 [2024-04-26 20:47:24.451108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.312 20:47:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:06.312 20:47:24 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:06.312 20:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.312 20:47:24 -- common/autotest_common.sh@10 -- # set +x 00:30:06.312 [2024-04-26 20:47:24.457875] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:06.312 [2024-04-26 20:47:24.460015] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.312 [2024-04-26 20:47:24.460560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.461032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.461044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.312 [2024-04-26 20:47:24.461053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.312 [2024-04-26 20:47:24.461269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.312 [2024-04-26 20:47:24.461440] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.312 [2024-04-26 20:47:24.461449] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.312 [2024-04-26 20:47:24.461457] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.312 20:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:06.312 20:47:24 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:06.312 [2024-04-26 20:47:24.463706] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.312 20:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.312 20:47:24 -- common/autotest_common.sh@10 -- # set +x 00:30:06.312 [2024-04-26 20:47:24.472566] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.312 [2024-04-26 20:47:24.473243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.473776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.312 [2024-04-26 20:47:24.473789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.312 [2024-04-26 20:47:24.473799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.312 [2024-04-26 20:47:24.473959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.313 [2024-04-26 20:47:24.474160] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.313 [2024-04-26 20:47:24.474168] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.313 [2024-04-26 20:47:24.474175] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.313 [2024-04-26 20:47:24.476381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.313 [2024-04-26 20:47:24.484955] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.313 [2024-04-26 20:47:24.485739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.313 [2024-04-26 20:47:24.486232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.313 [2024-04-26 20:47:24.486244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.313 [2024-04-26 20:47:24.486254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.313 [2024-04-26 20:47:24.486459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.313 [2024-04-26 20:47:24.486551] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.313 [2024-04-26 20:47:24.486559] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.313 [2024-04-26 20:47:24.486571] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.313 [2024-04-26 20:47:24.488991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.313 Malloc0 00:30:06.313 [2024-04-26 20:47:24.497318] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.313 20:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:06.313 20:47:24 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:06.313 [2024-04-26 20:47:24.498038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.313 20:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.313 20:47:24 -- common/autotest_common.sh@10 -- # set +x 00:30:06.313 [2024-04-26 20:47:24.498511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.313 [2024-04-26 20:47:24.498526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.313 [2024-04-26 20:47:24.498535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.313 [2024-04-26 20:47:24.498641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.313 [2024-04-26 20:47:24.498787] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.313 [2024-04-26 20:47:24.498795] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.313 [2024-04-26 20:47:24.498802] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.313 [2024-04-26 20:47:24.501010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.313 20:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:06.313 20:47:24 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:06.313 [2024-04-26 20:47:24.509881] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.313 20:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.313 20:47:24 -- common/autotest_common.sh@10 -- # set +x 00:30:06.313 [2024-04-26 20:47:24.510317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.313 [2024-04-26 20:47:24.510802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.313 [2024-04-26 20:47:24.510812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.313 [2024-04-26 20:47:24.510821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.313 [2024-04-26 20:47:24.510950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.313 [2024-04-26 20:47:24.511057] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.313 [2024-04-26 20:47:24.511064] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.313 [2024-04-26 20:47:24.511071] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.313 [2024-04-26 20:47:24.513332] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.313 20:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:06.313 20:47:24 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:06.313 20:47:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:06.313 20:47:24 -- common/autotest_common.sh@10 -- # set +x 00:30:06.313 [2024-04-26 20:47:24.522489] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.313 [2024-04-26 20:47:24.523170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.313 [2024-04-26 20:47:24.523632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:06.313 [2024-04-26 20:47:24.523677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa669c0 with addr=10.0.0.2, port=4420 00:30:06.313 [2024-04-26 20:47:24.523689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa669c0 is same with the state(5) to be set 00:30:06.313 [2024-04-26 20:47:24.523834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa669c0 (9): Bad file descriptor 00:30:06.313 [2024-04-26 20:47:24.523980] nvme_ctrlr.c:4027:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:06.313 [2024-04-26 20:47:24.523988] nvme_ctrlr.c:1736:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:06.313 [2024-04-26 20:47:24.523995] nvme_ctrlr.c:1028:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:06.313 [2024-04-26 20:47:24.526139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:06.313 [2024-04-26 20:47:24.528663] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:06.313 20:47:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:06.313 20:47:24 -- host/bdevperf.sh@38 -- # wait 53058 00:30:06.313 [2024-04-26 20:47:24.535069] nvme_ctrlr.c:1638:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:06.313 [2024-04-26 20:47:24.651358] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:16.394 00:30:16.394 Latency(us) 00:30:16.394 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:16.394 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:16.394 Verification LBA range: start 0x0 length 0x4000 00:30:16.394 Nvme1n1 : 15.01 10196.01 39.83 14926.55 0.00 5080.00 1181.01 17694.72 00:30:16.394 =================================================================================================================== 00:30:16.394 Total : 10196.01 39.83 14926.55 0.00 5080.00 1181.01 17694.72 00:30:16.394 20:47:33 -- host/bdevperf.sh@39 -- # sync 00:30:16.394 20:47:33 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:16.394 20:47:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:16.394 20:47:33 -- common/autotest_common.sh@10 -- # set +x 00:30:16.394 20:47:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:16.394 20:47:33 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:16.394 20:47:33 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:16.394 20:47:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:16.394 20:47:33 -- nvmf/common.sh@116 -- # sync 00:30:16.394 20:47:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:16.394 20:47:33 -- nvmf/common.sh@119 -- # set +e 00:30:16.394 20:47:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:16.394 20:47:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:16.394 rmmod nvme_tcp 00:30:16.394 rmmod nvme_fabrics 00:30:16.394 rmmod nvme_keyring 00:30:16.394 20:47:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:16.394 20:47:33 -- nvmf/common.sh@123 -- # set -e 00:30:16.394 20:47:33 -- nvmf/common.sh@124 -- # return 0 00:30:16.394 20:47:33 -- nvmf/common.sh@477 -- # '[' -n 54248 ']' 00:30:16.394 20:47:33 -- nvmf/common.sh@478 -- # killprocess 54248 00:30:16.394 20:47:33 -- common/autotest_common.sh@926 -- # '[' -z 54248 ']' 00:30:16.394 20:47:33 -- common/autotest_common.sh@930 -- # kill -0 54248 00:30:16.394 20:47:33 -- common/autotest_common.sh@931 -- # uname 00:30:16.394 20:47:33 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:16.394 20:47:33 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 54248 00:30:16.394 20:47:33 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:16.394 20:47:33 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:16.394 20:47:33 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 54248' 00:30:16.394 killing process with pid 54248 00:30:16.394 20:47:33 -- common/autotest_common.sh@945 -- # kill 54248 00:30:16.394 20:47:33 -- common/autotest_common.sh@950 -- # wait 54248 00:30:16.394 20:47:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:16.394 20:47:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:16.394 20:47:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:16.394 20:47:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:16.394 20:47:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:16.394 20:47:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:16.394 20:47:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:16.394 20:47:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:17.352 20:47:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:17.352 00:30:17.352 real 0m27.514s 00:30:17.352 user 1m2.137s 00:30:17.352 sys 0m6.990s 00:30:17.352 20:47:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:17.352 20:47:35 -- common/autotest_common.sh@10 -- # set +x 00:30:17.352 ************************************ 00:30:17.352 END TEST nvmf_bdevperf 00:30:17.352 ************************************ 00:30:17.352 20:47:35 -- nvmf/nvmf.sh@123 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:17.352 20:47:35 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:30:17.352 20:47:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:17.352 20:47:35 -- common/autotest_common.sh@10 -- # set +x 00:30:17.352 ************************************ 00:30:17.352 START TEST nvmf_target_disconnect 00:30:17.352 ************************************ 00:30:17.352 20:47:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:17.352 * Looking for test storage... 00:30:17.352 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:17.353 20:47:35 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:17.353 20:47:35 -- nvmf/common.sh@7 -- # uname -s 00:30:17.353 20:47:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:17.353 20:47:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:17.353 20:47:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:17.353 20:47:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:17.353 20:47:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:17.353 20:47:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:17.353 20:47:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:17.353 20:47:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:17.353 20:47:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:17.353 20:47:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:17.353 20:47:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:30:17.353 20:47:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:30:17.353 20:47:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:17.353 20:47:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:17.353 20:47:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:17.353 20:47:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:17.353 20:47:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:17.353 20:47:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:17.353 20:47:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:17.354 20:47:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:17.354 20:47:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:17.354 20:47:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:17.354 20:47:35 -- paths/export.sh@5 -- # export PATH 00:30:17.354 20:47:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:17.354 20:47:35 -- nvmf/common.sh@46 -- # : 0 00:30:17.354 20:47:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:17.354 20:47:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:17.354 20:47:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:17.354 20:47:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:17.354 20:47:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:17.355 20:47:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:17.355 20:47:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:17.355 20:47:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:17.355 20:47:35 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:17.355 20:47:35 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:17.355 20:47:35 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:17.355 20:47:35 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:17.355 20:47:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:17.355 20:47:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:17.355 20:47:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:17.355 20:47:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:17.355 20:47:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:17.355 20:47:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:17.355 20:47:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:17.355 20:47:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:17.355 20:47:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:17.355 20:47:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:17.355 20:47:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:17.355 20:47:35 -- common/autotest_common.sh@10 -- # set +x 00:30:25.501 20:47:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:25.501 20:47:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:25.501 20:47:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:25.501 20:47:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:25.501 20:47:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:25.501 20:47:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:25.501 20:47:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:25.501 20:47:42 -- nvmf/common.sh@294 -- # net_devs=() 00:30:25.501 20:47:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:25.501 20:47:42 -- nvmf/common.sh@295 -- # e810=() 00:30:25.501 20:47:42 -- nvmf/common.sh@295 -- # local -ga e810 00:30:25.501 20:47:42 -- nvmf/common.sh@296 -- # x722=() 00:30:25.501 20:47:42 -- nvmf/common.sh@296 -- # local -ga x722 00:30:25.501 20:47:42 -- nvmf/common.sh@297 -- # mlx=() 00:30:25.501 20:47:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:25.501 20:47:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:25.501 20:47:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:25.501 20:47:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:25.501 20:47:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:25.501 20:47:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:25.501 20:47:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:25.501 20:47:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:25.501 20:47:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:25.501 20:47:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:25.501 20:47:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:25.501 20:47:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:25.501 20:47:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:25.501 20:47:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:25.501 20:47:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:25.501 20:47:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:25.502 20:47:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:25.502 20:47:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:25.502 20:47:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:30:25.502 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:30:25.502 20:47:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:25.502 20:47:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:30:25.502 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:30:25.502 20:47:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:25.502 20:47:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:25.502 20:47:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:25.502 20:47:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:25.502 20:47:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:25.502 20:47:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:30:25.502 Found net devices under 0000:4b:00.0: cvl_0_0 00:30:25.502 20:47:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:25.502 20:47:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:25.502 20:47:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:25.502 20:47:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:25.502 20:47:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:25.502 20:47:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:30:25.502 Found net devices under 0000:4b:00.1: cvl_0_1 00:30:25.502 20:47:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:25.502 20:47:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:25.502 20:47:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:25.502 20:47:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:25.502 20:47:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:25.502 20:47:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:25.502 20:47:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:25.502 20:47:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:25.502 20:47:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:25.502 20:47:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:25.502 20:47:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:25.502 20:47:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:25.502 20:47:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:25.502 20:47:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:25.502 20:47:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:25.502 20:47:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:25.502 20:47:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:25.502 20:47:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:25.502 20:47:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:25.502 20:47:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:25.502 20:47:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:25.502 20:47:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:25.502 20:47:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:25.502 20:47:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:25.502 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:25.502 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.888 ms 00:30:25.502 00:30:25.502 --- 10.0.0.2 ping statistics --- 00:30:25.502 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:25.502 rtt min/avg/max/mdev = 0.888/0.888/0.888/0.000 ms 00:30:25.502 20:47:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:25.502 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:25.502 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.299 ms 00:30:25.502 00:30:25.502 --- 10.0.0.1 ping statistics --- 00:30:25.502 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:25.502 rtt min/avg/max/mdev = 0.299/0.299/0.299/0.000 ms 00:30:25.502 20:47:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:25.502 20:47:42 -- nvmf/common.sh@410 -- # return 0 00:30:25.502 20:47:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:25.502 20:47:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:25.502 20:47:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:25.502 20:47:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:25.502 20:47:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:25.502 20:47:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:25.502 20:47:42 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:25.502 20:47:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:25.502 20:47:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:25.502 20:47:42 -- common/autotest_common.sh@10 -- # set +x 00:30:25.502 ************************************ 00:30:25.502 START TEST nvmf_target_disconnect_tc1 00:30:25.502 ************************************ 00:30:25.502 20:47:42 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc1 00:30:25.502 20:47:42 -- host/target_disconnect.sh@32 -- # set +e 00:30:25.502 20:47:42 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:25.502 EAL: No free 2048 kB hugepages reported on node 1 00:30:25.502 [2024-04-26 20:47:42.760524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:25.502 [2024-04-26 20:47:42.761107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:25.502 [2024-04-26 20:47:42.761127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x168e860 with addr=10.0.0.2, port=4420 00:30:25.502 [2024-04-26 20:47:42.761165] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:25.502 [2024-04-26 20:47:42.761181] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:25.502 [2024-04-26 20:47:42.761189] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:25.502 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:25.502 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:25.502 Initializing NVMe Controllers 00:30:25.502 20:47:42 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:25.502 20:47:42 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:25.502 20:47:42 -- common/autotest_common.sh@1132 -- # [[ hxBET =~ e ]] 00:30:25.502 20:47:42 -- common/autotest_common.sh@1132 -- # return 0 00:30:25.502 20:47:42 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:25.502 20:47:42 -- host/target_disconnect.sh@41 -- # set -e 00:30:25.502 00:30:25.502 real 0m0.104s 00:30:25.502 user 0m0.048s 00:30:25.502 sys 0m0.055s 00:30:25.502 20:47:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:25.502 20:47:42 -- common/autotest_common.sh@10 -- # set +x 00:30:25.502 ************************************ 00:30:25.502 END TEST nvmf_target_disconnect_tc1 00:30:25.502 ************************************ 00:30:25.502 20:47:42 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:25.502 20:47:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:25.502 20:47:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:25.502 20:47:42 -- common/autotest_common.sh@10 -- # set +x 00:30:25.502 ************************************ 00:30:25.502 START TEST nvmf_target_disconnect_tc2 00:30:25.502 ************************************ 00:30:25.502 20:47:42 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc2 00:30:25.502 20:47:42 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:25.502 20:47:42 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:25.502 20:47:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:25.502 20:47:42 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:25.502 20:47:42 -- common/autotest_common.sh@10 -- # set +x 00:30:25.502 20:47:42 -- nvmf/common.sh@469 -- # nvmfpid=60317 00:30:25.502 20:47:42 -- nvmf/common.sh@470 -- # waitforlisten 60317 00:30:25.502 20:47:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:25.502 20:47:42 -- common/autotest_common.sh@819 -- # '[' -z 60317 ']' 00:30:25.502 20:47:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:25.502 20:47:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:25.502 20:47:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:25.502 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:25.502 20:47:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:25.502 20:47:42 -- common/autotest_common.sh@10 -- # set +x 00:30:25.502 [2024-04-26 20:47:42.873481] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:25.502 [2024-04-26 20:47:42.873540] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:25.502 EAL: No free 2048 kB hugepages reported on node 1 00:30:25.502 [2024-04-26 20:47:42.960374] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:25.502 [2024-04-26 20:47:43.051798] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:25.502 [2024-04-26 20:47:43.051956] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:25.502 [2024-04-26 20:47:43.051967] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:25.502 [2024-04-26 20:47:43.051974] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:25.502 [2024-04-26 20:47:43.052145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:25.502 [2024-04-26 20:47:43.052334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:25.502 [2024-04-26 20:47:43.052513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:25.503 [2024-04-26 20:47:43.052516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:25.503 20:47:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:25.503 20:47:43 -- common/autotest_common.sh@852 -- # return 0 00:30:25.503 20:47:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:25.503 20:47:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:25.503 20:47:43 -- common/autotest_common.sh@10 -- # set +x 00:30:25.503 20:47:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:25.503 20:47:43 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:25.503 20:47:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:25.503 20:47:43 -- common/autotest_common.sh@10 -- # set +x 00:30:25.503 Malloc0 00:30:25.503 20:47:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:25.503 20:47:43 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:25.503 20:47:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:25.503 20:47:43 -- common/autotest_common.sh@10 -- # set +x 00:30:25.503 [2024-04-26 20:47:43.748795] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:25.503 20:47:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:25.503 20:47:43 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:25.503 20:47:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:25.503 20:47:43 -- common/autotest_common.sh@10 -- # set +x 00:30:25.503 20:47:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:25.503 20:47:43 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:25.503 20:47:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:25.503 20:47:43 -- common/autotest_common.sh@10 -- # set +x 00:30:25.503 20:47:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:25.503 20:47:43 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:25.503 20:47:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:25.503 20:47:43 -- common/autotest_common.sh@10 -- # set +x 00:30:25.503 [2024-04-26 20:47:43.789175] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:25.503 20:47:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:25.503 20:47:43 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:25.503 20:47:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:25.503 20:47:43 -- common/autotest_common.sh@10 -- # set +x 00:30:25.503 20:47:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:25.503 20:47:43 -- host/target_disconnect.sh@50 -- # reconnectpid=60464 00:30:25.503 20:47:43 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:25.503 20:47:43 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:25.764 EAL: No free 2048 kB hugepages reported on node 1 00:30:27.687 20:47:45 -- host/target_disconnect.sh@53 -- # kill -9 60317 00:30:27.687 20:47:45 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Write completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Write completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Write completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Write completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Write completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Write completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Write completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Write completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Read completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Write completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 Write completed with error (sct=0, sc=8) 00:30:27.687 starting I/O failed 00:30:27.687 [2024-04-26 20:47:45.821522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:27.687 [2024-04-26 20:47:45.822039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.687 [2024-04-26 20:47:45.822564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.687 [2024-04-26 20:47:45.822591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.687 qpair failed and we were unable to recover it. 00:30:27.687 [2024-04-26 20:47:45.822904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.687 [2024-04-26 20:47:45.823578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.687 [2024-04-26 20:47:45.823607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.687 qpair failed and we were unable to recover it. 00:30:27.687 [2024-04-26 20:47:45.824094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.687 [2024-04-26 20:47:45.824579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.687 [2024-04-26 20:47:45.824607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.687 qpair failed and we were unable to recover it. 00:30:27.687 [2024-04-26 20:47:45.824937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.687 [2024-04-26 20:47:45.825540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.687 [2024-04-26 20:47:45.825569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.826041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.826287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.826297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.826594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.826991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.827000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.827372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.827585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.827597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.828051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.828495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.828504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.828970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.829451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.829460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.829954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.830431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.830439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.830910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.831266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.831275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.831683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.832184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.832193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.832614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.832965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.832973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.833499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.833959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.833970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.834530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.834890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.834901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.835366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.835746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.835755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.836202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.836651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.836660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.837135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.837698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.837727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.838074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.838622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.838651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.839000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.839570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.839599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.840030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.840582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.840611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.840977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.841338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.841347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.841695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.842011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.842020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.842501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.842900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.842908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.843382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.843750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.843757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.844114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.844424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.844433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.688 qpair failed and we were unable to recover it. 00:30:27.688 [2024-04-26 20:47:45.844884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.688 [2024-04-26 20:47:45.845256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.845265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.845715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.846148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.846156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.846727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.847150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.847160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.847552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.847995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.848002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.848572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.848808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.848821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.849191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.849595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.849603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.850071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.850519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.850528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.850962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.851447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.851475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.851970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.852303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.852312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.852798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.853239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.853247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.853616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.854060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.854069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.854615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.854974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.854984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.855447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.855926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.855934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.856516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.856975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.856985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.857455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.857925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.857933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.858492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.858955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.858968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.859455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.859940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.859948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.860504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.860960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.860971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.861451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.861933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.861942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.862162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.862549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.862557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.863023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.863494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.863503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.863940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.864422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.864430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.864889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.865241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.865249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.865693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.866122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.689 [2024-04-26 20:47:45.866130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.689 qpair failed and we were unable to recover it. 00:30:27.689 [2024-04-26 20:47:45.866558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.867024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.867034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.867461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.867829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.867846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.868299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.868721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.868729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.869158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.869615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.869624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.870097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.870638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.870667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.871173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.871989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.872006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.872470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.872946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.872955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.873471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.873929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.873940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.874404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.874839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.874847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.875205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.875642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.875651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.875993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.876492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.876501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.876927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.877356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.877367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.877592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.878044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.878052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.878520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.878995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.879002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.879357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.879784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.879791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.880260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.880659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.880667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.881021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.881410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.881418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.881888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.882363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.882372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.882805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.883273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.883285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.883623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.884083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.884090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.884523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.885029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.885039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.885385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.885830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.885841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.886315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.886748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.886758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.887224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.887671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.887680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.690 qpair failed and we were unable to recover it. 00:30:27.690 [2024-04-26 20:47:45.888155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.690 [2024-04-26 20:47:45.888689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.888718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.889196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.889651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.889660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.890137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.890718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.890747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.891174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.891732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.891762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.892236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.892795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.892824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.893286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.893710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.893739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.894066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.894630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.894659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.895133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.895693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.895721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.896194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.896727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.896755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.897231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.897749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.897777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.898254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.898774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.898804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.899231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.899725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.899753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.900189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.900643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.900652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.901127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.901691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.901720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.902189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.902721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.902750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.903220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.903710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.903739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.904171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.904690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.904699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.905028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.905573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.905602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.906076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.906616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.906644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.907116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.907675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.907704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.908170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.908537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.908545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.908982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.909567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.909596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.909918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.910402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.910411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.691 qpair failed and we were unable to recover it. 00:30:27.691 [2024-04-26 20:47:45.910888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.691 [2024-04-26 20:47:45.911324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.911332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.911795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.912018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.912029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.912482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.912882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.912890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.913356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.914156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.914172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.914640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.915123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.915131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.915611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.916043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.916051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.916519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.916955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.916962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.917522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.917982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.917992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.918509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.918889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.918898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.919373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.919829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.919838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.920183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.920483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.920493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.920960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.921438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.921446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.921880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.922355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.922363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.922700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.923176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.923184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.923635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.924067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.924074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.924547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.925024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.925032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.925565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.926021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.926031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.926616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.927080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.927090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.927603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.927851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.927864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.928323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.928775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.928783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.929253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.929713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.929721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.930188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.930526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.930536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.692 qpair failed and we were unable to recover it. 00:30:27.692 [2024-04-26 20:47:45.930986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.692 [2024-04-26 20:47:45.931462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.931470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.931927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.932147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.932156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.932607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.933038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.933045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.933595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.934104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.934115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.934654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.935158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.935168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.935610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.935903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.935911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.936363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.936691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.936699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.937189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.937616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.937624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.937979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.938451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.938460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.938887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.939361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.939369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.939805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.940233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.940240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.940602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.941074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.941082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.941622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.942131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.942141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.942707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.943210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.943221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.943556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.943995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.944007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.944576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.945044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.945054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.945612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.946076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.946086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.946654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.947160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.947170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.947627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.948105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.948113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.948656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.949161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.949171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.949619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.950094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.950103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.950546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.951035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.951045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.951517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.951972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.951982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.952536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.953042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.953052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.953628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.954102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.693 [2024-04-26 20:47:45.954113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.693 qpair failed and we were unable to recover it. 00:30:27.693 [2024-04-26 20:47:45.954686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.955189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.955199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.955751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.956094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.956105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.956675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.956786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.956799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.957245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.957708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.957717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.958190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.958587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.958595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.959031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.959350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.959359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.959807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.960235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.960243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.960712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.961185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.961193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.961630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.961988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.961996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.962523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.963029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.963040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.963609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.963847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.963858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.964190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.964598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.964606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.964961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.965395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.965403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.965855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.966330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.966338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.966560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.966999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.967007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.967423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.967862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.967870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.968288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.968742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.968749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.969249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.969651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.969658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.970125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.970563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.970571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.970919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.971474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.971502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.971972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.972413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.972421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.972870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.973352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.973360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.973827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.974306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.974313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.974784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.975259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.975268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.975734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.976127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.976135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.976692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.977195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.977206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.977735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.978091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.978098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.978665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.979130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.694 [2024-04-26 20:47:45.979140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.694 qpair failed and we were unable to recover it. 00:30:27.694 [2024-04-26 20:47:45.979698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.980158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.980168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.980720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.981234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.981244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.981809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.982285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.982296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.982652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.983129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.983136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.983694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.984200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.984211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.984741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.985246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.985256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.985830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.986301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.986319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.986661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.987163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.987171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.987611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.988090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.988098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.988593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.989051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.989062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.989628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.990088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.990099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.990631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.991138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.991149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.991694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.992199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.992210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.992766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.993270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.993285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.993786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.994286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.994297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.994626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.995093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.995105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.995667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.996147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.996157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.996598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.997080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.997088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.997660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.998163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.998173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.998622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.999099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:45.999107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:45.999721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.000069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.000080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:46.000628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.001008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.001018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:46.001570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.002075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.002086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:46.002659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.003127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.003137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:46.003692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.004191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.004201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:46.004646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.005153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.005163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:46.005642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.006117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.006126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.695 [2024-04-26 20:47:46.006681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.007139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.695 [2024-04-26 20:47:46.007149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.695 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.007699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.008158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.008169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.008505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.008995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.009006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.009589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.010047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.010061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.010521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.010981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.010991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.011558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.011932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.011943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.012399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.012842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.012851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.013325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.013767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.013775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.014001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.014413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.014423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.014894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.015368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.015376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.015841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.016321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.016329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.016793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.017159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.017166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.017616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.018096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.018104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.018575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.018918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.018928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.019389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.019865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.019873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.020339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.020771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.020779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.021243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.021718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.696 [2024-04-26 20:47:46.021726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.696 qpair failed and we were unable to recover it. 00:30:27.696 [2024-04-26 20:47:46.022065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.022600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.022630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.964 qpair failed and we were unable to recover it. 00:30:27.964 [2024-04-26 20:47:46.023448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.023896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.023906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.964 qpair failed and we were unable to recover it. 00:30:27.964 [2024-04-26 20:47:46.024427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.024888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.024895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.964 qpair failed and we were unable to recover it. 00:30:27.964 [2024-04-26 20:47:46.025369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.025819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.025827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.964 qpair failed and we were unable to recover it. 00:30:27.964 [2024-04-26 20:47:46.026176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.026636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.026644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.964 qpair failed and we were unable to recover it. 00:30:27.964 [2024-04-26 20:47:46.027090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.027564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.027573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.964 qpair failed and we were unable to recover it. 00:30:27.964 [2024-04-26 20:47:46.028039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.028506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.028538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.964 qpair failed and we were unable to recover it. 00:30:27.964 [2024-04-26 20:47:46.029008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.029584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.029612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.964 qpair failed and we were unable to recover it. 00:30:27.964 [2024-04-26 20:47:46.029950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.030416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.030424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.964 qpair failed and we were unable to recover it. 00:30:27.964 [2024-04-26 20:47:46.030783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.031220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.031227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.964 qpair failed and we were unable to recover it. 00:30:27.964 [2024-04-26 20:47:46.031674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.032109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.032117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.964 qpair failed and we were unable to recover it. 00:30:27.964 [2024-04-26 20:47:46.032658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.033165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.033175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.964 qpair failed and we were unable to recover it. 00:30:27.964 [2024-04-26 20:47:46.033643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.034076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.964 [2024-04-26 20:47:46.034085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.964 qpair failed and we were unable to recover it. 00:30:27.964 [2024-04-26 20:47:46.034620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.035085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.035095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.035683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.036146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.036156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.036630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.037103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.037110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.037666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.038172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.038182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.038660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.038979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.038988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.039552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.039788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.039798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.040258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.040691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.040699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.041169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.041640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.041648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.042095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.042619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.042648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.043084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.043659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.043688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.044035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.044468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.044497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.044968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.045511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.045539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.045996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.046575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.046604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.047037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.047612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.047641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.048112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.048693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.048721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.049159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.049562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.049591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.050052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.050478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.050506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.050952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.051532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.051562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.052033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.052599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.052627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.053097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.053620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.053650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.054107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.054640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.054669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.055136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.055589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.055618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.056085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.056614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.056644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.057113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.057669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.057700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.058055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.058610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.058639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.058980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.059515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.059544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.060015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.060539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.060567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.061013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.061470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.061498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.965 [2024-04-26 20:47:46.061956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.062529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.965 [2024-04-26 20:47:46.062558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.965 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.062983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.063475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.063483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.063908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.064385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.064393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.064862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.065219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.065226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.065694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.066170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.066178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.066628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.067103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.067110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.067625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.068092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.068102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.068330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.068742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.068751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.069203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.069676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.069685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.070150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.070710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.070739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.071046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.071645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.071673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.072193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.072608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.072616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.073070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.073612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.073641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.074116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.074572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.074600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.075069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.075304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.075317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.075810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.076247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.076255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.076737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.077168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.077176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.077720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.078176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.078186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.078632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.079061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.079070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.079625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.080131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.080142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.080673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.081177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.081188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.081620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.081871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.081886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.082361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.082824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.082832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.083182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.083459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.083466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.083910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.084379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.084387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.084861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.085340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.085348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.085803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.086232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.086239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.086702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.087176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.087184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.087659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.088087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.088095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.966 qpair failed and we were unable to recover it. 00:30:27.966 [2024-04-26 20:47:46.088658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.966 [2024-04-26 20:47:46.089123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.089132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.089520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.089901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.089911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.090370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.090706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.090714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.091174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.091618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.091625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.092121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.092642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.092670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.093153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.093614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.093643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.094122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.094686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.094716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.095253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.095635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.095663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.096008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.096532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.096562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.097030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.097513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.097542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.097977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.098521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.098556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.099010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.099588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.099617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.100051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.100629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.100657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.101090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.101633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.101661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.102131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.102704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.102733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.103197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.103726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.103754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.104223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.104555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.104582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.104970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.105345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.105354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.105812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.106247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.106255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.106702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.107178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.107187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.107972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.108452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.108461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.108938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.109415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.109423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.109887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.110367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.110376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.110693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.111130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.111137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.111487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.111951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.111959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.112429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.112865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.112873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.113339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.113787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.113794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.114240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.114473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.114484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.114953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.115440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.967 [2024-04-26 20:47:46.115448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.967 qpair failed and we were unable to recover it. 00:30:27.967 [2024-04-26 20:47:46.115882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.116062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.116070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.116496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.116972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.116979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.117426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.117887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.117895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.118395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.118855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.118862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.119328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.119667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.119674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.120016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.120482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.120491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.120918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.121385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.121393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.121864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.122215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.122222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.122677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.123151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.123159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.123710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.124203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.124214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.124532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.124982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.124991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.125547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.126010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.126020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.126554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.127059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.127069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.127686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.128190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.128201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.128648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.129086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.129093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.129638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.130142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.130152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.130691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.131198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.131209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.131772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.132281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.132293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.132784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.133246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.133257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.133798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.134261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.134271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.134843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.135341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.135351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.135695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.135875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.135885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.136336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.136784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.136793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.137290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.137688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.137696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.138169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.138617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.138625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.138952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.139423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.139431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.139864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.140292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.140299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.140742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.141042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.141051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.968 qpair failed and we were unable to recover it. 00:30:27.968 [2024-04-26 20:47:46.141445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.141916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.968 [2024-04-26 20:47:46.141924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.142390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.142715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.142723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.143175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.143514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.143522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.143977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.144313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.144321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.144766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.145193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.145201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.145640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.146017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.146024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.146490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.146964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.146972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.147317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.147750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.147758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.148112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.148455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.148463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.148798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.148983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.148992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.149288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.149717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.149731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.150196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.150618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.150626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.151109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.151629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.151657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.152129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.152672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.152702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.153161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.153648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.153657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.154103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.154629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.154659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.155009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.155582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.155611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.156097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.156584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.156613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.156946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.157515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.157543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.158013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.158593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.158622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.159076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.159602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.159633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.160061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.160624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.160653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.161002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.161557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.161585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.969 [2024-04-26 20:47:46.162057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.162633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.969 [2024-04-26 20:47:46.162661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.969 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.163135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.163667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.163695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.164164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.164646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.164655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.165105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.165671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.165700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.166168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.166688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.166716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.167229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.167642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.167650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.168115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.168654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.168683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.169142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.169707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.169740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.170208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.170737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.170766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.170984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.171527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.171555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.171901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.172369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.172377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.172815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.173246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.173254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.173678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.174153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.174160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.174666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.175048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.175058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.175605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.176108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.176118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.176671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.177133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.177143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.177674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.178175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.178186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.178728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.179185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.179199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.179647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.179973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.179981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.180606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.181109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.181119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.181683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.182138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.182148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.182697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.183204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.183215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.183765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.184266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.184281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.184710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.185169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.185180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.185637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.186124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.186132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.186720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.187221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.187232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.187843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.188488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.188517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.188973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.189539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.189567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.189787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.190202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.190211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.970 qpair failed and we were unable to recover it. 00:30:27.970 [2024-04-26 20:47:46.190647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.970 [2024-04-26 20:47:46.191131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.191138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.191701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.192201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.192211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.192670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.193150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.193159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.193719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.194069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.194080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.194650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.195111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.195121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.195534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.196036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.196048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.196506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.196755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.196769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.197255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.197731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.197739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.198209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.198644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.198652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.199118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.199677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.199705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.200159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.200632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.200661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.201135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.201697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.201726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.202198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.202667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.202695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.203173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.203616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.203625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.203975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.204561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.204590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.205061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.205641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.205669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.206123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.206596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.206626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.207055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.207634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.207663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.208120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.208667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.208696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.209170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.209711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.209740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.210175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.210621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.210630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.210783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.210994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.211001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.211342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.211814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.211821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.212287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.212715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.212723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.213193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.213636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.213645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.214108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.214670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.214699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.215160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.215621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.215630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.216103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.216634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.216663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.217134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.217663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.217691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.971 qpair failed and we were unable to recover it. 00:30:27.971 [2024-04-26 20:47:46.218172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.971 [2024-04-26 20:47:46.218732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.218761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.219215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.219676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.219684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.220152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.220675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.220704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.221181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.221626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.221654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.222072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.222603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.222631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.223091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.223621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.223649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.224091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.224565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.224593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.225064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.225517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.225546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.226015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.226546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.226575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.227021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.227553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.227582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.228015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.228586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.228614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.229094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.229628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.229656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.230127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.230692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.230721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.231176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.231729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.231758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.232077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.232608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.232636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.233108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.233692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.233720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.234068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.234581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.234609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.235065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.235595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.235623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.236095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.236622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.236650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.237131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.237669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.237698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.238031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.238596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.238624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.239061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.239608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.239636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.240112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.240675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.240704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.241174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.241722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.241750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.242190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.242674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.242683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.243129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.243668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.243696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.244130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.244676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.244705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.245181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.245692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.245720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.245938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.246362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.972 [2024-04-26 20:47:46.246371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.972 qpair failed and we were unable to recover it. 00:30:27.972 [2024-04-26 20:47:46.246825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.247308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.247316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.247653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.248093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.248100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.248546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.248898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.248905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.249343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.249807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.249815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.250252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.250587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.250595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.251105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.251638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.251666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.252020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.252565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.252594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.252940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.253408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.253416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.253867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.254352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.254360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.254846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.254935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.254946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.255375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.255804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.255811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.256282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.256597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.256606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.257067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.257485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.257492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.257914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.258263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.258270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.258609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.259072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.259081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.259640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.259891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.259904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.260372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.260763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.260771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.261244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.261424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.261434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.261880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.262360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.262368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.262723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.263073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.263081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.263536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.264007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.264014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.264489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.264969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.264976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.265542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.266050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.266060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.266617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.267119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.267130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.973 qpair failed and we were unable to recover it. 00:30:27.973 [2024-04-26 20:47:46.267676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.268187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.973 [2024-04-26 20:47:46.268197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.268730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.269200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.269210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.269689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.270126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.270133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.270691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.271193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.271203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.271767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.272273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.272290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.272862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.273491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.273521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.273991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.274481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.274510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.274989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.275522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.275550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.275998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.276533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.276561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.277031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.277603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.277632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.278104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.278665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.278694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.279047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.279643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.279671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.280018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.280614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.280643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.281119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.281529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.281558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.281988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.282515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.282544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.282757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.283219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.283228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.283675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.284099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.284106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.284669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.285095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.285105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.285733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.286237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.286247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.286811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.287283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.287293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.287802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.288266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.288283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.288838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.289455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.289484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.289957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.290486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.290515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.291019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.291503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.291532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.291985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.292551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.292579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.293036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.293615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.293644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.294111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.294682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.294711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.295181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.295417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.295429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.295759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.296205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.296214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.974 qpair failed and we were unable to recover it. 00:30:27.974 [2024-04-26 20:47:46.296675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.974 [2024-04-26 20:47:46.297150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.975 [2024-04-26 20:47:46.297158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.975 qpair failed and we were unable to recover it. 00:30:27.975 [2024-04-26 20:47:46.297585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.975 [2024-04-26 20:47:46.298088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.975 [2024-04-26 20:47:46.298099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.975 qpair failed and we were unable to recover it. 00:30:27.975 [2024-04-26 20:47:46.298558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.975 [2024-04-26 20:47:46.299011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.975 [2024-04-26 20:47:46.299021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.975 qpair failed and we were unable to recover it. 00:30:27.975 [2024-04-26 20:47:46.299559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.975 [2024-04-26 20:47:46.300031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.975 [2024-04-26 20:47:46.300041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.975 qpair failed and we were unable to recover it. 00:30:27.975 [2024-04-26 20:47:46.300612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.975 [2024-04-26 20:47:46.301072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:27.975 [2024-04-26 20:47:46.301082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:27.975 qpair failed and we were unable to recover it. 00:30:27.975 [2024-04-26 20:47:46.301630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.243 [2024-04-26 20:47:46.301984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.243 [2024-04-26 20:47:46.301995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.243 qpair failed and we were unable to recover it. 00:30:28.243 [2024-04-26 20:47:46.302554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.243 [2024-04-26 20:47:46.303057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.243 [2024-04-26 20:47:46.303068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.243 qpair failed and we were unable to recover it. 00:30:28.243 [2024-04-26 20:47:46.303614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.243 [2024-04-26 20:47:46.304118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.243 [2024-04-26 20:47:46.304129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.243 qpair failed and we were unable to recover it. 00:30:28.243 [2024-04-26 20:47:46.304690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.243 [2024-04-26 20:47:46.305194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.243 [2024-04-26 20:47:46.305208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.243 qpair failed and we were unable to recover it. 00:30:28.243 [2024-04-26 20:47:46.305749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.243 [2024-04-26 20:47:46.306257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.243 [2024-04-26 20:47:46.306268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.243 qpair failed and we were unable to recover it. 00:30:28.243 [2024-04-26 20:47:46.306837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.243 [2024-04-26 20:47:46.307470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.243 [2024-04-26 20:47:46.307498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.243 qpair failed and we were unable to recover it. 00:30:28.243 [2024-04-26 20:47:46.307815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.243 [2024-04-26 20:47:46.308300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.308308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.308744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.309215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.309223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.309680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.310029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.310038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.310337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.310773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.310781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.311228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.311618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.311625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.312094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.312318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.312331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.312744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.313221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.313228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.313660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.314131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.314142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.314684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.315141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.315151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.315704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.316062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.316072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.316606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.317073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.317083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.317718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.318259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.318271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.318739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.319195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.319206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.319751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.320219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.320230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.320585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.321043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.321054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.321625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.321993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.322003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.322591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.323057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.323066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.323667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.324135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.324148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.324692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.325163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.325173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.325611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.326046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.326054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.326617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.327078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.327088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.327628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.328129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.328139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.328701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.329201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.329212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.329751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.330210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.330221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.330765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.331187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.331197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.331608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.332046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.332055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.332611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.333120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.333130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.333691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.334191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.334204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.334748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.335208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.244 [2024-04-26 20:47:46.335219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.244 qpair failed and we were unable to recover it. 00:30:28.244 [2024-04-26 20:47:46.335796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.336265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.336275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.336714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.337068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.337079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.337603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.338061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.338071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.338609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.339069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.339079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.339600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.340107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.340118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.340719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.340967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.340981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.341466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.341814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.341823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.342283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.342647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.342655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.343091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.343661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.343690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.344034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.344590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.344619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.345088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.345644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.345672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.346126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.346697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.346725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.347197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.347725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.347754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.348184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.348634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.348642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.349107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.349626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.349654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.349990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.350559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.350587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.351119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.351571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.351599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.352032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.352605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.352633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.353103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.353566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.353594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.354036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.354608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.354636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.355106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.355556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.355585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.356050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.356612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.356641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.357111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.357677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.357706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.358164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.358583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.358613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.359093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.359612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.359640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.245 [2024-04-26 20:47:46.360071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.360613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.245 [2024-04-26 20:47:46.360641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.245 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.360978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.361508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.361536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.362003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.362582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.362611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.363088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.363557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.363585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.364089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.364617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.364646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.365115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.365667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.365695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.366013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.366573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.366601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.367068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.367644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.367672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.368143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.368691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.368720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.369190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.369677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.369706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.370165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.370519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.370527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.370962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.371439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.371447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.371913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.372391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.372399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.372863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.373335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.373343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.373792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.374263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.374271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.374740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.374937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.374946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.375391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.375867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.375874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.376063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.376410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.376418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.376771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.377078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.377085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.377512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.377991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.377998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.378467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.378941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.378948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.379414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.379885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.379892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.380337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.380772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.380780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.381246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.381614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.381622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.382059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.382549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.382578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.382928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.383428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.383436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.383821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.384145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.384154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.384629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.385070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.385077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.246 qpair failed and we were unable to recover it. 00:30:28.246 [2024-04-26 20:47:46.385642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.246 [2024-04-26 20:47:46.386113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.386122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.386651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.387120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.387130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.387677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.388044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.388054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.388592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.389101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.389112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.389637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.390095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.390105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.390328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.390809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.390818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.391168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.391734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.391763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.392220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.392733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.392762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.393110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.393668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.393697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.394165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.394716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.394745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.395190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.395635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.395644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.395864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.396210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.396218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.396665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.397144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.397152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.397561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.398020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.398028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.398471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.398903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.398911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.399352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.399827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.399835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.400336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.400741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.400749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.401214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.401654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.401662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.401873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.402330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.402338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.402808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.403286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.403294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.403740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.404215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.404222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.404431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.404906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.404915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.405390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.405834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.405841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.406281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.406704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.406712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.407177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.407689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.407697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.408123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.408586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.408615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.247 [2024-04-26 20:47:46.409084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.409635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.247 [2024-04-26 20:47:46.409663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.247 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.410025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.410638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.410668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.411134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.411702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.411730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.412212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.412701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.412729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.413183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.413540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.413549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.414012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.414579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.414607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.415043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.415622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.415651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.416120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.416665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.416693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.417045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.417618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.417647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.418120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.418667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.418696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.419205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.419503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.419531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.419974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.420580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.420609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.421107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.421685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.421714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.422068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.422602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.422631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.423105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.423635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.423663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.424095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.424636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.424665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.425118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.425626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.425654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.426121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.426637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.426666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.427136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.427689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.427718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.428163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.428722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.428751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.248 [2024-04-26 20:47:46.429220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.429763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.248 [2024-04-26 20:47:46.429792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.248 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.429996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.430484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.430492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.430975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.431580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.431609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.432076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.432623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.432651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.433097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.433637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.433665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.434103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.434655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.434683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.435151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.435716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.435745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.436095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.436651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.436680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.437128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.437684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.437712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.438181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.438622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.438652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.439132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.439683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.439711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.440179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.440725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.440753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.440976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.441445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.441455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.441935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.442416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.442424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.442780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.443260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.443267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.443739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.444173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.444180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.444539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.444798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.444806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.445149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.445693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.445701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.446128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.446594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.446622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.447092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.447673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.447701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.448150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.448696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.448726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.449161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.449713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.449742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.449981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.450414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.450423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.450903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.451337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.451345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.451657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.452134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.452142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.452609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.453084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.453092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.453669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.454053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.454063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.454584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.455089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.455099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.455645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.456152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.456163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.249 qpair failed and we were unable to recover it. 00:30:28.249 [2024-04-26 20:47:46.456531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.249 [2024-04-26 20:47:46.456999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.457008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.457480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.457975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.457988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.458558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.459056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.459066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.459606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.460063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.460074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.460608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.461071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.461081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.461651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.462155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.462165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.462642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.463078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.463085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.463644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.464099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.464109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.464678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.464925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.464938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.465423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.465865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.465873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.466339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.466811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.466818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.467263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.467607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.467618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.467851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.468320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.468327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.468805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.469282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.469291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.469743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.470219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.470226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.470664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.471141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.471149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.471725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.471993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.472007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.472567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.472923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.472933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.473436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.473919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.473926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.474241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.474723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.474731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.475203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.475458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.475467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.475929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.476474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.476506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.476982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.477338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.477346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.477802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.478125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.478133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.478581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.479067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.479074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.479588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.480043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.480053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.480620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.480872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.480886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.481368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.481813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.481821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.482275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.482711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.482719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.250 qpair failed and we were unable to recover it. 00:30:28.250 [2024-04-26 20:47:46.483059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.250 [2024-04-26 20:47:46.483589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.483617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.483965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.484415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.484423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.484883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.485318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.485326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.485795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.486285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.486292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.486732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.487208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.487215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.487424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.487880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.487888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.488336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.488816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.488823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.489288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.489763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.489770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.490242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.490430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.490440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.490876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.491353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.491361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.491803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.492129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.492137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.492613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.492839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.492849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.493305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.493717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.493724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.494201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.494612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.494620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.495061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.495537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.495544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.495971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.496448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.496457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.496933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.497470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.497498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.497941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.498416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.498424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.498766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.499205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.499212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.499570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.500035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.500042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.500511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.500999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.501006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.501462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.501963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.501973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.502542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.502995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.503005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.503481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.503967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.503975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.504530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.505034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.505044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.505614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.505841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.505855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.506093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.506526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.506535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.506994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.507385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.507394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.507866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.508341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.508349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.251 qpair failed and we were unable to recover it. 00:30:28.251 [2024-04-26 20:47:46.508818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.251 [2024-04-26 20:47:46.509294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.509302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.509749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.510226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.510233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.510599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.510940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.510947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.511389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.511822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.511829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.512146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.512617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.512625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.513065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.513626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.513654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.514124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.514712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.514741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.515216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.515645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.515673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.516150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.516713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.516741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.517194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.517727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.517756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.518250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.518671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.518700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.518915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.519342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.519351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.519836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.520304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.520312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.520756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.521229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.521236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.521695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.522178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.522185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.522616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.523088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.523095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.523652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.524157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.524167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.524531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.524883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.524890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.525362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.525824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.525832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.526194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.526630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.526638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.527060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.527537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.527544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.527989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.528214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.528227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.528551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.528979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.528987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.529415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.529856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.529864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.530330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.530806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.530813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.531259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.531724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.531732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.532195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.532639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.532646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.533116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.533539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.533569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.534039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.534572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.252 [2024-04-26 20:47:46.534601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.252 qpair failed and we were unable to recover it. 00:30:28.252 [2024-04-26 20:47:46.535045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.535568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.535598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.536002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.536529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.536558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.537012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.537485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.537514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.537848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.538155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.538163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.538623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.539099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.539107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.539582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.540009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.540018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.540587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.541091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.541101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.541646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.542150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.542159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.542631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.543108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.543117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.543675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.544181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.544191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.544722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.545182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.545192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.545635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.546110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.546117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.546653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.547116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.547126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.547551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.547934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.547944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.548538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.549046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.549055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.549620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.550102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.550112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.550528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.551037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.551048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.551585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.552091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.552101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.552683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.553188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.553198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.553621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.554126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.554136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.554668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.555122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.555133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.555696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.556081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.556091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.556559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.556883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.556895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.557452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.557955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.557965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.253 qpair failed and we were unable to recover it. 00:30:28.253 [2024-04-26 20:47:46.558418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.558731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.253 [2024-04-26 20:47:46.558739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.559087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.559547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.559556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.560023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.560546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.560574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.561047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.561619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.561648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.562099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.562661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.562690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.563141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.563632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.563660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.564085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.564662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.564690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.565164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.565618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.565647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.566092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.566670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.566700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.567058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.567566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.567594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.567822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.568271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.568292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.568742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.569098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.569105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.569644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.570149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.570159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.570636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.571111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.571119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.571674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.572140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.572150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.572715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.573083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.573094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.573642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.574098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.574108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.574684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.575149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.575159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.575696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.576198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.576208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.576658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.577133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.577141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.577675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.578179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.578189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.578735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.579209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.579220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.579659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.580019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.254 [2024-04-26 20:47:46.580027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.254 qpair failed and we were unable to recover it. 00:30:28.254 [2024-04-26 20:47:46.580581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.581085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.581096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.581635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.582137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.582147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.582645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.583137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.583147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.583687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.584181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.584192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.584734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.585195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.585206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.585733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.586234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.586245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.586575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.586932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.586944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.587425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.587862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.587870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.588231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.588702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.588710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.589152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.589708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.589736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.590132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.590665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.590693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.591130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.591701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.591729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.592200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.592746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.592774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.593211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.593665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.593694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.594166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.594644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.594652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.595128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.595615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.595643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.596081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.596662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.596690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.597132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.597557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.597585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.598056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.598583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.598615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.598967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.599520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.599549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.600020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.600548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.600577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.600914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.601229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.601237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.601705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.602179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.602187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.602645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.603075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.603083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.603611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.604116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.604126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.604672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.605132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.605142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.605574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.605931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.605942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.606513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.607017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.607027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.607594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.608094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.608108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.608645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.609150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.609160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.523 qpair failed and we were unable to recover it. 00:30:28.523 [2024-04-26 20:47:46.609637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.523 [2024-04-26 20:47:46.610077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.610085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.610618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.611127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.611137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.611558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.612050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.612061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.612771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.613235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.613245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.613847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.614488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.614517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.614739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.615187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.615196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.615655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.616129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.616137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.616676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.617187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.617197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.617656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.618025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.618035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.618614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.619119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.619130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.619669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.620173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.620183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.620727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.621230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.621240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.621803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.622491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.622520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.622987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.623569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.623598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.623912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.624399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.624407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.624854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.625283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.625290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.625744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.625929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.625940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.626247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.626694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.626703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.627167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.627627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.627638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.627953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.628538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.628566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.628921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.629371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.629379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.629687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.630116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.630124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.630565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.631049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.631056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.631578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.632082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.632092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.632521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.632978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.632988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.633519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.633975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.633985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.634539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.635002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.635013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.635477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.635981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.635991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.636475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.636954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.636962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.637519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.637997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.638007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.638576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.639003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.639013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.639519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.639857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.639865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.640293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.640672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.640680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.641147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.641599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.641606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.642079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.642613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.642642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.643089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.643525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.643553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.524 qpair failed and we were unable to recover it. 00:30:28.524 [2024-04-26 20:47:46.644027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.524 [2024-04-26 20:47:46.644599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.644627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.644961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.645492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.645520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.645974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.646458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.646467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.646958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.647549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.647577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.648052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.648627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.648655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.649119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.649675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.649705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.650177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.650479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.650488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.650920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.651356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.651365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.651814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.652248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.652255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.652753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.653185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.653194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.653614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.654088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.654097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.654316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.654799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.654807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.655283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.655826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.655854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.656485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.656955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.656965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.657503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.657874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.657884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.658485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.658951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.658961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.659428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.659750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.659757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.660191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.660531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.660539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.661021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.661455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.661462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.661908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.662389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.662397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.662823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.663251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.663258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.663700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.664175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.664184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.664640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.665071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.665079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.665519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.665904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.665914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.666354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.666845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.666852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.667362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.667714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.667722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.668195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.668610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.668618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.669104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.669524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.669532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.669954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.670486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.670514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.670871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.671324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.671332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.671786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.672242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.672250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.672778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.673168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.673175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.673637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.674111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.674119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.674344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.674771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.674780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.675256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.675729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.675738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.676183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.676437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.676446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.525 qpair failed and we were unable to recover it. 00:30:28.525 [2024-04-26 20:47:46.676924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.525 [2024-04-26 20:47:46.677404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.677412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.677807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.678178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.678185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.678527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.678987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.678994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.679431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.679782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.679790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.680121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.680591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.680600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.680947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.681417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.681425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.681759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.682233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.682240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.682702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.683144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.683152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.683560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.684024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.684034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.684577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.684959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.684969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.685539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.685999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.686008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.686459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.686941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.686949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.687551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.687910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.687919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.688380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.688857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.688864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.689299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.689781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.689789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.690232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.690682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.690689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.691155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.691718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.691748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.692221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.692758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.692787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.693240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.693800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.693829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.694284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.694614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.694641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.695127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.695665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.695694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.696124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.696701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.696730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.697201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.697729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.697757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.698212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.698751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.698780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.699300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.699671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.699679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.700107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.700578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.700586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.701054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.701582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.701611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.702065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.702613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.702642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.526 [2024-04-26 20:47:46.703115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.703686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.526 [2024-04-26 20:47:46.703715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.526 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.704148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.704680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.704708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.705179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.705712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.705740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.706087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.706527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.706556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.706991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.707559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.707588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.707920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.708390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.708399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.708873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.709304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.709312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.709763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.710235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.710244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.710707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.711181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.711189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.711632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.712109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.712117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.712629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.713089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.713099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.713657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.714161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.714171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.714625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.715017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.715025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.715569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.715949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.715959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.716515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.717017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.717027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.717572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.717917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.717928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.718395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.718872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.718880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.719344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.719811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.719818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.720289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.720736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.720744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.721185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.721627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.721637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.722136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.722593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.722601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.722914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.723097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.723108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.723551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.723942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.723949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.724406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.724836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.724843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.725311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.725745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.725752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.726219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.726655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.726663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.727126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.727662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.727690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.728041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.728576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.728605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.729036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.729503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.729532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.729999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.730524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.730553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.731028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.731591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.731619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.732075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.732596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.732625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.733098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.733625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.733654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.733821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.734246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.734255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.734727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.735210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.735217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.527 qpair failed and we were unable to recover it. 00:30:28.527 [2024-04-26 20:47:46.735435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.527 [2024-04-26 20:47:46.735860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.735869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.736348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.736812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.736820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.737287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.737721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.737728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.737981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.738442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.738450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.738891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.739367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.739375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.739820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.740256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.740263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.740709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.741100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.741109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.741668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.742136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.742146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.742552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.743057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.743067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.743489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.743863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.743873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.744344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.744823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.744831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.745173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.745626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.745633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.745983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.746456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.746463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.746931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.747410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.747418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.747876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.748239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.748251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.748472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.748822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.748831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.749293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.749707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.749715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.750164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.750619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.750627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.751090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.751515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.751523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.752002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.752568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.752596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.753054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.753584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.753613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.753968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.754298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.754307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.754734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.754953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.754964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.755398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.755851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.755858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.756302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.756723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.756734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.757201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.757531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.757539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.757869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.758329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.758337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.758804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.759166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.759173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.759526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.759988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.759996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.760460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.760940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.760948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.761422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.761776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.761784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.762215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.762659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.762667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.763112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.763644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.763672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.764142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.764669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.764698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.765168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.765603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.765614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.766085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.766652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.766680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.528 qpair failed and we were unable to recover it. 00:30:28.528 [2024-04-26 20:47:46.767133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.528 [2024-04-26 20:47:46.767689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.767718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.768074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.768664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.768693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.769039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.769519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.769547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.769978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.770557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.770585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.771042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.771551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.771580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.772010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.772552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.772581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.773049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.773517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.773546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.774029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.774629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.774659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.775114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.775664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.775696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.776016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.776496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.776526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.776952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.777512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.777541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.778014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.778587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.778615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.778967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.779338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.779346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.779802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.780274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.780290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.780740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.781091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.781099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.781536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.781893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.781903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.782364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.782846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.782854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.783328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.783813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.783821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.784030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.784440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.784448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.784916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.785387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.785395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.785839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.786314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.786322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.786788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.787221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.787229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.787674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.788110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.788117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.788557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.789030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.789038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.789255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.789793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.789821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.790301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.790827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.790836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.791304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.791698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.791705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.792173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.792443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.792452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.792771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.793236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.793243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.793711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.794187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.794194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.794627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.795101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.795109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.795648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.796149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.796159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.796506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.796956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.796964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.797421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.797852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.797859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.798295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.798719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.798726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.799194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.799506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.799514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.799964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.800328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.800336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.800793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.801268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.801275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.529 [2024-04-26 20:47:46.801736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.802209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.529 [2024-04-26 20:47:46.802216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.529 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.802665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.803139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.803146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.803516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.804022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.804034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.804607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.805063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.805073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.805657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.806116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.806126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.806695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.807150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.807160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.807669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.808050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.808061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.808581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.809084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.809095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.809661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.810166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.810177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.810635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.810817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.810828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.811275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.811711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.811719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.812187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.812528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.812536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.812998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.813561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.813589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.814060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.814617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.814646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.815101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.815615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.815643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.816108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.816679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.816707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.817138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.817673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.817702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.818168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.818711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.818740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.819089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.819652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.819681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.820161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.820572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.820582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.821053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.821617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.821645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.822080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.822657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.822686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.823145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.823685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.823715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.824042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.824603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.824632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.825103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.825680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.825709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.826182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.826703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.826732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.827184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.827627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.827636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.828099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.828646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.828674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.829152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.829692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.829721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.530 [2024-04-26 20:47:46.830198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.830704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.530 [2024-04-26 20:47:46.830733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.530 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.831186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.831681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.831690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.832163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.832632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.832641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.833061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.833243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.833256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.833780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.834029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.834043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.834488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.834969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.834978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.835447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.835892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.835900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.836238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.836685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.836693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.837146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.837668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.837697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.838151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.838578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.838607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.839081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.839607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.839636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.839872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.840453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.840482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.840830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.841307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.841316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.841778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.842197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.842205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.842666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.843142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.843150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.843706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.844197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.844207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.844742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.845181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.845189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.845654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.846089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.846098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.846655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.847113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.847123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.847687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.848148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.848158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.848635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.848989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.848999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.849301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.849707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.849715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.850191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.850662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.850670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.851136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.851676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.851704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.852173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.852592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.852599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.853043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.853605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.853635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.854103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.854682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.854711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.855143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.855702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.855731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.856071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.856613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.856641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.857093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.857494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.857522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.857995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.858553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.858581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.858898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.859381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.531 [2024-04-26 20:47:46.859390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.531 qpair failed and we were unable to recover it. 00:30:28.531 [2024-04-26 20:47:46.859610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.798 [2024-04-26 20:47:46.860085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.798 [2024-04-26 20:47:46.860095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.798 qpair failed and we were unable to recover it. 00:30:28.798 [2024-04-26 20:47:46.860320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.798 [2024-04-26 20:47:46.860742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.798 [2024-04-26 20:47:46.860750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.798 qpair failed and we were unable to recover it. 00:30:28.798 [2024-04-26 20:47:46.861088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.798 [2024-04-26 20:47:46.861579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.798 [2024-04-26 20:47:46.861608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.798 qpair failed and we were unable to recover it. 00:30:28.798 [2024-04-26 20:47:46.862079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.798 [2024-04-26 20:47:46.862657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.798 [2024-04-26 20:47:46.862685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.798 qpair failed and we were unable to recover it. 00:30:28.798 [2024-04-26 20:47:46.862846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.798 [2024-04-26 20:47:46.863275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.798 [2024-04-26 20:47:46.863298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.798 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.863713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.864039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.864048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.864601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.865102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.865113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.865680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.866133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.866144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.866699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.867205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.867215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.867758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.868012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.868026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.868610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.869081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.869091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.869658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.869905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.869917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.870416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.870871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.870879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.871371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.871848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.871855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.872298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.872712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.872720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.873188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.873599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.873607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.873791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.874239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.874247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.874588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.875062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.875069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.875411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.875893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.875900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.876369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.876825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.876833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.877301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.877633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.877641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.878084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.878542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.878550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.878875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.879333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.879341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.879819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.880292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.880300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.880719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.881189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.881197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.881644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.882130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.882138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.882298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.882614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.882621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.882966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.883433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.883441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.883914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.884274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.884287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.884627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.884973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.884980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.885417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.885895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.885903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.886374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.886812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.886819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.887281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.887710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.887717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.888164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.888630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.888638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.888984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.889477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.889506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.889982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.890420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.890428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.890897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.891372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.891380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.891868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.892304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.892312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.892758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.893116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.893124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.893629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.894103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.894111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.894666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.895133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.895146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.895547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.896011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.896022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.896596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.897099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.897109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.897673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.898050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.898060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.898602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.899103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.899114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.899663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.900165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.900175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.900508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.900879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.900888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.901368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.901825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.901833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.902307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.902742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.902749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.903086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.903423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.903430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.903881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.904309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.904319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.904798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.905289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.905298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.905744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.906181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.906188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.906650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.907122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.907130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.907691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.908156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.908166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.908441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.908768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.908776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.909245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.909715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.909722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.910165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.910349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.910361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.910788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.911264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.911272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.911715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.912189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.799 [2024-04-26 20:47:46.912198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.799 qpair failed and we were unable to recover it. 00:30:28.799 [2024-04-26 20:47:46.912621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.913097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.913108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.913641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.914142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.914153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.914721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.915181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.915190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.915635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.916134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.916145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.916693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.917196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.917207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.917740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.917982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.917993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.918450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.918932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.918940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.919160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.919592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.919601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.920079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.920554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.920561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.921079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.921553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.921582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.922063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.922674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.922703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.923179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.923627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.923635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.924106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.924578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.924607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.925066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.925639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.925669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.926143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.926609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.926637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.927107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.927679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.927707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.928184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.928729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.928757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.929221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.929807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.929835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.930266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.930832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.930860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.931480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.931984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.931993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.932215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.932617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.932626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.933078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.933542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.933570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.934037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.934509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.934537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.934883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.935325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.935333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.935778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.936233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.936241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.936669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.937094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.937102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.937666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.938057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.938067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.938590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.939094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.939105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.939651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.940007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.940017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.940550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.941023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.941033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.941598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.942061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.942071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.942646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.943107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.943117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.943678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.944132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.944142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.944548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.945038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.945050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.945632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.946139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.946149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.946572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.947077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.947087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.947687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.948061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.948071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.948635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.949027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.949037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.949467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.949947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.949957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.950533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.950780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.950794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.951242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.951644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.951652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.952106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.952619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.952649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.953152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.953574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.953603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.954082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.954659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.954688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.955161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.955618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.955627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.956068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.956609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.956638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.957071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.957649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.957679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.958117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.958685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.958714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.959182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.959728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.959757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.960254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.960797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.960826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.961304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.961665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.961673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.962195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.962621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.962629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.963063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.963627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.963655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.964110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.964661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.964690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.800 qpair failed and we were unable to recover it. 00:30:28.800 [2024-04-26 20:47:46.965160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.965638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.800 [2024-04-26 20:47:46.965646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.966111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.966550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.966578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.967094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.967594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.967623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.968073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.968613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.968642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.969110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.969683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.969712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.970059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.970633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.970662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.971132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.971663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.971692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.972150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.972592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.972621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.972875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.973467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.973495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.973929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.974413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.974422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.974760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.975194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.975202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.975644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.976118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.976126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.976665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.977168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.977178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.977635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.977993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.978001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.978202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.978657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.978665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.979108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.979627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.979655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.980087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.980524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.980553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.981024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.981553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.981581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.982017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.982582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.982611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.983064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.983643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.983671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.984147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.984664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.984693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.985121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.985696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.985725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.986163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.986758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.986786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.987239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.987533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.987562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.988038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.988608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.988637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.989079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.989650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.989679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.990145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.990712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.990740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.991192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.991727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.991755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.992191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.992623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.992632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.993147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.993559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.993588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.994075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.994600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.994630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.995081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.995507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.995536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.996012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.996578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.996606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.996989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.997484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.997512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.997983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.998558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.998586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:46.999037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.999604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:46.999633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:47.000104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.000654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.000683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:47.001158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.001626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.001635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:47.002136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.002657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.002687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:47.003144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.003700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.003729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:47.004159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.004694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.004723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:47.005152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.005722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.005751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:47.006169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.006711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.006739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:47.007086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.007635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.007663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:47.008124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.008665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.008694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:47.009168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.009731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.009759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:47.010229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.010720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.010749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:47.011200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.011530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.801 [2024-04-26 20:47:47.011539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.801 qpair failed and we were unable to recover it. 00:30:28.801 [2024-04-26 20:47:47.011974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.012564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.012593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.013067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.013587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.013615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.014081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.014565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.014594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.015046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.015622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.015651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.015982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.016495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.016523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.016990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.017560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.017589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.018061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.018586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.018615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.018831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.019286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.019295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.019740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.019917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.019926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.020330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.020793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.020802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.021142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.021580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.021587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.021921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.022264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.022272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.022723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.023190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.023198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.023446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.023919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.023927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.024501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.024969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.024979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.025424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.025851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.025859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.026198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.026642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.026651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.027117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.027671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.027699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.028131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.028691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.028719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.029174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.029738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.029766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.030236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.030765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.030794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.031132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.031610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.031638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.032119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.032560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.032588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.033042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.033616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.033644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.034112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.034690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.034718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.034933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.035394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.035403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.035894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.036576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.036589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.037032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.037600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.037629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.038100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.038553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.038582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.039063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.039631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.039663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.040134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.040683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.040712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.041158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.041584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.041613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.042087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.042546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.042575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.043030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.043602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.043631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.044102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.044610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.044639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.045133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.045686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.045715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.046516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.047064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.047076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.047553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.047911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.047919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.048394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.048830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.048838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.049293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.049742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.049751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.050217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.050628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.050637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.051100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.051539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.051548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.051917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.052502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.052530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.052985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.053352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.053360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.054379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.054851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.054860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.055088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.055535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.055544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.056016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.056446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.056454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.056896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.057369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.057378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.057818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.058303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.058311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.058788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.059220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.059232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.059673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.060104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.060111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.060662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.061166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.061176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.061637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.061999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.062007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.062570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.063028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.063038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.802 [2024-04-26 20:47:47.063599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.064102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.802 [2024-04-26 20:47:47.064113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.802 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.064657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.065041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.065052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.065584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.066047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.066056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.066615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.067163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.067178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.067652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.067945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.067953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.068380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.068852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.068862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.069215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.069619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.069627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.070098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.070538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.070547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.071017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.071196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.071207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.071628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.072072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.072081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.072528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.073004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.073011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.073362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.074512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.074527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.074996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.075762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.075777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.076116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.076583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.076592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.077088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.077541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.077550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.078064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.078565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.078594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.079046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.079651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.079680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.080135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.080652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.080681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.080905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.081293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.081303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.081756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.082232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.082240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.082782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.083255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.083265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.083814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.084299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.084318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.084791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.085257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.085264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.085717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.086205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.086212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.086824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.087453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.087482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.087934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.088525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.088553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.088770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.089239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.089247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.089669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.090152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.090160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.090548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.091051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.091062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.091621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.091965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.091976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.092468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.092928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.092938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.093441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.093904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.093912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.094359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.094808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.094816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.095247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.095704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.095712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.096077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.096582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.096611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.097087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.097471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.097480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.097949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.098538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.098567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.099023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.099250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.099261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.099694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.100134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.100142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.100710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.101216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.101226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.101777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.102301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.102320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.102777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.103210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.103218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.103673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.104150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.104157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.104721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.105182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.105192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.105542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.105914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.105924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.106392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.106844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.106852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.107185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.107673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.107681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.108163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.108597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.108605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.109070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.109535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.109564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.110052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.110624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.110653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.803 qpair failed and we were unable to recover it. 00:30:28.803 [2024-04-26 20:47:47.111123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.111659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.803 [2024-04-26 20:47:47.111687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.112155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.112692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.112720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.113194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.113716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.113744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.114198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.114525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.114534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.115019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.115484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.115512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.115992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.116524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.116554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.117026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.117500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.117528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.117985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.118471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.118480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.118958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.119493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.119522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.119964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.120454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.120462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.120796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.121228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.121236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.121599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.122052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.122059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.122482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.123001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.123011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.123564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.123896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.123906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.124387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.124817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.124825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.125176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.125647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.125655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.126140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.126694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.126723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.127186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.127533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.127542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.127914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.128263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.128270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.128730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.129096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.129103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.129645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.130139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.130150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.130716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.131219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.131229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.131571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.132038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.132048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.132589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.133072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.133082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.133551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.134013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.134023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.134249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.134746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:28.804 [2024-04-26 20:47:47.134755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:28.804 qpair failed and we were unable to recover it. 00:30:28.804 [2024-04-26 20:47:47.135235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.135805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.135833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.071 qpair failed and we were unable to recover it. 00:30:29.071 [2024-04-26 20:47:47.136287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.136812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.136840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.071 qpair failed and we were unable to recover it. 00:30:29.071 [2024-04-26 20:47:47.137300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.137801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.137809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.071 qpair failed and we were unable to recover it. 00:30:29.071 [2024-04-26 20:47:47.138286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.138735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.138742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.071 qpair failed and we were unable to recover it. 00:30:29.071 [2024-04-26 20:47:47.139268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.139818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.139847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.071 qpair failed and we were unable to recover it. 00:30:29.071 [2024-04-26 20:47:47.140469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.140983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.140993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.071 qpair failed and we were unable to recover it. 00:30:29.071 [2024-04-26 20:47:47.141615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.142077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.142088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.071 qpair failed and we were unable to recover it. 00:30:29.071 [2024-04-26 20:47:47.142541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.142905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.142916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.071 qpair failed and we were unable to recover it. 00:30:29.071 [2024-04-26 20:47:47.143539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.143996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.144006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.071 qpair failed and we were unable to recover it. 00:30:29.071 [2024-04-26 20:47:47.144571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.144930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.144940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.071 qpair failed and we were unable to recover it. 00:30:29.071 [2024-04-26 20:47:47.145378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.071 [2024-04-26 20:47:47.145858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.145866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.146094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.146489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.146497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.146947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.147419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.147426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.147840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.148284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.148292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.148815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.149219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.149226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.149766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.150231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.150242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.150790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.151291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.151302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.151755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.152230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.152237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.152707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.153201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.153211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.153770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.154247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.154258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.154840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.155490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.155518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.155845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.156479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.156507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.157001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.157469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.157498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.157960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.158270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.158283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.158745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.159182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.159190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.159745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.160221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.160231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.160695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.161114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.161122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.161705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.162179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.162189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.162487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.162791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.162799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.163251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.163662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.163670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.164087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.164552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.164560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.165032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.165618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.165646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.166118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.166663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.166691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.167152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.167707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.167735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.168185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.168614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.168642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.169127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.169586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.169614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.170064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.170607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.170637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.171095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.171616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.171645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.172101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.172628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.072 [2024-04-26 20:47:47.172656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.072 qpair failed and we were unable to recover it. 00:30:29.072 [2024-04-26 20:47:47.173059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.173546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.173574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.173960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.174495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.174523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.174881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.175367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.175376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.175838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.176206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.176213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.176655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.177172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.177180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.177593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.177937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.177945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.178405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.178840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.178848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.179324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.179747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.179754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.179975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.180464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.180472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.180822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.181254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.181261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.181595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.182077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.182085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.182541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.182981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.182988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.183568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.184078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.184088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.184560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.185058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.185069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.185625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.186140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.186152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.186470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.186915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.186923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.187393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.187872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.187879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.188363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.188853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.188860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.189308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.189643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.189651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.190060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.190551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.190559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.191044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.191547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.191555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.191871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.192358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.192369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.192813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.193262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.193270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.193716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.194151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.194159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.194716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.195208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.195219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.195772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.196260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.196271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.196855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.197496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.197525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.197959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.198550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.198579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.073 qpair failed and we were unable to recover it. 00:30:29.073 [2024-04-26 20:47:47.198932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.073 [2024-04-26 20:47:47.199510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.199538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.200000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.200311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.200319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.200795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.201284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.201292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.201839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.202274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.202289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.202832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.203300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.203318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.203695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.204157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.204166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.204459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.204947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.204955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.205439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.205870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.205878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.206345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.206751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.206758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.207234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.207493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.207502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.207946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.208253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.208260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.208748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.209059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.209067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.209599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.210045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.210055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.210593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.211098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.211111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.211644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.212034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.212044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.212604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.213037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.213048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.213594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.214081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.214091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.214676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.215068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.215078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.215528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.215873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.215884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.216454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.216813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.216821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.217291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.217731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.217739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.218185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.218403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.218415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.218752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.219224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.219231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.219685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.220164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.220175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.220641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.221120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.221128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.221681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.222160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.222170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.222398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.222894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.222903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.223393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.223869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.223877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.224366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.224812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.074 [2024-04-26 20:47:47.224821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.074 qpair failed and we were unable to recover it. 00:30:29.074 [2024-04-26 20:47:47.225220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.225667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.225676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.226122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.226680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.226709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.227186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.227682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.227691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.228146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.228695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.228723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.229174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.229812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.229840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.230184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.230586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.230595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.231021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.231622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.231650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.232128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.232727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.232755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.233203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.233716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.233745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.234201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.234682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.234711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.235199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.235438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.235447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.235963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.236368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.236376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.236866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.237287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.237294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.237762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.238190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.238197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.238645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.239108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.239116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.239447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.239911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.239920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.240387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.240858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.240866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.241314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.241745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.241752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.242096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.242449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.242463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.242881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.243402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.243410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.243880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.244349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.244356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.244791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.245265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.245272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.245739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.246189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.246197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.246594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.247064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.247071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.247529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.247982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.247993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.248591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.249054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.249064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.249667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.250053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.250063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.250628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.251165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.251175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.075 [2024-04-26 20:47:47.251708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.252159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.075 [2024-04-26 20:47:47.252166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.075 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.252659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.253141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.253150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.253703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.254155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.254165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.254748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.255094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.255105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.255568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.255948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.255958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.256530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.256988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.256998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.257464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.257966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.257977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.258454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.258910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.258918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.259379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.259726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.259734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.260197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.260536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.260544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.261001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.261447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.261455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.261914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.262363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.262370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.262873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.263308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.263316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.263778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.264233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.264240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.264489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.264945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.264952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.265172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.265522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.265531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.265978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.266399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.266407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.266872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.267204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.267212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.267678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.268116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.268124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.268689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.269170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.269180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.269725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.270096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.270103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.270578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.271062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.271072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.271603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.272026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.272036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.272590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.273073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.076 [2024-04-26 20:47:47.273083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.076 qpair failed and we were unable to recover it. 00:30:29.076 [2024-04-26 20:47:47.273632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.274096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.274106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.274627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.274985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.274995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.275559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.276033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.276043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.276627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.276995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.277006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.277458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.277964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.277974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.278432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.278885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.278893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.279369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.279842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.279849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.280323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.280803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.280812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.281293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.281755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.281763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.282237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.282699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.282707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.283050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.283268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.283286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.283750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.284155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.284162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.284606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.284980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.284989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.285551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.286039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.286049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.286628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.286999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.287009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.287560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.288044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.288054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.288606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.289101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.289111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.289543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.290064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.290074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.290625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.291131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.291141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.291719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.292095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.292105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.292645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.293023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.293033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.293579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.294044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.294054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.294604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.295086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.295097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.295665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.296173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.296185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.296499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.296979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.296987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.297549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.298062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.298072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.298643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.299138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.299148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.299706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.300170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.300181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.077 qpair failed and we were unable to recover it. 00:30:29.077 [2024-04-26 20:47:47.300769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.301256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.077 [2024-04-26 20:47:47.301266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.301656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.302019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.302027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.302599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.303104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.303115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.303603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.303842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.303855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.304293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.304733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.304741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.305203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.305563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.305571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.305904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.306336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.306344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.306839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.307318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.307326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.307780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.308178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.308186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.308536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.308969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.308977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.309465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.309899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.309908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.310222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.310479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.310490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.310948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.311410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.311418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.311878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.312330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.312339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.312855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.313226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.313234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.313767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.314177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.314186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.314596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.314966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.314974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.315325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.315770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.315778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.316244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.316613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.316621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.317085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.317707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.317736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.318077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.318556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.318584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.319042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.319580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.319609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.320068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.320564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.320592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.321034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.321585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.321614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.322076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.322313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.322323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.322803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.323273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.323287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.323818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.324188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.324199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.324756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.325007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.325020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.078 qpair failed and we were unable to recover it. 00:30:29.078 [2024-04-26 20:47:47.325482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.325936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.078 [2024-04-26 20:47:47.325945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.326506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.327003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.327013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.327632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.328142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.328152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.328785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.329259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.329269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.329815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.330478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.330506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.330968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.331300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.331316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.331750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.332228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.332235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.332699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.333130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.333141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.333650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.334120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.334131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.334584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.335033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.335044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.335591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.336086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.336096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.336668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.336978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.336989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.337487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.337949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.337959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.338462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.338956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.338966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.339448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.339928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.339936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.340297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.340713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.340720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.341190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.341627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.341635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.341980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.342444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.342456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.342928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.343360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.343368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.343702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.344145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.344153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.344373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.344795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.344803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.345249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.345721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.345730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.346194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.346649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.346656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.347102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.347698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.347726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.348201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.348628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.348656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.349110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.349568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.349595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.350044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.350622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.350652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.351143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.351723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.351755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.352104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.352583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.352612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.079 qpair failed and we were unable to recover it. 00:30:29.079 [2024-04-26 20:47:47.353076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.079 [2024-04-26 20:47:47.353566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.353594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.354067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.354492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.354521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.354972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.355566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.355595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.356049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.356559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.356588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.356948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.357171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.357181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.357656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.358148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.358157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.358654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.359164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.359175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.359294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.359757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.359765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.360100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.360613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.360624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.361058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.361601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.361629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.362105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.362555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.362585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.363051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.363539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.363568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.363930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.364448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.364456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.364884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.365242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.365249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.365624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.365990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.365998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.366538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.367007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.367018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.367589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.367938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.367949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.368418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.368752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.368759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.368984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.369441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.369449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.369888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.370338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.370346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.370792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.371107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.371114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.371522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.371898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.371906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.372390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.372842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.372849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.373298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.373721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.373729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.080 qpair failed and we were unable to recover it. 00:30:29.080 [2024-04-26 20:47:47.374174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.080 [2024-04-26 20:47:47.374673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.374681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.375141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.375611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.375618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.376087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.376560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.376588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.376777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.377206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.377214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.377677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.378150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.378157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.378697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.379128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.379137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.379685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.380158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.380169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.380616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.381075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.381083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.381546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.382007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.382018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.382555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.382941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.382951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.383556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.384048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.384058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.384627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.385014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.385024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.385574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.386066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.386077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.386633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.387131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.387141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.387551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.388031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.388042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.388616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.389092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.389102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.389664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.390174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.390184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.390609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.390994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.391004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.391477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.391929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.391937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.392516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.393026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.393035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.393509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.393997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.394007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.394480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.394969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.394980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.395457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.395915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.395923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.396391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.396945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.396952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.397531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.397985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.397995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.398483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.398825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.398833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.399307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.399678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.399686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.400156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.400588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.400596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.401051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.401610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.401640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.081 qpair failed and we were unable to recover it. 00:30:29.081 [2024-04-26 20:47:47.402111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.081 [2024-04-26 20:47:47.402575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.082 [2024-04-26 20:47:47.402603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.082 qpair failed and we were unable to recover it. 00:30:29.082 [2024-04-26 20:47:47.403079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.082 [2024-04-26 20:47:47.403632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.082 [2024-04-26 20:47:47.403660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.082 qpair failed and we were unable to recover it. 00:30:29.082 [2024-04-26 20:47:47.404116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.082 [2024-04-26 20:47:47.404605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.082 [2024-04-26 20:47:47.404634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.082 qpair failed and we were unable to recover it. 00:30:29.082 [2024-04-26 20:47:47.404969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.082 [2024-04-26 20:47:47.405504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.082 [2024-04-26 20:47:47.405533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.082 qpair failed and we were unable to recover it. 00:30:29.082 [2024-04-26 20:47:47.405974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.082 [2024-04-26 20:47:47.406506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.082 [2024-04-26 20:47:47.406534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.082 qpair failed and we were unable to recover it. 00:30:29.082 [2024-04-26 20:47:47.406972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.082 [2024-04-26 20:47:47.407450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.082 [2024-04-26 20:47:47.407458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.082 qpair failed and we were unable to recover it. 00:30:29.082 [2024-04-26 20:47:47.407945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.082 [2024-04-26 20:47:47.408363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.082 [2024-04-26 20:47:47.408372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.082 qpair failed and we were unable to recover it. 00:30:29.082 [2024-04-26 20:47:47.408844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.409073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.409087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.349 qpair failed and we were unable to recover it. 00:30:29.349 [2024-04-26 20:47:47.409555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.410024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.410032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.349 qpair failed and we were unable to recover it. 00:30:29.349 [2024-04-26 20:47:47.410199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.410540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.410549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.349 qpair failed and we were unable to recover it. 00:30:29.349 [2024-04-26 20:47:47.410978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.411451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.411459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.349 qpair failed and we were unable to recover it. 00:30:29.349 [2024-04-26 20:47:47.411917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.412274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.412293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.349 qpair failed and we were unable to recover it. 00:30:29.349 [2024-04-26 20:47:47.412636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.413085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.413093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.349 qpair failed and we were unable to recover it. 00:30:29.349 [2024-04-26 20:47:47.413645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.414154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.414163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.349 qpair failed and we were unable to recover it. 00:30:29.349 [2024-04-26 20:47:47.414477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.414884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.349 [2024-04-26 20:47:47.414891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.349 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.415253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.415728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.415736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.416207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.416660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.416668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.417146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.417744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.417771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.418249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.418731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.418759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.419213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.419589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.419617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.420088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.420553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.420581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.421086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.421630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.421659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.422150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.422613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.422642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.423098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.423567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.423596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.423932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.424292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.424302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.424731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.425082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.425089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.425534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.426017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.426025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.426489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.426948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.426958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.427566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.428035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.428045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.428522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.428983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.428994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.429445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.429933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.429942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.430515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.430901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.430911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.431370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.431745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.431753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.432185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.432512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.432521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.432749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.433113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.433122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.433453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.433888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.433896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.434337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.434793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.434801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.435265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.435794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.435802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.436232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.436417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.436429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.436831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.437291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.437299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.437747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.438174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.438182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.438716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.439140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.439148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.439603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.440026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.440034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.350 qpair failed and we were unable to recover it. 00:30:29.350 [2024-04-26 20:47:47.440559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.350 [2024-04-26 20:47:47.440816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.440830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.441305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.441752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.441760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.442195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.442639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.442647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.443098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.443560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.443569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.444026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.444612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.444641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.445098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.445572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.445601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.446074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.446644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.446672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.447096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.447577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.447606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.448046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.448568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.448597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.449027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.449490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.449519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.449989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.450527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.450562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.450997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.451479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.451507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.451859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.452207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.452215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.452677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.453074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.453082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.453548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.453889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.453900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.454326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.454799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.454808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.455254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.455674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.455682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.456123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.456622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.456651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.457111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.457623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.457652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.458012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.458379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.458388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.458754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.459071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.459078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.459538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.459853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.459860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.460292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.460747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.460754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.461100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.461410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.461418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.461809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.462198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.462206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.462593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.463028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.463036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.463392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.463871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.463878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.464348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.464799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.464806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.465265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.465678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.351 [2024-04-26 20:47:47.465688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.351 qpair failed and we were unable to recover it. 00:30:29.351 [2024-04-26 20:47:47.466004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.466472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.466481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.466909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.467296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.467304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.467683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.468082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.468090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.468485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.468907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.468915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.469383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.469867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.469874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.470115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.470514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.470522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.470954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.471267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.471275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.471759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.472165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.472173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.472739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.473181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.473192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.473538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.473730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.473742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.474198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.474534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.474542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.474989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.475391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.475399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.475834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.476279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.476287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.476662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.477089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.477096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.477533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.477976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.477989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.478568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.479028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.479038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.479617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.479890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.479900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.480366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.480699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.480707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.480927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.481343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.481352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.481830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.482305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.482312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.482638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.483078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.483085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.483554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.483908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.483916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.484355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.484689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.484698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.485154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.485479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.485487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.485948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.486382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.486393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.486863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.487340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.487349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.487789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.488264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.488271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.488714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.489030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.489038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.352 [2024-04-26 20:47:47.489441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.489899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.352 [2024-04-26 20:47:47.489909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.352 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.490374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.490810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.490818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.491161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.491629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.491637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.492090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.492618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.492647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.493128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.493698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.493727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.494170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.494618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.494647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.495090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.495500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.495531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.496030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.496520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.496548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.497018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.497548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.497576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.498050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.498619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.498648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.498985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.499548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.499577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.500036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.500565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.500594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.501167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.501607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.501616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.502081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.502623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.502652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.503154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.503551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.503580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.504044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.504618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.504647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.505081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.505637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.505670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.506132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.506689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.506718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.507193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.507759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.507787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.508265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.508816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.508844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.509289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.509673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.509682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.510070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.510318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.510327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.510800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.511221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.511229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.511705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.512127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.512136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.512678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.513178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.513188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.513649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.514085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.514093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.514623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.515128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.515139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.515570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.515940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.515951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.516519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.516887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.516897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.353 qpair failed and we were unable to recover it. 00:30:29.353 [2024-04-26 20:47:47.517380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.353 [2024-04-26 20:47:47.517748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.354 [2024-04-26 20:47:47.517756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.354 qpair failed and we were unable to recover it. 00:30:29.354 [2024-04-26 20:47:47.518202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.354 [2024-04-26 20:47:47.518653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.354 [2024-04-26 20:47:47.518661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.354 qpair failed and we were unable to recover it. 00:30:29.354 [2024-04-26 20:47:47.519011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.354 [2024-04-26 20:47:47.519432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.354 [2024-04-26 20:47:47.519441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.354 qpair failed and we were unable to recover it. 00:30:29.354 [2024-04-26 20:47:47.519917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.354 [2024-04-26 20:47:47.520401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.354 [2024-04-26 20:47:47.520410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.354 qpair failed and we were unable to recover it. 00:30:29.354 [2024-04-26 20:47:47.520855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.354 [2024-04-26 20:47:47.521326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.354 [2024-04-26 20:47:47.521335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.354 qpair failed and we were unable to recover it. 00:30:29.354 [2024-04-26 20:47:47.521796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.354 [2024-04-26 20:47:47.522241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.354 [2024-04-26 20:47:47.522249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.522624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.523104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.523112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.523562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.524078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.524089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.524652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.525022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.525033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.525589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.525972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.525983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.526557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.527056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.527067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.527306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.527800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.527810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.528281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.528842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.528871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.529288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.529873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.529902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.530217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.530850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.530879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.531231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.531691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.531720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.532163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.532445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.532454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.532892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.533283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.533291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.533716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.534154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.534162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.534619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.535067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.535074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.535680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.536153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.536164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.355 qpair failed and we were unable to recover it. 00:30:29.355 [2024-04-26 20:47:47.536683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.355 [2024-04-26 20:47:47.537122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.537130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.537597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.538019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.538029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.538606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.539000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.539010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.539513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.539901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.539911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.540248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.540553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.540562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.541011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.541562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.541591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.542023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.542509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.542537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.543007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.543547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.543576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.544025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.544568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.544596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.544918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.545332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.545340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.545672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.545899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.545910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.546365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.546848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.546856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.547313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.547756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.547764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.548272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.548781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.548789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.549137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.549545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.549573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.550032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.550534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.550562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.550901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.551332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.551340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.551802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.552169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.552176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.552529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.552980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.552987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.553483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.553926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.553934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.554400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.554896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.554903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.555099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.555533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.555541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.556012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.556524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.556552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.557025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.557508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.557536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.557892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.558345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.558354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.558765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.559246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.559254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.559371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.559733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.559742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.560224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.560493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.560501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.560849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.561335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.561342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.356 qpair failed and we were unable to recover it. 00:30:29.356 [2024-04-26 20:47:47.561776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.356 [2024-04-26 20:47:47.562245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.562252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.562704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.563002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.563010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.563213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.563539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.563546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.563985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.564490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.564498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.564937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.565313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.565321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.565795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.566146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.566154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.566697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.567049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.567057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.567709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.568170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.568180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.568664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.569131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.569139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.569682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.570130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.570140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.570697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.571063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.571073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.571583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.571980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.571991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.572559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.573042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.573052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.573633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.574113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.574123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.574599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.575109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.575120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.575585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.576090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.576100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.576612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.577097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.577107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.577672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.578158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.578168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.578712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.579050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.579061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.579500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.580049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.580059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.580638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.581132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.581142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.581595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.581849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.581864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.582243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.582605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.582613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.583026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.583600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.583628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.584089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.584624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.584652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.585131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.585615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.585644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.586085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.586638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.586666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.587140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.587583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.587612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.587974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.588513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.588542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.357 qpair failed and we were unable to recover it. 00:30:29.357 [2024-04-26 20:47:47.588878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.357 [2024-04-26 20:47:47.589349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.589357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.589830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.590206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.590213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.590671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.591113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.591121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.591666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.592162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.592173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.592615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.592936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.592945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.593333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.593837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.593845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.594324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.594859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.594866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.595293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.595723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.595731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.596034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.596473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.596481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.596964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.597371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.597380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.597626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.597955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.597963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.598415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.598864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.598872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.599342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.599679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.599687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.600163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.600490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.600497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.600857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.601223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.601230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.601718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.602129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.602136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.602587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.603044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.603053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.603609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.604088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.604098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.604742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.605091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.605100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.605575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.605912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.605922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.606267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.606735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.606744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.607141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.607685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.607713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.608184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.608718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.608747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.609215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.609783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.609812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.610494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.610954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.610964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.611498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.611848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.611859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.612337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.612800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.612809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.613154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.613369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.613381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.613834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.614313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.614321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.358 qpair failed and we were unable to recover it. 00:30:29.358 [2024-04-26 20:47:47.614788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.358 [2024-04-26 20:47:47.615071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.615078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.615543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.615988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.615995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.616424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.616772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.616780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.617220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.617686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.617694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.618129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.618732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.618761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.618902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.619354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.619363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.619871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.620356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.620364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.620830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.621266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.621274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.621733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.622213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.622221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.622692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.623143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.623151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.623565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.624030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.624043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.624515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.625012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.625022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.625595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.626100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.626110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.626584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.626828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.626841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.627320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.627813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.627821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.628300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.628668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.628676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.629135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.629451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.629458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.629902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.630391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.630398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.630851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.631294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.631303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.631655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.632016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.632023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.632238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.632487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.632499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.632854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.633315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.633322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.633802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.634240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.634247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.634645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.635083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.635090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.359 [2024-04-26 20:47:47.635568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.636003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.359 [2024-04-26 20:47:47.636010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.359 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.636493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.636741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.636754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.637252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.637601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.637610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.638057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.638514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.638521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.638840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.639198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.639206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.639548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.640003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.640011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.640546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.640968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.640979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.641498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.641977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.641987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.642575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.643072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.643082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.643640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.644135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.644144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.644698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.645078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.645089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.645651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.646107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.646117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.646654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.647186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.647196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.647746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.648257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.648267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.648640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.649078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.649086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.649581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.649925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.649936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.650531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.650991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.651004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.651482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.651968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.651978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.652333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.652856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.652864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.653307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.653786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.653793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.654304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.654791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.654799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.655268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.655618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.655626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.656072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.656390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.656400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.656833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.657267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.657275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.657635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.658074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.658081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.658632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.659159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.659170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.659700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.660181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.660189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.660647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.661091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.661099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.661656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.662159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.662168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.360 qpair failed and we were unable to recover it. 00:30:29.360 [2024-04-26 20:47:47.662751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.360 [2024-04-26 20:47:47.663260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.663270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.663445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.663823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.663832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.664308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.664768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.664776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.665121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.665493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.665501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.665964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.666440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.666448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.666805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.667245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.667252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.667711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.668141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.668149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.668630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.669083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.669093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.669561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.670034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.670044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.670601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.671099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.671110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.671675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.672058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.672068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.672492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.673020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.673030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.673641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.674100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.674110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.674588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.675083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.675093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.675571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.676053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.676064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.676634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.676977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.676988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.677576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.678051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.678061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.678632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.679116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.679128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.679612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.680149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.680159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.680599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.681035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.681043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.681620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.682068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.682078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.682524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.683003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.683014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.683558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.684058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.684068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.684669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.685141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.685151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.685738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.686232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.361 [2024-04-26 20:47:47.686243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.361 qpair failed and we were unable to recover it. 00:30:29.361 [2024-04-26 20:47:47.686740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.687218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.687231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.687811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.688283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.688294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.688815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.689497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.689526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.689951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.690556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.690584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.690825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.691289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.691299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.691746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.692145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.692152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.692618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.693092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.693100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.693642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.694120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.694130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.694724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.695107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.695117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.695566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.696064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.696076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.696555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.697028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.697039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.697653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.697877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.697886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.698129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.698477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.698485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.698841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.699154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.699162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.699627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.700103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.700112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.700670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.701128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.701138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.701596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.702094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.702104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.702661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.703164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.703173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.633 qpair failed and we were unable to recover it. 00:30:29.633 [2024-04-26 20:47:47.703649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.704095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.633 [2024-04-26 20:47:47.704104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.704624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.705113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.705124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.705707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.706186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.706196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.706737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.707236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.707246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.707773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.708495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.708523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.708938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.709515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.709543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.710006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.710579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.710607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.711080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.711657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.711685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.712138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.712590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.712619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.713093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.713569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.713599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.713930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.714507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.714535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.714884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.715226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.715234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.715717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.716158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.716167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.716558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.717037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.717045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.717591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.717810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.717822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.718182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.718535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.718543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.718978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.719415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.719423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.719880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.720304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.720312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.720780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.721193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.721201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.721628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.721986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.721993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.722451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.722884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.722892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.723204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.723576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.723584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.724059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.724452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.724460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.724931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.725321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.725328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.725797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.726228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.726235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.726613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.726969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.726977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.727424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.727835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.727844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.728316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.728801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.728808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.729266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.729706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.634 [2024-04-26 20:47:47.729714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.634 qpair failed and we were unable to recover it. 00:30:29.634 [2024-04-26 20:47:47.730103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.730636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.730664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.731139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.731638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.731666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.732145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.732709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.732737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.733208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.733639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.733667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.734022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.734212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.734220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.734558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.735035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.735043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.735512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.735987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.735998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.736482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.736941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.736951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.737428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.737651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.737662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.738105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.738513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.738521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.738993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.739522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.739551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.739884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.740293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.740301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.740531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.740835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.740843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.741202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.741580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.741588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.741946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.742291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.742299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.742723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.743158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.743166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.743606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.743933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.743942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.744382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.744837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.744845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.745214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.745647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.745655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.746004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.746326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.746334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.746662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.747097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.747105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.747608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.748077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.748085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.748202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.748681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.748689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.749029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.749340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.749348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.749718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.750046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.750053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.750386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.750825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.750832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.751185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.751568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.751576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.752013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.752347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.752355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.635 qpair failed and we were unable to recover it. 00:30:29.635 [2024-04-26 20:47:47.752827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.753051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.635 [2024-04-26 20:47:47.753060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.753444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.753769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.753776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.754256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.754674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.754682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.755004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.755231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.755241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.755673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.756072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.756080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.756628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.757142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.757152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.757714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.758186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.758196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.758554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.759026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.759036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.759537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.760018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.760031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.760520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.760988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.760998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.761573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.762054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.762064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.762632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.763096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.763106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.763605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.764057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.764068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.764546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.765043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.765053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.765577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.765962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.765972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.766535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.766919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.766929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.767429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.767853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.767860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.768341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.768758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.768765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.769216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.769568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.769578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.770021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.770460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.770468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.770762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.771078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.771086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.771660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.771947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.771954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.772418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.772868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.772876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.773313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.773793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.773801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.774272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.774721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.774729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.774935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.775350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.775359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.775826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.776223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.776231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.776687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.777113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.777122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.777679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.778144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.778157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.636 qpair failed and we were unable to recover it. 00:30:29.636 [2024-04-26 20:47:47.778577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.636 [2024-04-26 20:47:47.779007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.779015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.779511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.779952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.779962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.780334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.780672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.780679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.781032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.781357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.781365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.781823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.782103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.782110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.782461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.782785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.782793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.783236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.783548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.783556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.783880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.784085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.784097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.784406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.784723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.784731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.785196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.785625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.785637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.786101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.786402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.786409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.786734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.787156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.787164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.787685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.788116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.788123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.788563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.788889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.788898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.789338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.789793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.789800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.790267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.790749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.790757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.791211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.791556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.791564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.791998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.792494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.792524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.792993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.793180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.793192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.793666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.794119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.794127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.794693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.795201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.795211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.795679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.796005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.796013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.796566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.797070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.797080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.637 qpair failed and we were unable to recover it. 00:30:29.637 [2024-04-26 20:47:47.797572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.798080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.637 [2024-04-26 20:47:47.798090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.798759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.799122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.799133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.799684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.800182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.800192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.800782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.801132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.801141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.801610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.802092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.802102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.802585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.802947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.802957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.803515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.804007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.804017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.804547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.805025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.805035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.805584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.806038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.806048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.806601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.807074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.807085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.807657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.808120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.808130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.808642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.809141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.809151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.809578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.810053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.810063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.810526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.811036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.811047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.811628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.812015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.812025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.812562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.813045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.813055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.813578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.813938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.813948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.814504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.814989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.815000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.815223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.815739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.815748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.816179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.816457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.816466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.816821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 60317 Killed "${NVMF_APP[@]}" "$@" 00:30:29.638 [2024-04-26 20:47:47.817232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.817241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.817703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 20:47:47 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:29.638 20:47:47 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:29.638 [2024-04-26 20:47:47.818134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.818143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 20:47:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:29.638 20:47:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:29.638 [2024-04-26 20:47:47.818593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 20:47:47 -- common/autotest_common.sh@10 -- # set +x 00:30:29.638 [2024-04-26 20:47:47.819082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.819092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.819672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.820173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.820184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.820674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.821135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.821143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.821247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.821689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.821718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.638 [2024-04-26 20:47:47.822175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.822593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.638 [2024-04-26 20:47:47.822603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.638 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.822900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.823350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.823359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.823652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.824092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.824101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.824572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.824800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.824813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.825258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.825516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.825525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 20:47:47 -- nvmf/common.sh@469 -- # nvmfpid=61359 00:30:29.639 [2024-04-26 20:47:47.825872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 20:47:47 -- nvmf/common.sh@470 -- # waitforlisten 61359 00:30:29.639 20:47:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:29.639 20:47:47 -- common/autotest_common.sh@819 -- # '[' -z 61359 ']' 00:30:29.639 [2024-04-26 20:47:47.826346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.826355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 20:47:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:29.639 [2024-04-26 20:47:47.826711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 20:47:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:29.639 [2024-04-26 20:47:47.826944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.826952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 20:47:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:29.639 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:29.639 [2024-04-26 20:47:47.827300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 20:47:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:29.639 [2024-04-26 20:47:47.827652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.827661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 20:47:47 -- common/autotest_common.sh@10 -- # set +x 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.828137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.828461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.828471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.828794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.829118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.829127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.829589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.829816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.829827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.830230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.830674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.830683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.831124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.831570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.831598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.832076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.832633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.832663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.832884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.833349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.833359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.833674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.834127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.834136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.834617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.834936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.834944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.835418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.835732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.835740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.836200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.836499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.836508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.837006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.837437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.837444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.837917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.838358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.838366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.838839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.839213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.839221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.839591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.840059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.840067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.840540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.841020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.841028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.841557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.841917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.841928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.842291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.842763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.842770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.843113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.843551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.843559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.639 qpair failed and we were unable to recover it. 00:30:29.639 [2024-04-26 20:47:47.843881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.844223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.639 [2024-04-26 20:47:47.844231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.844705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.845174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.845182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.845688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.845996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.846003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.846577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.847062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.847072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.847622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.848123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.848133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.848690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.849214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.849224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.849694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.850154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.850164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.850531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.850969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.850976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.851422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.851842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.851851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.852295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.852721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.852728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.853201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.853611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.853619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.854095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.854521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.854530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.854847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.855353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.855361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.855887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.856372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.856380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.856725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.857070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.857077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.857451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.857905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.857913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.858133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.858575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.858583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.858849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.859310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.859318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.859677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.859990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.859998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.860455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.860932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.860940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.861416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.861851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.861859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.862183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.862688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.862696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.863050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.863514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.863523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.863852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.864323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.864330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.864790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.865093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.865101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.865434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.865895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.865902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.866254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.866721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.866729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.867204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.867439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.867452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.867907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.868385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.868393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.640 qpair failed and we were unable to recover it. 00:30:29.640 [2024-04-26 20:47:47.868838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.640 [2024-04-26 20:47:47.869269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.869280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.869708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.870034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.870042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.870648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.871162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.871171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.871653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.872099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.872107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.872666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.873010] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:29.641 [2024-04-26 20:47:47.873056] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:29.641 [2024-04-26 20:47:47.873165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.873175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.873662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.874154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.874162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.874387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.874883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.874891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.875326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.875455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.875461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.875907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.876296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.876304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.876632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.877117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.877125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.877606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.878044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.878053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.878534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.878977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.878985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.879596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.880121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.880131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.880565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.880917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.880927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.881360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.881799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.881808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.882269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.882740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.882749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.883187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.883522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.883530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.883752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.884167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.884175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.884494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.884936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.884943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.885298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.885711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.885718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.886195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.886644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.886653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.887134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.887464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.887472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.887959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.888545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.888573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.889038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.889675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.889704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.890190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.890645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.890653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.891136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.891777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.891807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.892489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.893004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.893014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.893575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.893830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.893841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.641 qpair failed and we were unable to recover it. 00:30:29.641 [2024-04-26 20:47:47.894296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.641 [2024-04-26 20:47:47.894729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.894737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.895216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.895737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.895766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.896250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.896337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.896351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.896689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.897190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.897199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.897653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.897980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.897989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.898476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.898923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.898931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.899460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.899931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.899939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.900298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.900760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.900767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.901251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.901719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.901727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.902083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.902545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.902574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.902935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.903500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.903508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.903963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 EAL: No free 2048 kB hugepages reported on node 1 00:30:29.642 [2024-04-26 20:47:47.904516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.904545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.904988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.905446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.905454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.905908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.906400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.906407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.906915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.907377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.907385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.907814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.908304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.908312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.908786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.909238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.909245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.909727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.909957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.909978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.910403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.910890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.910898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.911355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.911821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.911829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.912310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.912764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.912772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.913257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.913578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.913586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.914022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.914348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.914356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.914863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.915229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.915236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.642 qpair failed and we were unable to recover it. 00:30:29.642 [2024-04-26 20:47:47.915703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.642 [2024-04-26 20:47:47.916180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.916188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.916638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.917073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.917082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.917640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.918147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.918157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.918619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.919106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.919113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.919681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.920141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.920151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.920691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.921167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.921178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.921741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.922250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.922260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.922789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.923505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.923533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.924005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.924599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.924628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.924974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.925561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.925593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.925985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.926358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.926366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.926829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.927280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.927288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.927772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.928215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.928223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.928772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.929026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.929040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.929389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.929874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.929881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.930356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.930535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.930542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.930997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.931385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.931392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.931709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.932210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.932218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.932591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.932985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.932993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.933445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.933884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.933896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.934372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.934859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.934866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.935183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.935502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.935509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.935935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.936412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.936420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.936844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.937320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.937328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.937798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.938133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.938140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.938454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.938866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.938874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.939324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.939533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.939540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.939747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.940169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.940176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.940641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.941023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.643 [2024-04-26 20:47:47.941031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.643 qpair failed and we were unable to recover it. 00:30:29.643 [2024-04-26 20:47:47.941467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.941954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.941966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.942441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.942805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.942813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.943123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.943339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.943350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.943724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.944063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.944071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.944286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.944730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.944739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.945171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.945642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.945650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.946103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.946606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.946635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.947021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.947601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.947630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.948126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.948649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.948677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.949163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.949633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.949642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.950103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.950689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.950721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.951131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.951613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.951641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.952127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.952619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.952648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.953136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.953693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.953721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.954186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.954735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.954764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.955247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.955608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.955636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.955868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.956323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.956331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.956767] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:29.644 [2024-04-26 20:47:47.956824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.957113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.957121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.957573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.958066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.958074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.958612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.959003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.959013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.959489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.960003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.960016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.960482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.960991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.961001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.961460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.961952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.961960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.962545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.963055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.963065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.963642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.964120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.964130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.964712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.965095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.965105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.644 [2024-04-26 20:47:47.965700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.966211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.644 [2024-04-26 20:47:47.966221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.644 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.966641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.967077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.967087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.967639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.967989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.967999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.968584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.968937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.968948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.969405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.969881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.969893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.970366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.970845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.970853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.971326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.971742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.971750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.972105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.972558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.972566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.972972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.973450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.973458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.973802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.974266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.974273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.974546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.974976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.974983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.975322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.975683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.975691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.975875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.976320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.976329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.976628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.977059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.977067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.977335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.977791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.977801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.978270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.978724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.978732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.979182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.979624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.979632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.980100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.980568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.980597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.981060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.981638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.981668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.982135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.982674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.982702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.983164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.983514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.983522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.983956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.984487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.984516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.984863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.985337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.985346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.985842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.986195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.986203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.986647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.987075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.987082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.914 qpair failed and we were unable to recover it. 00:30:29.914 [2024-04-26 20:47:47.987533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.987978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.914 [2024-04-26 20:47:47.987985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.988227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.988426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.988438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.988853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.989336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.989345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.989783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.990267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.990275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.990760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.991245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.991253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.991697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.991914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.991923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.992401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.992770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.992778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.993235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.993697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.993705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.994210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.994622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.994630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.995098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.995651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.995679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.996132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.996686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.996714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.997163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.997724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.997753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.998101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.998691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.998720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.999188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.999524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:47.999532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:47.999982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.000565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.000594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.001052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.001619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.001648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.002134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.002687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.002715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.003188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.003731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.003760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.004231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.004782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.004811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.005267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.005809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.005837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.006302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.006542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.006553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.007041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.007496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.007504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.007977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.008292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.008301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.008728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.009167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.009175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.009391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.009840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.009849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.010352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.010754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.010762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.011242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.011720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.011728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.012098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.012580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.012588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.012934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.013518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.013547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.915 qpair failed and we were unable to recover it. 00:30:29.915 [2024-04-26 20:47:48.013932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.915 [2024-04-26 20:47:48.014441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.014449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.014888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.015250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.015258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.015687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.016061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.016069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.016610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.017119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.017130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.017649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.018163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.018173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.018656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.019088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.019096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.019639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.019692] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:29.916 [2024-04-26 20:47:48.019810] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:29.916 [2024-04-26 20:47:48.019820] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:29.916 [2024-04-26 20:47:48.019827] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:29.916 [2024-04-26 20:47:48.020010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:29.916 [2024-04-26 20:47:48.020149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.020159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.020134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:29.916 [2024-04-26 20:47:48.020308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:29.916 [2024-04-26 20:47:48.020309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:29.916 [2024-04-26 20:47:48.020518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.020888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.020897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.021335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.021752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.021759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.022111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.022567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.022577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.022869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.023344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.023352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.023695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.023974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.023983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.024442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.024879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.024887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.025355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.025828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.025835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.026288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.026629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.026637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.027071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.027511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.027519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.027995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.028363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.028370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.028804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.029118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.029126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.029589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.029924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.029933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.030375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.030705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.030714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.031026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.031507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.031514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.031997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.032449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.032457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.032906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.033230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.033239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.033689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.034126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.034134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.034699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.035047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.035057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.916 qpair failed and we were unable to recover it. 00:30:29.916 [2024-04-26 20:47:48.035636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.036104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.916 [2024-04-26 20:47:48.036114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.036678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.037191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.037201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.037742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.038216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.038226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.038712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.039151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.039159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.039633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.040074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.040082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.040657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.041165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.041175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.041490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.041951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.041961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.042444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.042773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.042781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.043218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.043446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.043459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.043918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.044399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.044407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.044727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.045027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.045034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.045366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.045841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.045848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.046359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.046712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.046720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.047172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.047647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.047655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.048122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.048560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.048567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.049046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.049514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.049543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.049776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.050226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.050234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.050666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.051149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.051157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.051708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.052176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.052187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.052641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.052883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.052891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.053331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.053819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.053827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.054284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.054525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.054532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.054881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.055316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.055324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.055800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.056281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.056288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.056746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.057183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.057191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.057647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.058088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.058096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.058643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.059157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.059168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.059645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.060125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.060133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.060559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.060920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.060930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.917 qpair failed and we were unable to recover it. 00:30:29.917 [2024-04-26 20:47:48.061523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.917 [2024-04-26 20:47:48.062040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.062050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.062465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.062986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.062996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.063252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.063729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.063737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.063969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.064530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.064559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.065025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.065516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.065545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.065793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.065997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.066005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.066495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.066688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.066695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.067141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.067648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.067655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.067766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.068125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.068133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.068505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.068986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.068994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.069462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.069946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.069954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.070527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.070992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.071002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.071236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.071678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.071686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.072025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.072576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.072604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.073089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.073684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.073712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.073922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.074408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.074428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.074658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.075123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.075130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.075588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.076071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.076079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.076594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.077064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.077074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.077621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.078133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.078143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.078607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.079065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.079076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.079521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.079804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.079815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.080257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.080737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.918 [2024-04-26 20:47:48.080746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.918 qpair failed and we were unable to recover it. 00:30:29.918 [2024-04-26 20:47:48.081222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.081577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.081604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.082076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.082458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.082487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.082696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.083141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.083149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.083602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.084041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.084050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.084629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.084887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.084898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.085259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.085615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.085622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.085955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.086430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.086438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.086908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.087388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.087396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.087837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.088065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.088078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.088558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.089000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.089008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.089445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.089883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.089891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.090362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.090802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.090810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.091125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.091564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.091572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.092030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.092611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.092640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.092863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.093192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.093200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.093641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.094132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.094140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.094606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.095068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.095078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.095502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.095966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.095976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.096557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.097071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.097081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.097625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.097878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.097892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.098152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.098550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.098559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.098787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.099028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.099035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.099437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.099889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.099898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.100210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.100525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.100534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.100981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.101448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.101456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.101908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.102283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.102291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.102621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.103063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.103071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.103621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.104105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.104116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.104536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.104896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.919 [2024-04-26 20:47:48.104906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.919 qpair failed and we were unable to recover it. 00:30:29.919 [2024-04-26 20:47:48.105334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.105574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.105582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.106014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.106452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.106460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.106929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.107364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.107372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.107845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.108101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.108112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.108558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.109039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.109048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.109458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.109699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.109713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.110089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.110507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.110515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.110950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.111431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.111439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.111893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.112337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.112345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.112823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.113307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.113315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.113639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.114075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.114082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.114429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.114859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.114866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.115202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.115671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.115678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.116155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.116684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.116716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.116970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.117217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.117226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.117717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.118207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.118216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.118536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.118625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.118632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.119066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.119524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.119531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.119860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.120206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.120214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.120637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.121122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.121129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.121544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.121763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.121773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.122100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.122518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.122526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.123003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.123489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.123497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.123971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.124514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.124547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.125009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.125591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.125620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.126096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.126222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.126229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.126687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.127122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.127130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.127497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.128009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.128019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.920 [2024-04-26 20:47:48.128568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.128954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.920 [2024-04-26 20:47:48.128964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.920 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.129537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.129868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.129878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.130054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.130445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.130454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.130893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.131218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.131225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.131547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.131991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.131998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.132224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.132643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.132654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.132878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.133320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.133328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.133581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.134054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.134061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.134550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.135033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.135041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.135263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.135687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.135695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.136119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.136535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.136564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.136913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.137470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.137499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.137852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.138322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.138330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.138772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.139094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.139101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.139552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.139998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.140007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.140254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.140585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.140592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.141055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.141275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.141301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.141765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.142196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.142204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.142728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.143244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.143254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.143803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.144487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.144515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.144870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.145479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.145507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.145945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.146427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.146435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.146768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.147088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.147097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.147546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.148027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.148034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.148586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.149098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.149109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.149572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.150041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.150052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.150633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.151009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.151019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.921 qpair failed and we were unable to recover it. 00:30:29.921 [2024-04-26 20:47:48.151592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.151923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.921 [2024-04-26 20:47:48.151933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.152270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.152606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.152614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.152947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.153424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.153433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.153919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.154407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.154414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.154869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.155350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.155359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.155873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.156072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.156079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.156429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.156782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.156791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.157266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.157757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.157765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.158246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.158594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.158603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.158817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.159266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.159274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.159727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.159983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.159992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.160549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.161014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.161024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.161567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.162037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.162048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.162601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.163109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.163119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.163536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.163797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.163807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.164251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.164712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.164721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.165202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.165628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.165635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.166097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.166635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.166664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.166911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.167195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.167203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.167690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.167907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.167914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.168383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.168863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.168870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.169319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.169784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.169792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.170018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.170255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.170263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.170714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.171196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.171203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.171623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.172102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.172109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.172537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.172999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.173010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.173496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.174005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.174014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.174479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.174984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.174994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.175466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.175831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.175842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.922 qpair failed and we were unable to recover it. 00:30:29.922 [2024-04-26 20:47:48.176319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.922 [2024-04-26 20:47:48.176811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.176820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.177264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.177748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.177756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.178225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.178689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.178696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.178945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.179513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.179542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.180005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.180485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.180514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.180989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.181228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.181236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.181679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.182164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.182172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.182632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.182954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.182961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.183410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.183711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.183719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.184222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.184410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.184418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.184832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.185310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.185318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.185763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.186196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.186204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.186662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.187149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.187157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.187315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.187419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.187425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.187702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.188152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.188159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.188630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.189082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.189090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.189404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.189622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.189629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.190075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.190509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.190516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.190877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.191265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.191273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.191762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.192196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.192204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.192658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.193139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.193147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.193569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.193808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.193817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.194294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.194756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.194764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.195235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.195582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.195590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.923 [2024-04-26 20:47:48.196039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.196519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.923 [2024-04-26 20:47:48.196527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.923 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.196779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.197003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.197010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.197454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.197775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.197782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.198025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.198250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.198262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.198453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.198869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.198876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.199349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.199601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.199609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.199834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.200274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.200287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.200750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.201231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.201238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.201690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.202171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.202178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.202632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.203112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.203119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.203664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.204172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.204182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.204636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.205127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.205136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.205587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.206093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.206103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.206645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.206957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.206967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.207491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.208003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.208013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.208555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.209066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.209076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.209672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.210137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.210147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.210503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.210999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.211009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.211572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.212032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.212041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.212624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.213136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.213146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.213522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.213990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.214000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.214564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.215076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.215085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.215638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.216147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.216157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.216419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.216854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.216862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.217210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.217537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.217546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.217894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.218358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.218366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.218832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.219328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.219336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.219782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.220261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.220269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.220713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.221037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.221044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.924 qpair failed and we were unable to recover it. 00:30:29.924 [2024-04-26 20:47:48.221471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.221911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.924 [2024-04-26 20:47:48.221919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.222394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.222830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.222837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.223173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.223656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.223663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.223989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.224356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.224364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.224804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.225019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.225026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.225491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.225929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.225937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.226403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.226836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.226844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.227040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.227488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.227496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.227851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.228327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.228335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.228661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.229095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.229103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.229354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.229680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.229688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.230025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.230526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.230534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.230970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.231402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.231409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.231642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.232085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.232093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.232450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.232683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.232690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.232880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.233326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.233333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.233559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.234019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.234027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.234327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.234760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.234768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.234992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.235398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.235406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.235873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.236307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.236315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.236759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.237192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.237199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.237647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.238102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.238109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.238458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.238933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.238940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.239388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.239611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.239619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.240090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.240490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.240497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.240973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.241339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.241347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.241566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.241779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.241786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.242229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.242681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.242702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.243148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.243462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.243470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.925 qpair failed and we were unable to recover it. 00:30:29.925 [2024-04-26 20:47:48.243820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.925 [2024-04-26 20:47:48.244140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.244147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.926 qpair failed and we were unable to recover it. 00:30:29.926 [2024-04-26 20:47:48.244586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.245024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.245031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.926 qpair failed and we were unable to recover it. 00:30:29.926 [2024-04-26 20:47:48.245574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.246035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.246045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.926 qpair failed and we were unable to recover it. 00:30:29.926 [2024-04-26 20:47:48.246579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.246819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.246829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.926 qpair failed and we were unable to recover it. 00:30:29.926 [2024-04-26 20:47:48.247307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.247794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.247802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.926 qpair failed and we were unable to recover it. 00:30:29.926 [2024-04-26 20:47:48.248123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.248596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.248605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.926 qpair failed and we were unable to recover it. 00:30:29.926 [2024-04-26 20:47:48.249004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.249575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.249604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:29.926 qpair failed and we were unable to recover it. 00:30:29.926 [2024-04-26 20:47:48.250081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:29.926 [2024-04-26 20:47:48.250671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.250700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.251187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.251526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.251537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.252023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.252638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.252667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.253127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.253554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.253583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.253798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.254025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.254033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.254282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.254719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.254726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.255207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.255443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.255450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.255690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.256191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.256198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.256642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.257081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.257089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.257432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.257856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.257863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.258333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.258655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.258662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.259153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.259458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.259469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.259660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.260089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.260097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.260566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.261047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.261054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.261508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.262017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.262027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.262577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.263034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.263044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.263581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.263822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.263832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.264313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.264776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.264784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.265102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.265588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.265596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.265938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.266272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.266290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.266734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.267168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.267175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.267632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.268001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.268012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.268211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.268432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.268444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.268898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.269377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.269385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.269817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.270292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.270300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.270723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.271179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.271186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.271631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.271862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.271869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.195 qpair failed and we were unable to recover it. 00:30:30.195 [2024-04-26 20:47:48.272308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.195 [2024-04-26 20:47:48.272792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.272800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.273052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.273484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.273491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.273917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.274354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.274362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.274687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.274999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.275006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.275185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.275513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.275521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.275884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.276353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.276361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.276783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.277262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.277270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.277739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.278100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.278107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.278419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.278898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.278905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.279132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.279587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.279595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.279848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.280323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.280331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.280561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.280983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.280991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.281180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.281487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.281495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.281966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.282446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.282460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.282937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.283421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.283428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.283902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.284382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.284390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.284520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.284925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.284932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.285416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.285854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.285861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.286332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.286567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.286574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.286975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.287454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.287462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.287830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.288061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.288069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.288489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.288744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.288751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.289222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.289605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.289612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.289932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.290398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.290406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.290862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.291223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.291231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.291543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.291714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.291725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.292227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.292657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.292665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.293138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.293571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.293580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.196 [2024-04-26 20:47:48.293773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.294176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.196 [2024-04-26 20:47:48.294184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.196 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.294429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.294868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.294875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.295386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.295827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.295834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.296348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.296781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.296788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.297313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.297755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.297763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.298236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.298680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.298689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.299159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.299492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.299520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.299867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.300225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.300233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.300681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.301140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.301149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.301700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.302170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.302180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.302641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.303134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.303142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.303715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.304179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.304189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.304723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.304982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.304993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.305317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.305644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.305652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.306130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.306603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.306610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.307090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.307471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.307500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.307980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.308553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.308581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.309105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.309611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.309640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.310112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.310478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.310506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.310983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.311560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.311588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.312050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.312630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.312658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.313135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.313715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.313744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.314186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.314722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.314751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.314975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.315426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.315434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.315885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.316323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.316331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.316571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.316767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.316778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.317258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.317577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.317585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.318013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.318447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.318455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.197 [2024-04-26 20:47:48.318800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.319266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.197 [2024-04-26 20:47:48.319273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.197 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.319748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.320059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.320067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.320446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.320777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.320785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.321135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.321576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.321584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.322021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.322466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.322495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.322972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.323234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.323241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.323471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.323930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.323938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.324162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.324687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.324716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.325174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.325628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.325637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.326070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.326653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.326682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.327199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.327629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.327637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.328117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.328505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.328534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.328999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.329238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.329247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.329805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.330033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.330043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.330465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.330908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.330916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.331472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.331932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.331942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.332172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.332645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.332653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.333009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.333496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.333504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.333864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.334351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.334359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.334799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.335130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.335137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.335586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.335841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.335849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.336094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.336545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.336553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.336781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.337206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.337215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.337304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.337738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.337746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.338106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.338584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.338592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.339025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.339345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.339353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.339693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.340138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.340146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.340589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.341070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.341078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.341526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.342001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.342011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.198 qpair failed and we were unable to recover it. 00:30:30.198 [2024-04-26 20:47:48.342552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.198 [2024-04-26 20:47:48.343065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.343075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.343655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.344121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.344131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.344676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.345036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.345047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.345285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.345806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.345836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.346496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.346842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.346852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.347442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.347697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.347707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.348171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.348491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.348499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.348953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.349400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.349408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.349881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.350363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.350371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.350719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.351198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.351206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.351671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.352164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.352172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.352496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.352935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.352943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.353375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.353698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.353706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.354180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.354500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.354509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.354987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.355466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.355473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.355931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.356443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.356451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.356925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.357254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.357262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.357736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.358217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.358225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.358671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.359156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.359164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.359725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.360234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.360244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.360702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.361168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.361176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.361725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.362092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.362102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.362665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.363126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.363137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.199 qpair failed and we were unable to recover it. 00:30:30.199 [2024-04-26 20:47:48.363503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.199 [2024-04-26 20:47:48.364055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.364066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.364497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.364846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.364858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.365331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.365562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.365571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.365904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.366381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.366390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.366849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.367082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.367090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.367410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.367518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.367526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.367833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.368274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.368291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.368633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.368958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.368965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.369310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.369623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.369631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.370074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.370521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.370529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.371000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.371478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.371487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.371799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.372281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.372290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.372728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.373201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.373209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.373667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.373920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.373929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.374406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.374662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.374671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.375106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.375433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.375441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.375891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.376372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.376380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.376896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.377328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.377338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.377564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.378039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.378047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.378518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.378999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.379006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.379463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.379697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.379705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.380135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.380578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.380586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.381061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.381635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.381664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.381864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.382272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.382287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.382752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.383192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.383200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.383659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.384142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.384150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.384228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.384682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.384691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.385169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.385622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.385634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.386090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.386561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.200 [2024-04-26 20:47:48.386589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.200 qpair failed and we were unable to recover it. 00:30:30.200 [2024-04-26 20:47:48.386945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.387524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.387552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.387889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.388366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.388376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.388645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.389112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.389120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.389586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.390069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.390077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.390486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.390995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.391005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.391543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.391825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.391835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.392316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.392775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.392783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.393238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.393721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.393729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.393958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.394403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.394415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.394614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.395104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.395112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.395593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.395919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.395927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.396302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.396749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.396756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.397019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.397341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.397348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.397833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.398273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.398285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.398612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.399091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.399099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.399641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.400152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.400162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.400632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.400990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.400998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.401502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.401883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.401891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.402332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.402817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.402825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.403284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.403741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.403750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.404179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.404652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.404659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.405131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.405660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.405689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.405916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.406151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.406163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.406497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.406984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.406992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.407371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.407827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.407834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.408310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.408761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.408769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.409114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.409337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.409345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.409803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.410232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.410239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.410591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.410823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.201 [2024-04-26 20:47:48.410829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.201 qpair failed and we were unable to recover it. 00:30:30.201 [2024-04-26 20:47:48.411309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.411629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.411637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.411951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.412132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.412143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.412596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.413076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.413084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.413310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.413633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.413641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.414056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.414471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.414500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.414962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.415335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.415343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.415811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.416291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.416299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.416731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.417211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.417218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.417670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.418156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.418164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.418631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.419065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.419074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.419309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.419739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.419747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.420208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.420656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.420665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.421116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.421685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.421714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.422168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.422625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.422634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.423147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.423627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.423657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.424134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.424522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.424551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.424988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.425194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.425202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.425665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.426144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.426152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.426731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.427084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.427096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.427649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.428044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.428054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.428532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.429046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.429056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.429635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.430101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.430111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.430664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.431015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.431025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.431557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.432047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.432057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.432534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.432878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.432888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.433083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.433543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.433551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.433804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.434255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.434262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.434454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.434890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.434898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.202 [2024-04-26 20:47:48.435377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.435660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.202 [2024-04-26 20:47:48.435677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.202 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.436145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.436382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.436389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.436870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.437386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.437394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.437832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.438270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.438284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.438709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.439190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.439197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.439647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.440126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.440133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.440681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.441144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.441155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.441526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.441963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.441971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.442488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.442960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.442971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.443413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.443814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.443822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.444265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.444625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.444633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.444840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.445085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.445095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.445529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.445807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.445815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.446183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.446645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.446653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.446901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.447341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.447348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.447821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.448298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.448306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.448720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.449199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.449207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.449662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.450145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.450153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.450623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.451102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.451110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.451676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.452137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.452147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.452601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.452986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.452996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.453232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.453707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.453715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.453929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.454487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.454516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.454957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.455285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.455294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.455629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.455950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.455957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.456532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.457027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.457037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.457301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.457683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.457690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.458171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.458552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.458559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.459038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.459367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.459374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.203 [2024-04-26 20:47:48.459854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.460227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.203 [2024-04-26 20:47:48.460235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.203 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.460583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.460893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.460901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.461219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.461544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.461554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.461874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.462361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.462370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.462606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.462829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.462837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.463235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.463673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.463682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.463907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.464223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.464231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.464711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.465152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.465161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.465606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.466043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.466051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.466244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.466561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.466570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.466657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.467063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.467071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.467543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.468016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.468026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.468591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.469057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.469068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.469305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.469752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.469762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.470234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.470600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.470628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.470944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.471386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.471394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.471886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.472374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.472382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.472844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.473282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.473292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.473727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.474203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.474212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.474476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.474920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.474928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.475406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.475633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.475644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.475890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.476346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.476355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.476714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.476945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.476956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.477394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.477875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.477883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.204 [2024-04-26 20:47:48.478231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.478468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.204 [2024-04-26 20:47:48.478476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.204 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.478939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.479409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.479416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.479888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.480326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.480334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.480748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.480945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.480952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.481386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.481717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.481724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.481914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.482335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.482343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.482739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.483209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.483217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.483568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.484047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.484055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.484530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.484754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.484763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.484945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.485240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.485248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.485720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.485974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.485982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.486458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.486691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.486699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.487134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.487358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.487366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.487589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.488042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.488050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.488367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.488844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.488852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.489334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.489764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.489772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.490119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.490553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.490560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.491002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.491386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.491394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.491843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.492323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.492331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.492627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.493067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.493075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.493496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.493711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.493719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.494178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.494291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.494297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.494725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.495206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.495214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.495656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.495882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.495900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.496120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.496590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.496598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.497051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.497579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.497608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.497965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.498186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.498194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.498669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.499034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.499043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.499459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.499719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.499727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.205 [2024-04-26 20:47:48.500185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.500637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.205 [2024-04-26 20:47:48.500648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.205 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.501119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.501562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.501590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.502061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.502634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.502664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.503144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.503485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.503513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.503823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.504265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.504273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.504756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.505198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.505206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.505546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.505901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.505913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.506369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.506810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.506818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.507272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.507586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.507594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.507906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.508297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.508305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.508748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.509227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.509238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.509716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.509790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.509798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.510257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.510719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.510728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.511211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.511544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.511552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.511997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.512430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.512438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.512907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.513379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.513387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.513853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.514129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.514137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.514588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.515071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.515079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.515603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.515847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.515857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.516068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.516543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.516551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.516866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.517088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.517098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.517423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.517606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.517618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.517849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.518312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.518321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.518776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.519132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.519141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.519585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.519985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.519993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.520473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.520962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.520969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.521412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.521890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.521898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.522368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.522824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.522831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.523282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.523491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.523500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.206 [2024-04-26 20:47:48.523921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.524358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.206 [2024-04-26 20:47:48.524366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.206 qpair failed and we were unable to recover it. 00:30:30.207 [2024-04-26 20:47:48.524821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.525298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.525308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.207 qpair failed and we were unable to recover it. 00:30:30.207 [2024-04-26 20:47:48.525562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.526049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.526058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.207 qpair failed and we were unable to recover it. 00:30:30.207 [2024-04-26 20:47:48.526511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.526989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.526998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.207 qpair failed and we were unable to recover it. 00:30:30.207 [2024-04-26 20:47:48.527221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.527644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.527652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.207 qpair failed and we were unable to recover it. 00:30:30.207 [2024-04-26 20:47:48.528130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.528678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.528706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.207 qpair failed and we were unable to recover it. 00:30:30.207 [2024-04-26 20:47:48.528817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.529289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.529298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.207 qpair failed and we were unable to recover it. 00:30:30.207 [2024-04-26 20:47:48.529736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.530178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.530186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.207 qpair failed and we were unable to recover it. 00:30:30.207 [2024-04-26 20:47:48.530660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.531139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.207 [2024-04-26 20:47:48.531147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.207 qpair failed and we were unable to recover it. 00:30:30.478 [2024-04-26 20:47:48.531623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.532103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.532112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-04-26 20:47:48.532733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.533241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.533251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-04-26 20:47:48.533802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.534261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.534272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-04-26 20:47:48.534745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.535255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.535266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-04-26 20:47:48.535715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.536101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.536111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-04-26 20:47:48.536490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.537006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.537016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-04-26 20:47:48.537499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.537971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.537981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-04-26 20:47:48.538530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.538993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.539004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-04-26 20:47:48.539563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.540073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.540083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-04-26 20:47:48.540627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.540876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.540889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-04-26 20:47:48.541128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.541607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.478 [2024-04-26 20:47:48.541616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.478 qpair failed and we were unable to recover it. 00:30:30.478 [2024-04-26 20:47:48.542102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.542588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.542596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.543068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.543642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.543672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.544112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.544656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.544685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.544899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.545223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.545231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.545761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.546047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.546055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.546674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.547181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.547191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.547653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.548128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.548136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.548544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.549061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.549070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.549484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.549948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.549958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.550532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.550809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.550821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.551307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.551757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.551765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.552218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.552641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.552649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.553088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.553417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.553424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.553875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.554107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.554114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.554425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.554918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.554926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.555365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.555595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.555603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.555954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.556294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.556302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.556530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.556988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.556996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.557470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.557905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.557913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.558359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.558574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.558581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.559051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.559526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.559534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.559764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.560177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.560184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.560634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.561111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.561118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.561567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.562020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.562028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.562556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.563016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.563026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.563588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.563932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.563942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.564301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.564747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.564755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.565205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.565648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.565657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.479 [2024-04-26 20:47:48.566129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.566696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.479 [2024-04-26 20:47:48.566725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.479 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.567205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.567537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.567545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.567896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.568338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.568348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.568658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.569114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.569121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.569596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.570078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.570086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.570463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.570970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.570980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.571207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.571658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.571666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.571894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.572359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.572369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.572801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.573282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.573290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.573591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.573899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.573907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.574344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.574779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.574787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.575143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.575587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.575595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.575821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.576151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.576159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.576625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.577000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.577008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.577555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.578029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.578039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.578593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.579057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.579069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.579726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.579958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.579968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.580191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.580646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.580655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.581130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.581548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.581577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.581778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.582237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.582246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.582474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.582801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.582809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.583251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.583605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.583617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.584079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.584569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.584577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.584922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.585118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.585125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.585556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.585876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.585884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.586353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.586822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.586830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.587180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.587490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.587499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.587719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.588121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.588129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.588606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.589038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.589045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.480 qpair failed and we were unable to recover it. 00:30:30.480 [2024-04-26 20:47:48.589518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.590009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.480 [2024-04-26 20:47:48.590018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.590483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.590944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.590955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.591508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.591981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.591992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.592471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.592688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.592697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.592956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.593388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.593396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.593875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.593988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.593996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.594461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.594693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.594700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.595086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.595488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.595496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.595713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.595926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.595935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.596333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.596788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.596796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.597247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.597687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.597695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.598137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.598619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.598627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.599098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.599615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.599643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.599997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.600526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.600555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.601012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.601600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.601629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.601985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.602543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.602572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.603052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.603625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.603654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.604092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.604630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.604659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.605016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.605238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.605251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.605711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.606193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.606201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.606735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.607211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.607222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.607717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.608177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.608185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.608487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.608942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.608951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.609515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.610021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.610032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.610612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.611076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.611087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.611180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.611642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.611651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.612181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.612629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.612638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.612874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.613318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.613326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.613561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.614004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.614013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.481 qpair failed and we were unable to recover it. 00:30:30.481 [2024-04-26 20:47:48.614526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.481 [2024-04-26 20:47:48.614717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.614724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.615174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.615657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.615664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.616152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.616632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.616640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.617065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.617593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.617621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.617955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.618531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.618559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.618657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.618874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.618882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.619329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.619786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.619793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.620292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.620548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.620557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.621031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.621524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.621532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.622068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.622563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.622591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.623076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.623666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.623695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.624176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.624413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.624421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.624897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.625220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.625228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.625432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.625763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.625771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.626211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.626659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.626669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.627119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.627594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.627602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.627830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.628016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.628029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.628502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.628990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.628997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.629473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.629919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.629926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.630399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.630757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.630765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.631236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.631449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.631456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.631932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.632259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.632267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.632583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.633034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.633041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.633264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.633722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.633730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.634069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.634297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.634312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.634818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.635254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.635262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.635600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.635843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.635854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.636330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.636812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.636820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.637290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.637490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.482 [2024-04-26 20:47:48.637497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.482 qpair failed and we were unable to recover it. 00:30:30.482 [2024-04-26 20:47:48.637928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.638369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.638377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.638483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.638932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.638941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.639372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.639812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.639820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.640039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.640238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.640246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.640697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.641018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.641025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.641337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.641698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.641705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.642210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.642634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.642642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.643113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.643587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.643596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.644049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.644488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.644517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.644990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 20:47:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:30.483 [2024-04-26 20:47:48.645491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.645521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 20:47:48 -- common/autotest_common.sh@852 -- # return 0 00:30:30.483 [2024-04-26 20:47:48.645999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 20:47:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:30.483 [2024-04-26 20:47:48.646260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.646268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 20:47:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:30.483 20:47:48 -- common/autotest_common.sh@10 -- # set +x 00:30:30.483 [2024-04-26 20:47:48.646589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.647083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.647093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.647628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.648109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.648118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.648555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.648842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.648851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.649356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.649848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.649854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.650283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.650636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.650643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.651114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.651660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.651687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.652074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.652655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.652683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.653038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.653594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.653621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.654106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.654676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.654704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.655127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.655603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.655630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.656069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.656638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.656666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.483 qpair failed and we were unable to recover it. 00:30:30.483 [2024-04-26 20:47:48.657165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.483 [2024-04-26 20:47:48.657765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.657793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.658039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.658501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.658528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.659004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.659575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.659602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.660133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.660556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.660583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.661066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.661643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.661669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.661901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.662335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.662342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.662571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.663043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.663049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.663521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.664043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.664050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.664501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.664817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.664824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.665261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.665716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.665724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.665941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.666368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.666376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.666844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.667203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.667209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.667469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.667794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.667802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.668219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.668467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.668473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.668578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.668732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.668739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.668933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.669292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.669300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.669724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.670202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.670209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.670640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.671111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.671118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.671548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.672025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.672033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.672452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.672905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.672911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.673359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.673781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.673788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.674269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.674594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.674601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.675059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.675280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.675287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.675708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.676058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.676065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.676618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.676995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.677004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.677575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.678085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.678095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.678645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.679152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.679161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.679527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.679742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.679751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.680197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.680394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.484 [2024-04-26 20:47:48.680401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.484 qpair failed and we were unable to recover it. 00:30:30.484 [2024-04-26 20:47:48.680946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.681412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.681419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.681905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.682151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.682158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.682409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.682748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.682755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.682988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.683176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.683182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.683615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.683927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.683934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.684400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 20:47:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:30.485 [2024-04-26 20:47:48.684839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.684847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 20:47:48 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:30.485 [2024-04-26 20:47:48.685218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 20:47:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:30.485 20:47:48 -- common/autotest_common.sh@10 -- # set +x 00:30:30.485 [2024-04-26 20:47:48.685668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.685678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.686137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.686604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.686611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.686725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.687127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.687133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.687575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.688047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.688054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.688589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.689099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.689108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.689693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.690197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.690206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.690738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.690940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.690949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.691182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.691605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.691612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.692092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.692573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.692580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.692794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.692990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.693001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.693450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.693970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.693977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.694420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.694865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.694871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.695057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.695392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.695399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.695838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.696167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.696173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.696638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.696993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.696999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.697461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.697776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.697782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.698105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.698553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.698560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.698996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.699219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.699225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.699560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.700038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.700045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.700591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.701070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.701085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.701658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 Malloc0 00:30:30.485 [2024-04-26 20:47:48.702140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.702149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.485 [2024-04-26 20:47:48.702685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 20:47:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:30.485 20:47:48 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:30.485 [2024-04-26 20:47:48.703246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.485 [2024-04-26 20:47:48.703255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.485 qpair failed and we were unable to recover it. 00:30:30.486 20:47:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:30.486 20:47:48 -- common/autotest_common.sh@10 -- # set +x 00:30:30.486 [2024-04-26 20:47:48.703840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.704522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.704551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.704808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.705267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.705273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.705759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.706204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.706210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.706752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.707102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.707111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.707548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.707800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.707809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.708301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.708513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.708520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.708907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.709248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.709254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.709439] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:30.486 [2024-04-26 20:47:48.709753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.710196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.710203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.710469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.710636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.710642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.711107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.711638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.711645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.711867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.712286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.712295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.712633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.713072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.713078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.713629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.713969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.713978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.714462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.714941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.714947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.715526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.715925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.715935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.716418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.716802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.716809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.717322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.717652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.717662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.718107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.718355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.718361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 20:47:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:30.486 [2024-04-26 20:47:48.718821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 20:47:48 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:30.486 20:47:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:30.486 [2024-04-26 20:47:48.719311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.719318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 20:47:48 -- common/autotest_common.sh@10 -- # set +x 00:30:30.486 [2024-04-26 20:47:48.719767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.719968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.719975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.720233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.720681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.720688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.721161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.721630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.721636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.721878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.722321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.722328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.722777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.722974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.722980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.723461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.723910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.723916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.724358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.724696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.724702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.486 [2024-04-26 20:47:48.725031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.725258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.486 [2024-04-26 20:47:48.725264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.486 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.725739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.725861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.725867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.726359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.726823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.726829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.727269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.727623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.727629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.728084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.728531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.728537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.728975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.729288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.729295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.729504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.729595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.729601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.729775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.730106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.730112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 20:47:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:30.487 [2024-04-26 20:47:48.730612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.730863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.730870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 20:47:48 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:30.487 20:47:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:30.487 [2024-04-26 20:47:48.731344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 20:47:48 -- common/autotest_common.sh@10 -- # set +x 00:30:30.487 [2024-04-26 20:47:48.731801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.731807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.732237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.732696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.732703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.732919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.733393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.733399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.733851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.734337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.734344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.734677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.735023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.735030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.735470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.735871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.735877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.736311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.736739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.736745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.736989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.737215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.737222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.737678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.737996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.738004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.738353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.738769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.738775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.739084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.739315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.739325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.739769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.740022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.740029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.740454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.740890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.740896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.741103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.741455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.741462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 [2024-04-26 20:47:48.741964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.742321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.487 [2024-04-26 20:47:48.742328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.487 qpair failed and we were unable to recover it. 00:30:30.487 20:47:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:30.487 [2024-04-26 20:47:48.742790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 20:47:48 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:30.488 20:47:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:30.488 [2024-04-26 20:47:48.743218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.743225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 20:47:48 -- common/autotest_common.sh@10 -- # set +x 00:30:30.488 [2024-04-26 20:47:48.743777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.744104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.744111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-04-26 20:47:48.744599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.745082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.745091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-04-26 20:47:48.745623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.746103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.746112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-04-26 20:47:48.746667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.747145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.747154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-04-26 20:47:48.747611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.748056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.748064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-04-26 20:47:48.748509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.748767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.748776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-04-26 20:47:48.749243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.749602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:30.488 [2024-04-26 20:47:48.749609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f6d8c000b90 with addr=10.0.0.2, port=4420 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-04-26 20:47:48.749735] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:30.488 20:47:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:30.488 20:47:48 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:30.488 20:47:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:30.488 20:47:48 -- common/autotest_common.sh@10 -- # set +x 00:30:30.488 [2024-04-26 20:47:48.760335] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.488 [2024-04-26 20:47:48.760469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.488 [2024-04-26 20:47:48.760484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.488 [2024-04-26 20:47:48.760490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.488 [2024-04-26 20:47:48.760495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.488 [2024-04-26 20:47:48.760510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 20:47:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:30.488 20:47:48 -- host/target_disconnect.sh@58 -- # wait 60464 00:30:30.488 [2024-04-26 20:47:48.770315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.488 [2024-04-26 20:47:48.770412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.488 [2024-04-26 20:47:48.770426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.488 [2024-04-26 20:47:48.770431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.488 [2024-04-26 20:47:48.770435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.488 [2024-04-26 20:47:48.770447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-04-26 20:47:48.780274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.488 [2024-04-26 20:47:48.780504] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.488 [2024-04-26 20:47:48.780522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.488 [2024-04-26 20:47:48.780527] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.488 [2024-04-26 20:47:48.780532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.488 [2024-04-26 20:47:48.780543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-04-26 20:47:48.790268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.488 [2024-04-26 20:47:48.790362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.488 [2024-04-26 20:47:48.790375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.488 [2024-04-26 20:47:48.790380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.488 [2024-04-26 20:47:48.790385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.488 [2024-04-26 20:47:48.790396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-04-26 20:47:48.800306] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.488 [2024-04-26 20:47:48.800393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.488 [2024-04-26 20:47:48.800406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.488 [2024-04-26 20:47:48.800412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.488 [2024-04-26 20:47:48.800416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.488 [2024-04-26 20:47:48.800427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.488 [2024-04-26 20:47:48.810342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.488 [2024-04-26 20:47:48.810419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.488 [2024-04-26 20:47:48.810432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.488 [2024-04-26 20:47:48.810437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.488 [2024-04-26 20:47:48.810442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.488 [2024-04-26 20:47:48.810453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.488 qpair failed and we were unable to recover it. 00:30:30.751 [2024-04-26 20:47:48.820468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.751 [2024-04-26 20:47:48.820556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.751 [2024-04-26 20:47:48.820568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.751 [2024-04-26 20:47:48.820574] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.751 [2024-04-26 20:47:48.820579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.751 [2024-04-26 20:47:48.820591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.751 qpair failed and we were unable to recover it. 00:30:30.751 [2024-04-26 20:47:48.830334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.751 [2024-04-26 20:47:48.830416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.751 [2024-04-26 20:47:48.830430] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.751 [2024-04-26 20:47:48.830436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.830443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.830455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.840418] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.840507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.840520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.840526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.840531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.840543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.850312] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.850395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.850409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.850415] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.850419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.850432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.860432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.860518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.860532] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.860537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.860542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.860553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.870447] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.870527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.870543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.870549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.870554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.870565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.880531] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.880624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.880638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.880644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.880649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.880661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.890545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.890629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.890643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.890648] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.890653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.890664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.900559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.900651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.900665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.900670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.900675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.900686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.910562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.910643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.910656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.910661] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.910666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.910680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.920609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.920707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.920721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.920727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.920732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.920743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.930514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.930736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.930750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.930755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.930760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.930771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.940655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.940739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.940752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.940757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.940762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.940774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.950673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.950751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.950765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.950770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.950775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.950787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.960728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.960836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.960852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.960858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.960862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.960874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.970856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.970939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.970953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.970959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.970964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.970976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.980775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.980858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.980878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.980885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.980890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.980905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:48.990866] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:48.990963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:48.990983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:48.990990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:48.990995] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:48.991010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:49.000862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:49.000951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:49.000971] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:49.000978] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:49.000986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:49.001001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:49.010855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.752 [2024-04-26 20:47:49.010941] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.752 [2024-04-26 20:47:49.010956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.752 [2024-04-26 20:47:49.010962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.752 [2024-04-26 20:47:49.010967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.752 [2024-04-26 20:47:49.010979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.752 qpair failed and we were unable to recover it. 00:30:30.752 [2024-04-26 20:47:49.020883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.753 [2024-04-26 20:47:49.020969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.753 [2024-04-26 20:47:49.020983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.753 [2024-04-26 20:47:49.020989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.753 [2024-04-26 20:47:49.020993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.753 [2024-04-26 20:47:49.021004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.753 qpair failed and we were unable to recover it. 00:30:30.753 [2024-04-26 20:47:49.031032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.753 [2024-04-26 20:47:49.031124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.753 [2024-04-26 20:47:49.031138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.753 [2024-04-26 20:47:49.031143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.753 [2024-04-26 20:47:49.031148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.753 [2024-04-26 20:47:49.031160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.753 qpair failed and we were unable to recover it. 00:30:30.753 [2024-04-26 20:47:49.040979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.753 [2024-04-26 20:47:49.041063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.753 [2024-04-26 20:47:49.041076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.753 [2024-04-26 20:47:49.041082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.753 [2024-04-26 20:47:49.041087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.753 [2024-04-26 20:47:49.041099] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.753 qpair failed and we were unable to recover it. 00:30:30.753 [2024-04-26 20:47:49.051034] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.753 [2024-04-26 20:47:49.051119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.753 [2024-04-26 20:47:49.051132] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.753 [2024-04-26 20:47:49.051138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.753 [2024-04-26 20:47:49.051143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.753 [2024-04-26 20:47:49.051155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.753 qpair failed and we were unable to recover it. 00:30:30.753 [2024-04-26 20:47:49.061031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.753 [2024-04-26 20:47:49.061109] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.753 [2024-04-26 20:47:49.061123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.753 [2024-04-26 20:47:49.061128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.753 [2024-04-26 20:47:49.061133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.753 [2024-04-26 20:47:49.061145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.753 qpair failed and we were unable to recover it. 00:30:30.753 [2024-04-26 20:47:49.070953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.753 [2024-04-26 20:47:49.071050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.753 [2024-04-26 20:47:49.071064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.753 [2024-04-26 20:47:49.071070] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.753 [2024-04-26 20:47:49.071074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.753 [2024-04-26 20:47:49.071086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.753 qpair failed and we were unable to recover it. 00:30:30.753 [2024-04-26 20:47:49.081062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.753 [2024-04-26 20:47:49.081149] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.753 [2024-04-26 20:47:49.081163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.753 [2024-04-26 20:47:49.081168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.753 [2024-04-26 20:47:49.081173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.753 [2024-04-26 20:47:49.081184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.753 qpair failed and we were unable to recover it. 00:30:30.753 [2024-04-26 20:47:49.091103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:30.753 [2024-04-26 20:47:49.091188] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:30.753 [2024-04-26 20:47:49.091200] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:30.753 [2024-04-26 20:47:49.091206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:30.753 [2024-04-26 20:47:49.091214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:30.753 [2024-04-26 20:47:49.091226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:30.753 qpair failed and we were unable to recover it. 00:30:31.015 [2024-04-26 20:47:49.101118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.015 [2024-04-26 20:47:49.101201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.015 [2024-04-26 20:47:49.101214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.015 [2024-04-26 20:47:49.101220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.015 [2024-04-26 20:47:49.101225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.015 [2024-04-26 20:47:49.101237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.015 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.111124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.111246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.111260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.016 [2024-04-26 20:47:49.111266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.016 [2024-04-26 20:47:49.111271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.016 [2024-04-26 20:47:49.111289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.016 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.121189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.121284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.121298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.016 [2024-04-26 20:47:49.121303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.016 [2024-04-26 20:47:49.121308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.016 [2024-04-26 20:47:49.121320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.016 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.131179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.131262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.131275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.016 [2024-04-26 20:47:49.131285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.016 [2024-04-26 20:47:49.131290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.016 [2024-04-26 20:47:49.131302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.016 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.141247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.141336] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.141349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.016 [2024-04-26 20:47:49.141355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.016 [2024-04-26 20:47:49.141360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.016 [2024-04-26 20:47:49.141372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.016 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.151245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.151325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.151338] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.016 [2024-04-26 20:47:49.151344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.016 [2024-04-26 20:47:49.151349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.016 [2024-04-26 20:47:49.151361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.016 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.161273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.161382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.161396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.016 [2024-04-26 20:47:49.161401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.016 [2024-04-26 20:47:49.161406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.016 [2024-04-26 20:47:49.161418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.016 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.171324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.171410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.171424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.016 [2024-04-26 20:47:49.171430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.016 [2024-04-26 20:47:49.171435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.016 [2024-04-26 20:47:49.171447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.016 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.181518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.181600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.181613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.016 [2024-04-26 20:47:49.181622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.016 [2024-04-26 20:47:49.181626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.016 [2024-04-26 20:47:49.181638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.016 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.191436] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.191518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.191531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.016 [2024-04-26 20:47:49.191537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.016 [2024-04-26 20:47:49.191542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.016 [2024-04-26 20:47:49.191554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.016 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.201344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.201427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.201440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.016 [2024-04-26 20:47:49.201445] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.016 [2024-04-26 20:47:49.201450] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.016 [2024-04-26 20:47:49.201462] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.016 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.211473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.211558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.211571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.016 [2024-04-26 20:47:49.211577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.016 [2024-04-26 20:47:49.211582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.016 [2024-04-26 20:47:49.211594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.016 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.221482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.221565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.221578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.016 [2024-04-26 20:47:49.221584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.016 [2024-04-26 20:47:49.221589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.016 [2024-04-26 20:47:49.221601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.016 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.231511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.231590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.231604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.016 [2024-04-26 20:47:49.231609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.016 [2024-04-26 20:47:49.231615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.016 [2024-04-26 20:47:49.231627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.016 qpair failed and we were unable to recover it. 00:30:31.016 [2024-04-26 20:47:49.241525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.016 [2024-04-26 20:47:49.241623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.016 [2024-04-26 20:47:49.241636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.017 [2024-04-26 20:47:49.241642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.017 [2024-04-26 20:47:49.241647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.017 [2024-04-26 20:47:49.241658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.017 qpair failed and we were unable to recover it. 00:30:31.017 [2024-04-26 20:47:49.251440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.017 [2024-04-26 20:47:49.251519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.017 [2024-04-26 20:47:49.251533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.017 [2024-04-26 20:47:49.251538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.017 [2024-04-26 20:47:49.251543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.017 [2024-04-26 20:47:49.251555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.017 qpair failed and we were unable to recover it. 00:30:31.017 [2024-04-26 20:47:49.261562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.017 [2024-04-26 20:47:49.261645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.017 [2024-04-26 20:47:49.261658] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.017 [2024-04-26 20:47:49.261664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.017 [2024-04-26 20:47:49.261669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.017 [2024-04-26 20:47:49.261681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.017 qpair failed and we were unable to recover it. 00:30:31.017 [2024-04-26 20:47:49.271613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.017 [2024-04-26 20:47:49.271696] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.017 [2024-04-26 20:47:49.271710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.017 [2024-04-26 20:47:49.271718] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.017 [2024-04-26 20:47:49.271723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.017 [2024-04-26 20:47:49.271734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.017 qpair failed and we were unable to recover it. 00:30:31.017 [2024-04-26 20:47:49.281665] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.017 [2024-04-26 20:47:49.281748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.017 [2024-04-26 20:47:49.281761] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.017 [2024-04-26 20:47:49.281766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.017 [2024-04-26 20:47:49.281771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.017 [2024-04-26 20:47:49.281782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.017 qpair failed and we were unable to recover it. 00:30:31.017 [2024-04-26 20:47:49.291660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.017 [2024-04-26 20:47:49.291746] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.017 [2024-04-26 20:47:49.291760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.017 [2024-04-26 20:47:49.291766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.017 [2024-04-26 20:47:49.291770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.017 [2024-04-26 20:47:49.291782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.017 qpair failed and we were unable to recover it. 00:30:31.017 [2024-04-26 20:47:49.301587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.017 [2024-04-26 20:47:49.301667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.017 [2024-04-26 20:47:49.301680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.017 [2024-04-26 20:47:49.301685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.017 [2024-04-26 20:47:49.301689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.017 [2024-04-26 20:47:49.301700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.017 qpair failed and we were unable to recover it. 00:30:31.017 [2024-04-26 20:47:49.311712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.017 [2024-04-26 20:47:49.311795] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.017 [2024-04-26 20:47:49.311808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.017 [2024-04-26 20:47:49.311813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.017 [2024-04-26 20:47:49.311818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.017 [2024-04-26 20:47:49.311829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.017 qpair failed and we were unable to recover it. 00:30:31.017 [2024-04-26 20:47:49.321771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.017 [2024-04-26 20:47:49.321853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.017 [2024-04-26 20:47:49.321866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.017 [2024-04-26 20:47:49.321871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.017 [2024-04-26 20:47:49.321876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.017 [2024-04-26 20:47:49.321888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.017 qpair failed and we were unable to recover it. 00:30:31.017 [2024-04-26 20:47:49.331792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.017 [2024-04-26 20:47:49.331896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.017 [2024-04-26 20:47:49.331916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.017 [2024-04-26 20:47:49.331923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.017 [2024-04-26 20:47:49.331928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.017 [2024-04-26 20:47:49.331943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.017 qpair failed and we were unable to recover it. 00:30:31.017 [2024-04-26 20:47:49.341812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.017 [2024-04-26 20:47:49.341902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.017 [2024-04-26 20:47:49.341922] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.017 [2024-04-26 20:47:49.341928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.017 [2024-04-26 20:47:49.341933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.017 [2024-04-26 20:47:49.341948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.017 qpair failed and we were unable to recover it. 00:30:31.017 [2024-04-26 20:47:49.351867] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.017 [2024-04-26 20:47:49.351953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.017 [2024-04-26 20:47:49.351973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.017 [2024-04-26 20:47:49.351979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.017 [2024-04-26 20:47:49.351984] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.017 [2024-04-26 20:47:49.351999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.017 qpair failed and we were unable to recover it. 00:30:31.280 [2024-04-26 20:47:49.361944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.280 [2024-04-26 20:47:49.362033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.280 [2024-04-26 20:47:49.362057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.280 [2024-04-26 20:47:49.362064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.280 [2024-04-26 20:47:49.362069] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.280 [2024-04-26 20:47:49.362084] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.280 qpair failed and we were unable to recover it. 00:30:31.280 [2024-04-26 20:47:49.371921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.280 [2024-04-26 20:47:49.372006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.280 [2024-04-26 20:47:49.372026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.280 [2024-04-26 20:47:49.372033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.280 [2024-04-26 20:47:49.372038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.280 [2024-04-26 20:47:49.372053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.280 qpair failed and we were unable to recover it. 00:30:31.280 [2024-04-26 20:47:49.381910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.280 [2024-04-26 20:47:49.381994] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.280 [2024-04-26 20:47:49.382009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.280 [2024-04-26 20:47:49.382015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.280 [2024-04-26 20:47:49.382020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.280 [2024-04-26 20:47:49.382032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.280 qpair failed and we were unable to recover it. 00:30:31.280 [2024-04-26 20:47:49.391957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.280 [2024-04-26 20:47:49.392044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.280 [2024-04-26 20:47:49.392064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.280 [2024-04-26 20:47:49.392070] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.280 [2024-04-26 20:47:49.392075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.280 [2024-04-26 20:47:49.392090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.280 qpair failed and we were unable to recover it. 00:30:31.280 [2024-04-26 20:47:49.402003] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.280 [2024-04-26 20:47:49.402089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.402103] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.402110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.402115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.402130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.412033] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.412156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.412170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.412176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.412181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.412193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.421998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.422081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.422095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.422101] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.422107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.422119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.432104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.432187] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.432201] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.432207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.432212] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.432224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.442096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.442189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.442202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.442208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.442213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.442225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.452076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.452153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.452172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.452178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.452183] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.452195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.462118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.462206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.462219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.462225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.462230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.462242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.472171] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.472264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.472282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.472289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.472293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.472305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.482181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.482269] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.482287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.482293] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.482297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.482309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.492156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.492238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.492251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.492257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.492264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.492282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.502263] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.502346] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.502360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.502365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.502371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.502383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.512305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.512389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.512403] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.512408] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.512413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.512424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.522198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.522288] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.522303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.522308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.522313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.522325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.532352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.532432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.532446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.532451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.532456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.532468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.542382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.542467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.542481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.542486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.542491] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.542503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.552380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.552460] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.552473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.552479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.552484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.552496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.562530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.562622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.562635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.562641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.562645] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.562657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.572383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.572462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.572475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.572481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.572485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.572497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.582457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.582531] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.582545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.281 [2024-04-26 20:47:49.582550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.281 [2024-04-26 20:47:49.582559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.281 [2024-04-26 20:47:49.582570] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.281 qpair failed and we were unable to recover it. 00:30:31.281 [2024-04-26 20:47:49.592534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.281 [2024-04-26 20:47:49.592616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.281 [2024-04-26 20:47:49.592632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.282 [2024-04-26 20:47:49.592638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.282 [2024-04-26 20:47:49.592643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.282 [2024-04-26 20:47:49.592656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.282 qpair failed and we were unable to recover it. 00:30:31.282 [2024-04-26 20:47:49.602412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.282 [2024-04-26 20:47:49.602499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.282 [2024-04-26 20:47:49.602513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.282 [2024-04-26 20:47:49.602518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.282 [2024-04-26 20:47:49.602523] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.282 [2024-04-26 20:47:49.602535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.282 qpair failed and we were unable to recover it. 00:30:31.282 [2024-04-26 20:47:49.612581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.282 [2024-04-26 20:47:49.612708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.282 [2024-04-26 20:47:49.612721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.282 [2024-04-26 20:47:49.612727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.282 [2024-04-26 20:47:49.612732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.282 [2024-04-26 20:47:49.612743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.282 qpair failed and we were unable to recover it. 00:30:31.282 [2024-04-26 20:47:49.622508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.282 [2024-04-26 20:47:49.622599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.282 [2024-04-26 20:47:49.622613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.282 [2024-04-26 20:47:49.622618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.282 [2024-04-26 20:47:49.622622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.282 [2024-04-26 20:47:49.622634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.282 qpair failed and we were unable to recover it. 00:30:31.544 [2024-04-26 20:47:49.632610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.544 [2024-04-26 20:47:49.632697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.544 [2024-04-26 20:47:49.632711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.544 [2024-04-26 20:47:49.632717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.544 [2024-04-26 20:47:49.632722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.544 [2024-04-26 20:47:49.632733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.544 qpair failed and we were unable to recover it. 00:30:31.544 [2024-04-26 20:47:49.642660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.544 [2024-04-26 20:47:49.642745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.544 [2024-04-26 20:47:49.642758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.544 [2024-04-26 20:47:49.642763] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.544 [2024-04-26 20:47:49.642768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.544 [2024-04-26 20:47:49.642780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.544 qpair failed and we were unable to recover it. 00:30:31.544 [2024-04-26 20:47:49.652705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.544 [2024-04-26 20:47:49.652799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.544 [2024-04-26 20:47:49.652813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.544 [2024-04-26 20:47:49.652818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.544 [2024-04-26 20:47:49.652823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.544 [2024-04-26 20:47:49.652834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.544 qpair failed and we were unable to recover it. 00:30:31.544 [2024-04-26 20:47:49.662690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.544 [2024-04-26 20:47:49.662772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.544 [2024-04-26 20:47:49.662786] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.544 [2024-04-26 20:47:49.662792] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.544 [2024-04-26 20:47:49.662797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.544 [2024-04-26 20:47:49.662809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.544 qpair failed and we were unable to recover it. 00:30:31.544 [2024-04-26 20:47:49.672914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.544 [2024-04-26 20:47:49.673001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.544 [2024-04-26 20:47:49.673015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.544 [2024-04-26 20:47:49.673024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.544 [2024-04-26 20:47:49.673028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.544 [2024-04-26 20:47:49.673040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.544 qpair failed and we were unable to recover it. 00:30:31.544 [2024-04-26 20:47:49.682932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.544 [2024-04-26 20:47:49.683026] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.544 [2024-04-26 20:47:49.683047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.544 [2024-04-26 20:47:49.683053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.544 [2024-04-26 20:47:49.683058] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.544 [2024-04-26 20:47:49.683074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.544 qpair failed and we were unable to recover it. 00:30:31.544 [2024-04-26 20:47:49.692695] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.544 [2024-04-26 20:47:49.692777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.544 [2024-04-26 20:47:49.692797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.544 [2024-04-26 20:47:49.692804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.544 [2024-04-26 20:47:49.692809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.544 [2024-04-26 20:47:49.692824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.544 qpair failed and we were unable to recover it. 00:30:31.544 [2024-04-26 20:47:49.702851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.544 [2024-04-26 20:47:49.702938] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.544 [2024-04-26 20:47:49.702958] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.544 [2024-04-26 20:47:49.702964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.544 [2024-04-26 20:47:49.702969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.544 [2024-04-26 20:47:49.702984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.544 qpair failed and we were unable to recover it. 00:30:31.544 [2024-04-26 20:47:49.712881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.544 [2024-04-26 20:47:49.713003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.713018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.713023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.713028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.545 [2024-04-26 20:47:49.713040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.545 qpair failed and we were unable to recover it. 00:30:31.545 [2024-04-26 20:47:49.722889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.545 [2024-04-26 20:47:49.722970] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.722983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.722989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.722993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.545 [2024-04-26 20:47:49.723006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.545 qpair failed and we were unable to recover it. 00:30:31.545 [2024-04-26 20:47:49.732953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.545 [2024-04-26 20:47:49.733040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.733054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.733060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.733064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.545 [2024-04-26 20:47:49.733076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.545 qpair failed and we were unable to recover it. 00:30:31.545 [2024-04-26 20:47:49.742959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.545 [2024-04-26 20:47:49.743040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.743053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.743061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.743066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.545 [2024-04-26 20:47:49.743077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.545 qpair failed and we were unable to recover it. 00:30:31.545 [2024-04-26 20:47:49.752963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.545 [2024-04-26 20:47:49.753045] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.753058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.753064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.753068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.545 [2024-04-26 20:47:49.753080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.545 qpair failed and we were unable to recover it. 00:30:31.545 [2024-04-26 20:47:49.763026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.545 [2024-04-26 20:47:49.763155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.763169] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.763177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.763182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.545 [2024-04-26 20:47:49.763194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.545 qpair failed and we were unable to recover it. 00:30:31.545 [2024-04-26 20:47:49.773009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.545 [2024-04-26 20:47:49.773125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.773139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.773144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.773149] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.545 [2024-04-26 20:47:49.773161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.545 qpair failed and we were unable to recover it. 00:30:31.545 [2024-04-26 20:47:49.783062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.545 [2024-04-26 20:47:49.783141] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.783155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.783160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.783165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.545 [2024-04-26 20:47:49.783177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.545 qpair failed and we were unable to recover it. 00:30:31.545 [2024-04-26 20:47:49.793096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.545 [2024-04-26 20:47:49.793177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.793190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.793196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.793201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.545 [2024-04-26 20:47:49.793212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.545 qpair failed and we were unable to recover it. 00:30:31.545 [2024-04-26 20:47:49.803105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.545 [2024-04-26 20:47:49.803193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.803206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.803212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.803217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.545 [2024-04-26 20:47:49.803228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.545 qpair failed and we were unable to recover it. 00:30:31.545 [2024-04-26 20:47:49.813129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.545 [2024-04-26 20:47:49.813207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.813221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.813226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.813231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.545 [2024-04-26 20:47:49.813242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.545 qpair failed and we were unable to recover it. 00:30:31.545 [2024-04-26 20:47:49.823150] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.545 [2024-04-26 20:47:49.823256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.823270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.823282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.823287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.545 [2024-04-26 20:47:49.823298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.545 qpair failed and we were unable to recover it. 00:30:31.545 [2024-04-26 20:47:49.833185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.545 [2024-04-26 20:47:49.833265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.833282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.833288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.833292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.545 [2024-04-26 20:47:49.833304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.545 qpair failed and we were unable to recover it. 00:30:31.545 [2024-04-26 20:47:49.843241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.545 [2024-04-26 20:47:49.843364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.545 [2024-04-26 20:47:49.843378] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.545 [2024-04-26 20:47:49.843383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.545 [2024-04-26 20:47:49.843387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.546 [2024-04-26 20:47:49.843399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.546 qpair failed and we were unable to recover it. 00:30:31.546 [2024-04-26 20:47:49.853197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.546 [2024-04-26 20:47:49.853274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.546 [2024-04-26 20:47:49.853293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.546 [2024-04-26 20:47:49.853299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.546 [2024-04-26 20:47:49.853303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.546 [2024-04-26 20:47:49.853315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.546 qpair failed and we were unable to recover it. 00:30:31.546 [2024-04-26 20:47:49.863267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.546 [2024-04-26 20:47:49.863348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.546 [2024-04-26 20:47:49.863362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.546 [2024-04-26 20:47:49.863368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.546 [2024-04-26 20:47:49.863373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.546 [2024-04-26 20:47:49.863385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.546 qpair failed and we were unable to recover it. 00:30:31.546 [2024-04-26 20:47:49.873349] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.546 [2024-04-26 20:47:49.873431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.546 [2024-04-26 20:47:49.873444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.546 [2024-04-26 20:47:49.873450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.546 [2024-04-26 20:47:49.873455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.546 [2024-04-26 20:47:49.873467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.546 qpair failed and we were unable to recover it. 00:30:31.546 [2024-04-26 20:47:49.883330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.546 [2024-04-26 20:47:49.883414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.546 [2024-04-26 20:47:49.883428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.546 [2024-04-26 20:47:49.883434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.546 [2024-04-26 20:47:49.883439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.546 [2024-04-26 20:47:49.883450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.546 qpair failed and we were unable to recover it. 00:30:31.808 [2024-04-26 20:47:49.893352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.808 [2024-04-26 20:47:49.893434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.808 [2024-04-26 20:47:49.893448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.808 [2024-04-26 20:47:49.893454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.808 [2024-04-26 20:47:49.893459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.808 [2024-04-26 20:47:49.893474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.808 qpair failed and we were unable to recover it. 00:30:31.808 [2024-04-26 20:47:49.903386] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.808 [2024-04-26 20:47:49.903511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.808 [2024-04-26 20:47:49.903524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.808 [2024-04-26 20:47:49.903530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.808 [2024-04-26 20:47:49.903534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.808 [2024-04-26 20:47:49.903546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.808 qpair failed and we were unable to recover it. 00:30:31.808 [2024-04-26 20:47:49.913572] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.808 [2024-04-26 20:47:49.913695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.808 [2024-04-26 20:47:49.913708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.808 [2024-04-26 20:47:49.913714] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.808 [2024-04-26 20:47:49.913719] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.808 [2024-04-26 20:47:49.913731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.808 qpair failed and we were unable to recover it. 00:30:31.808 [2024-04-26 20:47:49.923468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.808 [2024-04-26 20:47:49.923552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.808 [2024-04-26 20:47:49.923565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.808 [2024-04-26 20:47:49.923570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.808 [2024-04-26 20:47:49.923576] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.808 [2024-04-26 20:47:49.923587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.808 qpair failed and we were unable to recover it. 00:30:31.808 [2024-04-26 20:47:49.933510] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.808 [2024-04-26 20:47:49.933591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.808 [2024-04-26 20:47:49.933604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.808 [2024-04-26 20:47:49.933610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.808 [2024-04-26 20:47:49.933615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.808 [2024-04-26 20:47:49.933626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.808 qpair failed and we were unable to recover it. 00:30:31.808 [2024-04-26 20:47:49.943519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.808 [2024-04-26 20:47:49.943611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.808 [2024-04-26 20:47:49.943627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.808 [2024-04-26 20:47:49.943633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.808 [2024-04-26 20:47:49.943637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.808 [2024-04-26 20:47:49.943648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.808 qpair failed and we were unable to recover it. 00:30:31.808 [2024-04-26 20:47:49.953562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.809 [2024-04-26 20:47:49.953642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.809 [2024-04-26 20:47:49.953655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.809 [2024-04-26 20:47:49.953661] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.809 [2024-04-26 20:47:49.953666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.809 [2024-04-26 20:47:49.953678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.809 qpair failed and we were unable to recover it. 00:30:31.809 [2024-04-26 20:47:49.963584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.809 [2024-04-26 20:47:49.963670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.809 [2024-04-26 20:47:49.963683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.809 [2024-04-26 20:47:49.963688] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.809 [2024-04-26 20:47:49.963693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.809 [2024-04-26 20:47:49.963705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.809 qpair failed and we were unable to recover it. 00:30:31.809 [2024-04-26 20:47:49.973596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.809 [2024-04-26 20:47:49.973674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.809 [2024-04-26 20:47:49.973687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.809 [2024-04-26 20:47:49.973693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.809 [2024-04-26 20:47:49.973698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.809 [2024-04-26 20:47:49.973709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.809 qpair failed and we were unable to recover it. 00:30:31.809 [2024-04-26 20:47:49.983619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.809 [2024-04-26 20:47:49.983698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.809 [2024-04-26 20:47:49.983711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.809 [2024-04-26 20:47:49.983716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.809 [2024-04-26 20:47:49.983721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.809 [2024-04-26 20:47:49.983736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.809 qpair failed and we were unable to recover it. 00:30:31.809 [2024-04-26 20:47:49.993575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.809 [2024-04-26 20:47:49.993657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.809 [2024-04-26 20:47:49.993670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.809 [2024-04-26 20:47:49.993676] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.809 [2024-04-26 20:47:49.993681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.809 [2024-04-26 20:47:49.993693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.809 qpair failed and we were unable to recover it. 00:30:31.809 [2024-04-26 20:47:50.003710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.809 [2024-04-26 20:47:50.003801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.809 [2024-04-26 20:47:50.003816] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.809 [2024-04-26 20:47:50.003823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.809 [2024-04-26 20:47:50.003827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.809 [2024-04-26 20:47:50.003839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.809 qpair failed and we were unable to recover it. 00:30:31.809 [2024-04-26 20:47:50.013690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.809 [2024-04-26 20:47:50.013777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.809 [2024-04-26 20:47:50.013790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.809 [2024-04-26 20:47:50.013796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.809 [2024-04-26 20:47:50.013801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.809 [2024-04-26 20:47:50.013813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.809 qpair failed and we were unable to recover it. 00:30:31.809 [2024-04-26 20:47:50.023739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.809 [2024-04-26 20:47:50.023820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.809 [2024-04-26 20:47:50.023834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.809 [2024-04-26 20:47:50.023839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.809 [2024-04-26 20:47:50.023844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.809 [2024-04-26 20:47:50.023856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.809 qpair failed and we were unable to recover it. 00:30:31.809 [2024-04-26 20:47:50.033811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.809 [2024-04-26 20:47:50.033918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.809 [2024-04-26 20:47:50.033935] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.809 [2024-04-26 20:47:50.033940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.809 [2024-04-26 20:47:50.033946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.809 [2024-04-26 20:47:50.033957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.809 qpair failed and we were unable to recover it. 00:30:31.809 [2024-04-26 20:47:50.043745] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.809 [2024-04-26 20:47:50.043832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.809 [2024-04-26 20:47:50.043845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.809 [2024-04-26 20:47:50.043851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.809 [2024-04-26 20:47:50.043856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.809 [2024-04-26 20:47:50.043868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.809 qpair failed and we were unable to recover it. 00:30:31.809 [2024-04-26 20:47:50.053850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.809 [2024-04-26 20:47:50.053930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.809 [2024-04-26 20:47:50.053943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.809 [2024-04-26 20:47:50.053949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.809 [2024-04-26 20:47:50.053954] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.809 [2024-04-26 20:47:50.053965] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.809 qpair failed and we were unable to recover it. 00:30:31.809 [2024-04-26 20:47:50.063862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.809 [2024-04-26 20:47:50.063963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.809 [2024-04-26 20:47:50.063976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.809 [2024-04-26 20:47:50.063982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.809 [2024-04-26 20:47:50.063986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.809 [2024-04-26 20:47:50.063997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.809 qpair failed and we were unable to recover it. 00:30:31.809 [2024-04-26 20:47:50.073921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.809 [2024-04-26 20:47:50.074002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.809 [2024-04-26 20:47:50.074016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.809 [2024-04-26 20:47:50.074021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.810 [2024-04-26 20:47:50.074029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.810 [2024-04-26 20:47:50.074042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.810 qpair failed and we were unable to recover it. 00:30:31.810 [2024-04-26 20:47:50.083840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.810 [2024-04-26 20:47:50.083935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.810 [2024-04-26 20:47:50.083949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.810 [2024-04-26 20:47:50.083954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.810 [2024-04-26 20:47:50.083959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.810 [2024-04-26 20:47:50.083970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.810 qpair failed and we were unable to recover it. 00:30:31.810 [2024-04-26 20:47:50.093933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.810 [2024-04-26 20:47:50.094014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.810 [2024-04-26 20:47:50.094027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.810 [2024-04-26 20:47:50.094033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.810 [2024-04-26 20:47:50.094038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.810 [2024-04-26 20:47:50.094050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.810 qpair failed and we were unable to recover it. 00:30:31.810 [2024-04-26 20:47:50.104009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.810 [2024-04-26 20:47:50.104093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.810 [2024-04-26 20:47:50.104106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.810 [2024-04-26 20:47:50.104112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.810 [2024-04-26 20:47:50.104117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.810 [2024-04-26 20:47:50.104128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.810 qpair failed and we were unable to recover it. 00:30:31.810 [2024-04-26 20:47:50.113972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.810 [2024-04-26 20:47:50.114054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.810 [2024-04-26 20:47:50.114067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.810 [2024-04-26 20:47:50.114073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.810 [2024-04-26 20:47:50.114078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.810 [2024-04-26 20:47:50.114090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.810 qpair failed and we were unable to recover it. 00:30:31.810 [2024-04-26 20:47:50.124060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.810 [2024-04-26 20:47:50.124149] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.810 [2024-04-26 20:47:50.124163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.810 [2024-04-26 20:47:50.124168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.810 [2024-04-26 20:47:50.124173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.810 [2024-04-26 20:47:50.124184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.810 qpair failed and we were unable to recover it. 00:30:31.810 [2024-04-26 20:47:50.134073] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.810 [2024-04-26 20:47:50.134154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.810 [2024-04-26 20:47:50.134167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.810 [2024-04-26 20:47:50.134173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.810 [2024-04-26 20:47:50.134178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.810 [2024-04-26 20:47:50.134190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.810 qpair failed and we were unable to recover it. 00:30:31.810 [2024-04-26 20:47:50.144020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:31.810 [2024-04-26 20:47:50.144112] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:31.810 [2024-04-26 20:47:50.144125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:31.810 [2024-04-26 20:47:50.144131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:31.810 [2024-04-26 20:47:50.144135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:31.810 [2024-04-26 20:47:50.144147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:31.810 qpair failed and we were unable to recover it. 00:30:32.074 [2024-04-26 20:47:50.154118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.074 [2024-04-26 20:47:50.154201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.074 [2024-04-26 20:47:50.154215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.074 [2024-04-26 20:47:50.154220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.074 [2024-04-26 20:47:50.154225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.074 [2024-04-26 20:47:50.154236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-04-26 20:47:50.164158] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.074 [2024-04-26 20:47:50.164240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.074 [2024-04-26 20:47:50.164253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.074 [2024-04-26 20:47:50.164265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.074 [2024-04-26 20:47:50.164271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.074 [2024-04-26 20:47:50.164287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-04-26 20:47:50.174182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.074 [2024-04-26 20:47:50.174262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.074 [2024-04-26 20:47:50.174275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.074 [2024-04-26 20:47:50.174285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.074 [2024-04-26 20:47:50.174290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.074 [2024-04-26 20:47:50.174301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-04-26 20:47:50.184175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.074 [2024-04-26 20:47:50.184249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.074 [2024-04-26 20:47:50.184262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.074 [2024-04-26 20:47:50.184268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.074 [2024-04-26 20:47:50.184273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.074 [2024-04-26 20:47:50.184290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-04-26 20:47:50.194227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.074 [2024-04-26 20:47:50.194314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.074 [2024-04-26 20:47:50.194327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.074 [2024-04-26 20:47:50.194333] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.074 [2024-04-26 20:47:50.194338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.074 [2024-04-26 20:47:50.194350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-04-26 20:47:50.204156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.074 [2024-04-26 20:47:50.204247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.074 [2024-04-26 20:47:50.204260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.074 [2024-04-26 20:47:50.204265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.074 [2024-04-26 20:47:50.204270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.074 [2024-04-26 20:47:50.204287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-04-26 20:47:50.214150] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.074 [2024-04-26 20:47:50.214227] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.074 [2024-04-26 20:47:50.214241] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.074 [2024-04-26 20:47:50.214246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.074 [2024-04-26 20:47:50.214251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.074 [2024-04-26 20:47:50.214263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-04-26 20:47:50.224275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.074 [2024-04-26 20:47:50.224362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.074 [2024-04-26 20:47:50.224375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.074 [2024-04-26 20:47:50.224380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.074 [2024-04-26 20:47:50.224385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.074 [2024-04-26 20:47:50.224397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-04-26 20:47:50.234335] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.074 [2024-04-26 20:47:50.234425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.074 [2024-04-26 20:47:50.234438] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.074 [2024-04-26 20:47:50.234443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.074 [2024-04-26 20:47:50.234449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.074 [2024-04-26 20:47:50.234460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-04-26 20:47:50.244334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.074 [2024-04-26 20:47:50.244418] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.074 [2024-04-26 20:47:50.244431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.074 [2024-04-26 20:47:50.244436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.074 [2024-04-26 20:47:50.244441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.074 [2024-04-26 20:47:50.244453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.074 qpair failed and we were unable to recover it. 00:30:32.074 [2024-04-26 20:47:50.254429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.074 [2024-04-26 20:47:50.254508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.074 [2024-04-26 20:47:50.254521] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.074 [2024-04-26 20:47:50.254530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.074 [2024-04-26 20:47:50.254535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.254547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.264437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.075 [2024-04-26 20:47:50.264562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.075 [2024-04-26 20:47:50.264576] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.075 [2024-04-26 20:47:50.264582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.075 [2024-04-26 20:47:50.264586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.264598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.274464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.075 [2024-04-26 20:47:50.274547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.075 [2024-04-26 20:47:50.274560] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.075 [2024-04-26 20:47:50.274565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.075 [2024-04-26 20:47:50.274570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.274581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.284493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.075 [2024-04-26 20:47:50.284574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.075 [2024-04-26 20:47:50.284588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.075 [2024-04-26 20:47:50.284593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.075 [2024-04-26 20:47:50.284598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.284609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.294535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.075 [2024-04-26 20:47:50.294616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.075 [2024-04-26 20:47:50.294629] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.075 [2024-04-26 20:47:50.294635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.075 [2024-04-26 20:47:50.294640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.294651] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.304513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.075 [2024-04-26 20:47:50.304590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.075 [2024-04-26 20:47:50.304604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.075 [2024-04-26 20:47:50.304609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.075 [2024-04-26 20:47:50.304615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.304626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.314557] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.075 [2024-04-26 20:47:50.314638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.075 [2024-04-26 20:47:50.314651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.075 [2024-04-26 20:47:50.314657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.075 [2024-04-26 20:47:50.314662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.314673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.324470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.075 [2024-04-26 20:47:50.324560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.075 [2024-04-26 20:47:50.324574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.075 [2024-04-26 20:47:50.324580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.075 [2024-04-26 20:47:50.324585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.324597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.334500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.075 [2024-04-26 20:47:50.334578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.075 [2024-04-26 20:47:50.334591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.075 [2024-04-26 20:47:50.334597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.075 [2024-04-26 20:47:50.334602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.334615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.344633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.075 [2024-04-26 20:47:50.344728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.075 [2024-04-26 20:47:50.344744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.075 [2024-04-26 20:47:50.344750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.075 [2024-04-26 20:47:50.344755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.344767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.354662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.075 [2024-04-26 20:47:50.354748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.075 [2024-04-26 20:47:50.354761] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.075 [2024-04-26 20:47:50.354767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.075 [2024-04-26 20:47:50.354771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.354783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.364709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.075 [2024-04-26 20:47:50.364797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.075 [2024-04-26 20:47:50.364810] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.075 [2024-04-26 20:47:50.364816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.075 [2024-04-26 20:47:50.364821] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.364832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.374679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.075 [2024-04-26 20:47:50.374759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.075 [2024-04-26 20:47:50.374772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.075 [2024-04-26 20:47:50.374778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.075 [2024-04-26 20:47:50.374783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.374795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.384734] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.075 [2024-04-26 20:47:50.384815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.075 [2024-04-26 20:47:50.384828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.075 [2024-04-26 20:47:50.384833] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.075 [2024-04-26 20:47:50.384839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.075 [2024-04-26 20:47:50.384852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.075 qpair failed and we were unable to recover it. 00:30:32.075 [2024-04-26 20:47:50.394798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.076 [2024-04-26 20:47:50.394882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.076 [2024-04-26 20:47:50.394902] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.076 [2024-04-26 20:47:50.394909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.076 [2024-04-26 20:47:50.394914] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.076 [2024-04-26 20:47:50.394929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-04-26 20:47:50.404835] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.076 [2024-04-26 20:47:50.404926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.076 [2024-04-26 20:47:50.404946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.076 [2024-04-26 20:47:50.404953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.076 [2024-04-26 20:47:50.404958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.076 [2024-04-26 20:47:50.404973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.076 [2024-04-26 20:47:50.414866] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.076 [2024-04-26 20:47:50.414943] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.076 [2024-04-26 20:47:50.414957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.076 [2024-04-26 20:47:50.414963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.076 [2024-04-26 20:47:50.414967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.076 [2024-04-26 20:47:50.414979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.076 qpair failed and we were unable to recover it. 00:30:32.340 [2024-04-26 20:47:50.424883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.340 [2024-04-26 20:47:50.424970] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.340 [2024-04-26 20:47:50.424990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.340 [2024-04-26 20:47:50.424997] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.340 [2024-04-26 20:47:50.425002] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.340 [2024-04-26 20:47:50.425018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.340 qpair failed and we were unable to recover it. 00:30:32.340 [2024-04-26 20:47:50.434914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.340 [2024-04-26 20:47:50.435001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.340 [2024-04-26 20:47:50.435025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.340 [2024-04-26 20:47:50.435032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.340 [2024-04-26 20:47:50.435037] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.340 [2024-04-26 20:47:50.435052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.340 qpair failed and we were unable to recover it. 00:30:32.340 [2024-04-26 20:47:50.444908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.340 [2024-04-26 20:47:50.445000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.340 [2024-04-26 20:47:50.445016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.340 [2024-04-26 20:47:50.445022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.340 [2024-04-26 20:47:50.445027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.340 [2024-04-26 20:47:50.445039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.340 qpair failed and we were unable to recover it. 00:30:32.340 [2024-04-26 20:47:50.454987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.340 [2024-04-26 20:47:50.455080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.340 [2024-04-26 20:47:50.455094] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.340 [2024-04-26 20:47:50.455100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.340 [2024-04-26 20:47:50.455104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.340 [2024-04-26 20:47:50.455116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.340 qpair failed and we were unable to recover it. 00:30:32.340 [2024-04-26 20:47:50.464956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.340 [2024-04-26 20:47:50.465054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.340 [2024-04-26 20:47:50.465070] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.340 [2024-04-26 20:47:50.465076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.340 [2024-04-26 20:47:50.465081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.340 [2024-04-26 20:47:50.465093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.475001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.475086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.475099] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.475105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.475110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.475124] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.485050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.485137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.485150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.485156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.485161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.485173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.495077] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.495158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.495171] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.495177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.495182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.495194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.505124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.505210] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.505223] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.505229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.505234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.505245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.515135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.515230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.515243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.515249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.515254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.515265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.525161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.525242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.525258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.525264] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.525269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.525286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.535154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.535237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.535250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.535257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.535261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.535274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.545238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.545323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.545336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.545343] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.545347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.545359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.555250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.555341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.555354] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.555360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.555365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.555377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.565157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.565245] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.565258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.565264] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.565272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.565288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.575273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.575359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.575373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.575379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.575384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.575396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.585319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.585427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.585440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.585446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.585451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.585463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.595338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.595419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.595432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.595437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.595442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.595454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.605344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.605446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.605459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.605464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.605469] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.605481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.615555] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.615646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.615659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.615665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.615670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.615681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.625435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.625517] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.625530] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.625536] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.625541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.625552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.635479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.635560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.635575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.635581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.635586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.635600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.645530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.645763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.645779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.645784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.341 [2024-04-26 20:47:50.645789] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.341 [2024-04-26 20:47:50.645800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.341 qpair failed and we were unable to recover it. 00:30:32.341 [2024-04-26 20:47:50.655580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.341 [2024-04-26 20:47:50.655661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.341 [2024-04-26 20:47:50.655674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.341 [2024-04-26 20:47:50.655680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.342 [2024-04-26 20:47:50.655687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.342 [2024-04-26 20:47:50.655699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.342 qpair failed and we were unable to recover it. 00:30:32.342 [2024-04-26 20:47:50.665603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.342 [2024-04-26 20:47:50.665700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.342 [2024-04-26 20:47:50.665713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.342 [2024-04-26 20:47:50.665719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.342 [2024-04-26 20:47:50.665723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.342 [2024-04-26 20:47:50.665735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.342 qpair failed and we were unable to recover it. 00:30:32.342 [2024-04-26 20:47:50.675634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.342 [2024-04-26 20:47:50.675742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.342 [2024-04-26 20:47:50.675755] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.342 [2024-04-26 20:47:50.675760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.342 [2024-04-26 20:47:50.675765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.342 [2024-04-26 20:47:50.675776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.342 qpair failed and we were unable to recover it. 00:30:32.605 [2024-04-26 20:47:50.685634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.605 [2024-04-26 20:47:50.685720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.605 [2024-04-26 20:47:50.685733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.605 [2024-04-26 20:47:50.685739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.605 [2024-04-26 20:47:50.685744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.605 [2024-04-26 20:47:50.685755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.605 qpair failed and we were unable to recover it. 00:30:32.605 [2024-04-26 20:47:50.695674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.605 [2024-04-26 20:47:50.695756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.605 [2024-04-26 20:47:50.695769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.605 [2024-04-26 20:47:50.695775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.605 [2024-04-26 20:47:50.695780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.605 [2024-04-26 20:47:50.695792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.605 qpair failed and we were unable to recover it. 00:30:32.605 [2024-04-26 20:47:50.705705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.605 [2024-04-26 20:47:50.705786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.605 [2024-04-26 20:47:50.705799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.605 [2024-04-26 20:47:50.705805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.605 [2024-04-26 20:47:50.705810] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.605 [2024-04-26 20:47:50.705821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.605 qpair failed and we were unable to recover it. 00:30:32.605 [2024-04-26 20:47:50.715728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.605 [2024-04-26 20:47:50.715810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.605 [2024-04-26 20:47:50.715823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.605 [2024-04-26 20:47:50.715828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.605 [2024-04-26 20:47:50.715834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.605 [2024-04-26 20:47:50.715846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.605 qpair failed and we were unable to recover it. 00:30:32.605 [2024-04-26 20:47:50.725756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.605 [2024-04-26 20:47:50.725842] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.605 [2024-04-26 20:47:50.725855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.605 [2024-04-26 20:47:50.725861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.605 [2024-04-26 20:47:50.725866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.605 [2024-04-26 20:47:50.725877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.605 qpair failed and we were unable to recover it. 00:30:32.605 [2024-04-26 20:47:50.735789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.605 [2024-04-26 20:47:50.735877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.605 [2024-04-26 20:47:50.735891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.605 [2024-04-26 20:47:50.735896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.605 [2024-04-26 20:47:50.735901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.605 [2024-04-26 20:47:50.735912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.605 qpair failed and we were unable to recover it. 00:30:32.605 [2024-04-26 20:47:50.745682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.605 [2024-04-26 20:47:50.745767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.605 [2024-04-26 20:47:50.745780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.605 [2024-04-26 20:47:50.745789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.605 [2024-04-26 20:47:50.745794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.605 [2024-04-26 20:47:50.745805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.605 qpair failed and we were unable to recover it. 00:30:32.605 [2024-04-26 20:47:50.755844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.605 [2024-04-26 20:47:50.755928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.605 [2024-04-26 20:47:50.755942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.605 [2024-04-26 20:47:50.755948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.605 [2024-04-26 20:47:50.755953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.605 [2024-04-26 20:47:50.755964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.605 qpair failed and we were unable to recover it. 00:30:32.605 [2024-04-26 20:47:50.765881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.605 [2024-04-26 20:47:50.765961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.605 [2024-04-26 20:47:50.765974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.605 [2024-04-26 20:47:50.765979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.605 [2024-04-26 20:47:50.765984] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.605 [2024-04-26 20:47:50.765996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.605 qpair failed and we were unable to recover it. 00:30:32.605 [2024-04-26 20:47:50.775902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.605 [2024-04-26 20:47:50.775987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.605 [2024-04-26 20:47:50.776007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.605 [2024-04-26 20:47:50.776014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.605 [2024-04-26 20:47:50.776019] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.605 [2024-04-26 20:47:50.776034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.605 qpair failed and we were unable to recover it. 00:30:32.605 [2024-04-26 20:47:50.785814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.605 [2024-04-26 20:47:50.785897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.605 [2024-04-26 20:47:50.785912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.605 [2024-04-26 20:47:50.785918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.605 [2024-04-26 20:47:50.785922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.785935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.795978] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.606 [2024-04-26 20:47:50.796061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.606 [2024-04-26 20:47:50.796081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.606 [2024-04-26 20:47:50.796088] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.606 [2024-04-26 20:47:50.796094] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.796108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.805914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.606 [2024-04-26 20:47:50.806017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.606 [2024-04-26 20:47:50.806036] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.606 [2024-04-26 20:47:50.806043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.606 [2024-04-26 20:47:50.806048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.806063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.816046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.606 [2024-04-26 20:47:50.816134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.606 [2024-04-26 20:47:50.816154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.606 [2024-04-26 20:47:50.816161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.606 [2024-04-26 20:47:50.816166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.816181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.826049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.606 [2024-04-26 20:47:50.826135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.606 [2024-04-26 20:47:50.826155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.606 [2024-04-26 20:47:50.826161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.606 [2024-04-26 20:47:50.826167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.826182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.836054] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.606 [2024-04-26 20:47:50.836138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.606 [2024-04-26 20:47:50.836153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.606 [2024-04-26 20:47:50.836162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.606 [2024-04-26 20:47:50.836167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.836181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.846104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.606 [2024-04-26 20:47:50.846210] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.606 [2024-04-26 20:47:50.846223] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.606 [2024-04-26 20:47:50.846229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.606 [2024-04-26 20:47:50.846234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.846245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.856099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.606 [2024-04-26 20:47:50.856181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.606 [2024-04-26 20:47:50.856194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.606 [2024-04-26 20:47:50.856200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.606 [2024-04-26 20:47:50.856205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.856216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.866132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.606 [2024-04-26 20:47:50.866219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.606 [2024-04-26 20:47:50.866233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.606 [2024-04-26 20:47:50.866238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.606 [2024-04-26 20:47:50.866243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.866255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.876180] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.606 [2024-04-26 20:47:50.876259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.606 [2024-04-26 20:47:50.876273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.606 [2024-04-26 20:47:50.876284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.606 [2024-04-26 20:47:50.876289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.876301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.886275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.606 [2024-04-26 20:47:50.886380] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.606 [2024-04-26 20:47:50.886393] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.606 [2024-04-26 20:47:50.886399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.606 [2024-04-26 20:47:50.886403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.886415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.896241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.606 [2024-04-26 20:47:50.896326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.606 [2024-04-26 20:47:50.896340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.606 [2024-04-26 20:47:50.896346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.606 [2024-04-26 20:47:50.896350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.896362] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.906226] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.606 [2024-04-26 20:47:50.906308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.606 [2024-04-26 20:47:50.906322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.606 [2024-04-26 20:47:50.906327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.606 [2024-04-26 20:47:50.906333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.906345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.916207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.606 [2024-04-26 20:47:50.916289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.606 [2024-04-26 20:47:50.916303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.606 [2024-04-26 20:47:50.916309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.606 [2024-04-26 20:47:50.916313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.606 [2024-04-26 20:47:50.916325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.606 qpair failed and we were unable to recover it. 00:30:32.606 [2024-04-26 20:47:50.926239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.607 [2024-04-26 20:47:50.926324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.607 [2024-04-26 20:47:50.926341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.607 [2024-04-26 20:47:50.926347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.607 [2024-04-26 20:47:50.926351] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.607 [2024-04-26 20:47:50.926363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.607 qpair failed and we were unable to recover it. 00:30:32.607 [2024-04-26 20:47:50.936389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.607 [2024-04-26 20:47:50.936499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.607 [2024-04-26 20:47:50.936513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.607 [2024-04-26 20:47:50.936519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.607 [2024-04-26 20:47:50.936523] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.607 [2024-04-26 20:47:50.936535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.607 qpair failed and we were unable to recover it. 00:30:32.607 [2024-04-26 20:47:50.946391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.607 [2024-04-26 20:47:50.946509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.607 [2024-04-26 20:47:50.946522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.607 [2024-04-26 20:47:50.946528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.607 [2024-04-26 20:47:50.946532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.607 [2024-04-26 20:47:50.946544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.607 qpair failed and we were unable to recover it. 00:30:32.869 [2024-04-26 20:47:50.956415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.869 [2024-04-26 20:47:50.956499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.869 [2024-04-26 20:47:50.956513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.869 [2024-04-26 20:47:50.956518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.869 [2024-04-26 20:47:50.956524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.869 [2024-04-26 20:47:50.956535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.869 qpair failed and we were unable to recover it. 00:30:32.869 [2024-04-26 20:47:50.966449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.869 [2024-04-26 20:47:50.966540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.869 [2024-04-26 20:47:50.966554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.869 [2024-04-26 20:47:50.966559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.869 [2024-04-26 20:47:50.966564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.869 [2024-04-26 20:47:50.966579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.869 qpair failed and we were unable to recover it. 00:30:32.869 [2024-04-26 20:47:50.976483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.869 [2024-04-26 20:47:50.976564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.869 [2024-04-26 20:47:50.976578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.869 [2024-04-26 20:47:50.976584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.869 [2024-04-26 20:47:50.976589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.869 [2024-04-26 20:47:50.976601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.869 qpair failed and we were unable to recover it. 00:30:32.869 [2024-04-26 20:47:50.986485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.869 [2024-04-26 20:47:50.986580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.869 [2024-04-26 20:47:50.986594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.869 [2024-04-26 20:47:50.986599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.869 [2024-04-26 20:47:50.986604] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.869 [2024-04-26 20:47:50.986616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.869 qpair failed and we were unable to recover it. 00:30:32.869 [2024-04-26 20:47:50.996507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.869 [2024-04-26 20:47:50.996589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.869 [2024-04-26 20:47:50.996602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.869 [2024-04-26 20:47:50.996608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.869 [2024-04-26 20:47:50.996613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.869 [2024-04-26 20:47:50.996624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.869 qpair failed and we were unable to recover it. 00:30:32.869 [2024-04-26 20:47:51.006580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.869 [2024-04-26 20:47:51.006667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.869 [2024-04-26 20:47:51.006680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.869 [2024-04-26 20:47:51.006686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.869 [2024-04-26 20:47:51.006692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.869 [2024-04-26 20:47:51.006703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.869 qpair failed and we were unable to recover it. 00:30:32.869 [2024-04-26 20:47:51.016469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.869 [2024-04-26 20:47:51.016568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.869 [2024-04-26 20:47:51.016584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.869 [2024-04-26 20:47:51.016590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.869 [2024-04-26 20:47:51.016594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.869 [2024-04-26 20:47:51.016606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.869 qpair failed and we were unable to recover it. 00:30:32.869 [2024-04-26 20:47:51.026607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.869 [2024-04-26 20:47:51.026691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.869 [2024-04-26 20:47:51.026705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.869 [2024-04-26 20:47:51.026710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.869 [2024-04-26 20:47:51.026716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.869 [2024-04-26 20:47:51.026727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.869 qpair failed and we were unable to recover it. 00:30:32.870 [2024-04-26 20:47:51.036683] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.870 [2024-04-26 20:47:51.036798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.870 [2024-04-26 20:47:51.036812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.870 [2024-04-26 20:47:51.036817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.870 [2024-04-26 20:47:51.036822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.870 [2024-04-26 20:47:51.036834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.870 qpair failed and we were unable to recover it. 00:30:32.870 [2024-04-26 20:47:51.046718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.870 [2024-04-26 20:47:51.046809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.870 [2024-04-26 20:47:51.046822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.870 [2024-04-26 20:47:51.046828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.870 [2024-04-26 20:47:51.046833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.870 [2024-04-26 20:47:51.046844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.870 qpair failed and we were unable to recover it. 00:30:32.870 [2024-04-26 20:47:51.056740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.870 [2024-04-26 20:47:51.056824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.870 [2024-04-26 20:47:51.056837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.870 [2024-04-26 20:47:51.056844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.870 [2024-04-26 20:47:51.056851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.870 [2024-04-26 20:47:51.056862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.870 qpair failed and we were unable to recover it. 00:30:32.870 [2024-04-26 20:47:51.066754] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.870 [2024-04-26 20:47:51.066843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.870 [2024-04-26 20:47:51.066863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.870 [2024-04-26 20:47:51.066871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.870 [2024-04-26 20:47:51.066875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.870 [2024-04-26 20:47:51.066890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.870 qpair failed and we were unable to recover it. 00:30:32.870 [2024-04-26 20:47:51.076776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.870 [2024-04-26 20:47:51.076913] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.870 [2024-04-26 20:47:51.076933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.870 [2024-04-26 20:47:51.076940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.870 [2024-04-26 20:47:51.076945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.870 [2024-04-26 20:47:51.076960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.870 qpair failed and we were unable to recover it. 00:30:32.870 [2024-04-26 20:47:51.086826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.870 [2024-04-26 20:47:51.086921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.870 [2024-04-26 20:47:51.086936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.870 [2024-04-26 20:47:51.086942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.870 [2024-04-26 20:47:51.086946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.870 [2024-04-26 20:47:51.086959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.870 qpair failed and we were unable to recover it. 00:30:32.870 [2024-04-26 20:47:51.096758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.870 [2024-04-26 20:47:51.096848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.870 [2024-04-26 20:47:51.096869] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.870 [2024-04-26 20:47:51.096875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.870 [2024-04-26 20:47:51.096880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.870 [2024-04-26 20:47:51.096895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.870 qpair failed and we were unable to recover it. 00:30:32.870 [2024-04-26 20:47:51.106897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.870 [2024-04-26 20:47:51.107007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.870 [2024-04-26 20:47:51.107022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.870 [2024-04-26 20:47:51.107028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.870 [2024-04-26 20:47:51.107033] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.870 [2024-04-26 20:47:51.107045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.870 qpair failed and we were unable to recover it. 00:30:32.870 [2024-04-26 20:47:51.116880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.870 [2024-04-26 20:47:51.116967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.870 [2024-04-26 20:47:51.116986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.870 [2024-04-26 20:47:51.116993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.870 [2024-04-26 20:47:51.116998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.870 [2024-04-26 20:47:51.117013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.870 qpair failed and we were unable to recover it. 00:30:32.870 [2024-04-26 20:47:51.126927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.870 [2024-04-26 20:47:51.127015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.870 [2024-04-26 20:47:51.127035] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.870 [2024-04-26 20:47:51.127041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.870 [2024-04-26 20:47:51.127046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.870 [2024-04-26 20:47:51.127061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.870 qpair failed and we were unable to recover it. 00:30:32.870 [2024-04-26 20:47:51.136816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.870 [2024-04-26 20:47:51.136916] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.870 [2024-04-26 20:47:51.136931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.870 [2024-04-26 20:47:51.136937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.870 [2024-04-26 20:47:51.136941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.870 [2024-04-26 20:47:51.136953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.870 qpair failed and we were unable to recover it. 00:30:32.870 [2024-04-26 20:47:51.146961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.871 [2024-04-26 20:47:51.147044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.871 [2024-04-26 20:47:51.147065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.871 [2024-04-26 20:47:51.147071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.871 [2024-04-26 20:47:51.147081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.871 [2024-04-26 20:47:51.147096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.871 qpair failed and we were unable to recover it. 00:30:32.871 [2024-04-26 20:47:51.157013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.871 [2024-04-26 20:47:51.157101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.871 [2024-04-26 20:47:51.157121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.871 [2024-04-26 20:47:51.157128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.871 [2024-04-26 20:47:51.157132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.871 [2024-04-26 20:47:51.157147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.871 qpair failed and we were unable to recover it. 00:30:32.871 [2024-04-26 20:47:51.167056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.871 [2024-04-26 20:47:51.167172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.871 [2024-04-26 20:47:51.167187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.871 [2024-04-26 20:47:51.167193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.871 [2024-04-26 20:47:51.167197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.871 [2024-04-26 20:47:51.167209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.871 qpair failed and we were unable to recover it. 00:30:32.871 [2024-04-26 20:47:51.177063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.871 [2024-04-26 20:47:51.177148] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.871 [2024-04-26 20:47:51.177163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.871 [2024-04-26 20:47:51.177169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.871 [2024-04-26 20:47:51.177173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.871 [2024-04-26 20:47:51.177185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.871 qpair failed and we were unable to recover it. 00:30:32.871 [2024-04-26 20:47:51.187090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.871 [2024-04-26 20:47:51.187180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.871 [2024-04-26 20:47:51.187194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.871 [2024-04-26 20:47:51.187200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.871 [2024-04-26 20:47:51.187204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.871 [2024-04-26 20:47:51.187216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.871 qpair failed and we were unable to recover it. 00:30:32.871 [2024-04-26 20:47:51.197288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.871 [2024-04-26 20:47:51.197387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.871 [2024-04-26 20:47:51.197402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.871 [2024-04-26 20:47:51.197407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.871 [2024-04-26 20:47:51.197412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.871 [2024-04-26 20:47:51.197424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.871 qpair failed and we were unable to recover it. 00:30:32.871 [2024-04-26 20:47:51.207322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:32.871 [2024-04-26 20:47:51.207412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:32.871 [2024-04-26 20:47:51.207425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:32.871 [2024-04-26 20:47:51.207431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:32.871 [2024-04-26 20:47:51.207435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:32.871 [2024-04-26 20:47:51.207447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:32.871 qpair failed and we were unable to recover it. 00:30:33.134 [2024-04-26 20:47:51.217107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.134 [2024-04-26 20:47:51.217208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.134 [2024-04-26 20:47:51.217222] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.134 [2024-04-26 20:47:51.217228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.134 [2024-04-26 20:47:51.217233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.134 [2024-04-26 20:47:51.217245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.134 qpair failed and we were unable to recover it. 00:30:33.134 [2024-04-26 20:47:51.227229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.134 [2024-04-26 20:47:51.227366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.134 [2024-04-26 20:47:51.227379] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.134 [2024-04-26 20:47:51.227385] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.134 [2024-04-26 20:47:51.227390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.134 [2024-04-26 20:47:51.227402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.134 qpair failed and we were unable to recover it. 00:30:33.134 [2024-04-26 20:47:51.237118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.134 [2024-04-26 20:47:51.237197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.134 [2024-04-26 20:47:51.237211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.134 [2024-04-26 20:47:51.237220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.134 [2024-04-26 20:47:51.237225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.134 [2024-04-26 20:47:51.237237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.134 qpair failed and we were unable to recover it. 00:30:33.134 [2024-04-26 20:47:51.247290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.134 [2024-04-26 20:47:51.247400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.134 [2024-04-26 20:47:51.247414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.134 [2024-04-26 20:47:51.247419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.134 [2024-04-26 20:47:51.247424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.134 [2024-04-26 20:47:51.247436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.134 qpair failed and we were unable to recover it. 00:30:33.134 [2024-04-26 20:47:51.257295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.257382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.257395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.257401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.135 [2024-04-26 20:47:51.257406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.135 [2024-04-26 20:47:51.257417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.135 qpair failed and we were unable to recover it. 00:30:33.135 [2024-04-26 20:47:51.267328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.267408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.267421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.267426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.135 [2024-04-26 20:47:51.267431] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.135 [2024-04-26 20:47:51.267442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.135 qpair failed and we were unable to recover it. 00:30:33.135 [2024-04-26 20:47:51.277351] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.277432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.277445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.277451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.135 [2024-04-26 20:47:51.277455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.135 [2024-04-26 20:47:51.277466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.135 qpair failed and we were unable to recover it. 00:30:33.135 [2024-04-26 20:47:51.287397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.287482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.287495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.287501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.135 [2024-04-26 20:47:51.287506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.135 [2024-04-26 20:47:51.287517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.135 qpair failed and we were unable to recover it. 00:30:33.135 [2024-04-26 20:47:51.297441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.297530] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.297544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.297550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.135 [2024-04-26 20:47:51.297554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.135 [2024-04-26 20:47:51.297565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.135 qpair failed and we were unable to recover it. 00:30:33.135 [2024-04-26 20:47:51.307481] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.307567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.307580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.307585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.135 [2024-04-26 20:47:51.307590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.135 [2024-04-26 20:47:51.307601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.135 qpair failed and we were unable to recover it. 00:30:33.135 [2024-04-26 20:47:51.317522] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.317606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.317619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.317624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.135 [2024-04-26 20:47:51.317629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.135 [2024-04-26 20:47:51.317641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.135 qpair failed and we were unable to recover it. 00:30:33.135 [2024-04-26 20:47:51.327470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.327559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.327573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.327581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.135 [2024-04-26 20:47:51.327585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.135 [2024-04-26 20:47:51.327597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.135 qpair failed and we were unable to recover it. 00:30:33.135 [2024-04-26 20:47:51.337441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.337526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.337539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.337546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.135 [2024-04-26 20:47:51.337551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.135 [2024-04-26 20:47:51.337563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.135 qpair failed and we were unable to recover it. 00:30:33.135 [2024-04-26 20:47:51.347548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.347648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.347662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.347667] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.135 [2024-04-26 20:47:51.347672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.135 [2024-04-26 20:47:51.347683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.135 qpair failed and we were unable to recover it. 00:30:33.135 [2024-04-26 20:47:51.357603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.357687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.357700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.357705] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.135 [2024-04-26 20:47:51.357711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.135 [2024-04-26 20:47:51.357722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.135 qpair failed and we were unable to recover it. 00:30:33.135 [2024-04-26 20:47:51.367547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.367631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.367644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.367650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.135 [2024-04-26 20:47:51.367655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.135 [2024-04-26 20:47:51.367666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.135 qpair failed and we were unable to recover it. 00:30:33.135 [2024-04-26 20:47:51.377626] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.377708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.377721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.377727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.135 [2024-04-26 20:47:51.377732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.135 [2024-04-26 20:47:51.377743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.135 qpair failed and we were unable to recover it. 00:30:33.135 [2024-04-26 20:47:51.387656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.135 [2024-04-26 20:47:51.387730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.135 [2024-04-26 20:47:51.387743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.135 [2024-04-26 20:47:51.387749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.136 [2024-04-26 20:47:51.387753] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.136 [2024-04-26 20:47:51.387765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.136 qpair failed and we were unable to recover it. 00:30:33.136 [2024-04-26 20:47:51.397590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.136 [2024-04-26 20:47:51.397672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.136 [2024-04-26 20:47:51.397686] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.136 [2024-04-26 20:47:51.397692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.136 [2024-04-26 20:47:51.397696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.136 [2024-04-26 20:47:51.397708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.136 qpair failed and we were unable to recover it. 00:30:33.136 [2024-04-26 20:47:51.407710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.136 [2024-04-26 20:47:51.407793] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.136 [2024-04-26 20:47:51.407806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.136 [2024-04-26 20:47:51.407812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.136 [2024-04-26 20:47:51.407817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.136 [2024-04-26 20:47:51.407828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.136 qpair failed and we were unable to recover it. 00:30:33.136 [2024-04-26 20:47:51.417742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.136 [2024-04-26 20:47:51.417820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.136 [2024-04-26 20:47:51.417836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.136 [2024-04-26 20:47:51.417842] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.136 [2024-04-26 20:47:51.417846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.136 [2024-04-26 20:47:51.417857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.136 qpair failed and we were unable to recover it. 00:30:33.136 [2024-04-26 20:47:51.427762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.136 [2024-04-26 20:47:51.427889] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.136 [2024-04-26 20:47:51.427902] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.136 [2024-04-26 20:47:51.427908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.136 [2024-04-26 20:47:51.427913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.136 [2024-04-26 20:47:51.427925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.136 qpair failed and we were unable to recover it. 00:30:33.136 [2024-04-26 20:47:51.437832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.136 [2024-04-26 20:47:51.437922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.136 [2024-04-26 20:47:51.437936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.136 [2024-04-26 20:47:51.437941] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.136 [2024-04-26 20:47:51.437946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.136 [2024-04-26 20:47:51.437957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.136 qpair failed and we were unable to recover it. 00:30:33.136 [2024-04-26 20:47:51.447732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.136 [2024-04-26 20:47:51.447816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.136 [2024-04-26 20:47:51.447829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.136 [2024-04-26 20:47:51.447835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.136 [2024-04-26 20:47:51.447839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.136 [2024-04-26 20:47:51.447851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.136 qpair failed and we were unable to recover it. 00:30:33.136 [2024-04-26 20:47:51.457858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.136 [2024-04-26 20:47:51.457939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.136 [2024-04-26 20:47:51.457952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.136 [2024-04-26 20:47:51.457958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.136 [2024-04-26 20:47:51.457962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.136 [2024-04-26 20:47:51.457976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.136 qpair failed and we were unable to recover it. 00:30:33.136 [2024-04-26 20:47:51.467874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.136 [2024-04-26 20:47:51.467954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.136 [2024-04-26 20:47:51.467967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.136 [2024-04-26 20:47:51.467973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.136 [2024-04-26 20:47:51.467977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.136 [2024-04-26 20:47:51.467989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.136 qpair failed and we were unable to recover it. 00:30:33.397 [2024-04-26 20:47:51.477903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.397 [2024-04-26 20:47:51.477986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.477999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.478005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.398 [2024-04-26 20:47:51.478009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.398 [2024-04-26 20:47:51.478021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.398 qpair failed and we were unable to recover it. 00:30:33.398 [2024-04-26 20:47:51.487976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.398 [2024-04-26 20:47:51.488108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.488121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.488127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.398 [2024-04-26 20:47:51.488131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.398 [2024-04-26 20:47:51.488143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.398 qpair failed and we were unable to recover it. 00:30:33.398 [2024-04-26 20:47:51.497956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.398 [2024-04-26 20:47:51.498037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.498050] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.498055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.398 [2024-04-26 20:47:51.498059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.398 [2024-04-26 20:47:51.498070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.398 qpair failed and we were unable to recover it. 00:30:33.398 [2024-04-26 20:47:51.507952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.398 [2024-04-26 20:47:51.508024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.508040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.508046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.398 [2024-04-26 20:47:51.508050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.398 [2024-04-26 20:47:51.508061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.398 qpair failed and we were unable to recover it. 00:30:33.398 [2024-04-26 20:47:51.518024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.398 [2024-04-26 20:47:51.518107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.518123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.518128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.398 [2024-04-26 20:47:51.518133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.398 [2024-04-26 20:47:51.518145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.398 qpair failed and we were unable to recover it. 00:30:33.398 [2024-04-26 20:47:51.528086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.398 [2024-04-26 20:47:51.528178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.528197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.528204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.398 [2024-04-26 20:47:51.528209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.398 [2024-04-26 20:47:51.528223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.398 qpair failed and we were unable to recover it. 00:30:33.398 [2024-04-26 20:47:51.538102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.398 [2024-04-26 20:47:51.538184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.538199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.538204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.398 [2024-04-26 20:47:51.538209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.398 [2024-04-26 20:47:51.538221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.398 qpair failed and we were unable to recover it. 00:30:33.398 [2024-04-26 20:47:51.548068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.398 [2024-04-26 20:47:51.548145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.548159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.548164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.398 [2024-04-26 20:47:51.548169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.398 [2024-04-26 20:47:51.548184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.398 qpair failed and we were unable to recover it. 00:30:33.398 [2024-04-26 20:47:51.558136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.398 [2024-04-26 20:47:51.558218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.558232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.558237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.398 [2024-04-26 20:47:51.558242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.398 [2024-04-26 20:47:51.558254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.398 qpair failed and we were unable to recover it. 00:30:33.398 [2024-04-26 20:47:51.568216] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.398 [2024-04-26 20:47:51.568306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.568320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.568326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.398 [2024-04-26 20:47:51.568331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.398 [2024-04-26 20:47:51.568343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.398 qpair failed and we were unable to recover it. 00:30:33.398 [2024-04-26 20:47:51.578204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.398 [2024-04-26 20:47:51.578287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.578301] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.578307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.398 [2024-04-26 20:47:51.578311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.398 [2024-04-26 20:47:51.578323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.398 qpair failed and we were unable to recover it. 00:30:33.398 [2024-04-26 20:47:51.588190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.398 [2024-04-26 20:47:51.588260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.588273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.588282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.398 [2024-04-26 20:47:51.588287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.398 [2024-04-26 20:47:51.588298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.398 qpair failed and we were unable to recover it. 00:30:33.398 [2024-04-26 20:47:51.598273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.398 [2024-04-26 20:47:51.598360] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.598375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.598381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.398 [2024-04-26 20:47:51.598386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.398 [2024-04-26 20:47:51.598398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.398 qpair failed and we were unable to recover it. 00:30:33.398 [2024-04-26 20:47:51.608309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.398 [2024-04-26 20:47:51.608394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.398 [2024-04-26 20:47:51.608407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.398 [2024-04-26 20:47:51.608413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.608417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.608428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.399 [2024-04-26 20:47:51.618274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.399 [2024-04-26 20:47:51.618355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.399 [2024-04-26 20:47:51.618368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.399 [2024-04-26 20:47:51.618374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.618379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.618391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.399 [2024-04-26 20:47:51.628274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.399 [2024-04-26 20:47:51.628358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.399 [2024-04-26 20:47:51.628371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.399 [2024-04-26 20:47:51.628377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.628381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.628393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.399 [2024-04-26 20:47:51.638391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.399 [2024-04-26 20:47:51.638471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.399 [2024-04-26 20:47:51.638484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.399 [2024-04-26 20:47:51.638490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.638499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.638511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.399 [2024-04-26 20:47:51.648404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.399 [2024-04-26 20:47:51.648488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.399 [2024-04-26 20:47:51.648502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.399 [2024-04-26 20:47:51.648507] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.648512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.648524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.399 [2024-04-26 20:47:51.658323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.399 [2024-04-26 20:47:51.658399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.399 [2024-04-26 20:47:51.658412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.399 [2024-04-26 20:47:51.658418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.658422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.658434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.399 [2024-04-26 20:47:51.668592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.399 [2024-04-26 20:47:51.668692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.399 [2024-04-26 20:47:51.668705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.399 [2024-04-26 20:47:51.668711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.668715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.668727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.399 [2024-04-26 20:47:51.678518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.399 [2024-04-26 20:47:51.678599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.399 [2024-04-26 20:47:51.678613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.399 [2024-04-26 20:47:51.678618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.678624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.678635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.399 [2024-04-26 20:47:51.688512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.399 [2024-04-26 20:47:51.688599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.399 [2024-04-26 20:47:51.688612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.399 [2024-04-26 20:47:51.688618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.688623] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.688635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.399 [2024-04-26 20:47:51.698493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.399 [2024-04-26 20:47:51.698565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.399 [2024-04-26 20:47:51.698578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.399 [2024-04-26 20:47:51.698583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.698588] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.698599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.399 [2024-04-26 20:47:51.708544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.399 [2024-04-26 20:47:51.708622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.399 [2024-04-26 20:47:51.708638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.399 [2024-04-26 20:47:51.708644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.708649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.708661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.399 [2024-04-26 20:47:51.718532] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.399 [2024-04-26 20:47:51.718614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.399 [2024-04-26 20:47:51.718627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.399 [2024-04-26 20:47:51.718633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.718637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.718649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.399 [2024-04-26 20:47:51.728624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.399 [2024-04-26 20:47:51.728703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.399 [2024-04-26 20:47:51.728716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.399 [2024-04-26 20:47:51.728725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.728730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.728742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.399 [2024-04-26 20:47:51.738600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.399 [2024-04-26 20:47:51.738669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.399 [2024-04-26 20:47:51.738682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.399 [2024-04-26 20:47:51.738688] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.399 [2024-04-26 20:47:51.738692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.399 [2024-04-26 20:47:51.738704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.399 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.748616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.748689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.662 [2024-04-26 20:47:51.748702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.662 [2024-04-26 20:47:51.748708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.662 [2024-04-26 20:47:51.748713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.662 [2024-04-26 20:47:51.748725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.662 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.758693] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.758766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.662 [2024-04-26 20:47:51.758779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.662 [2024-04-26 20:47:51.758785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.662 [2024-04-26 20:47:51.758790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.662 [2024-04-26 20:47:51.758802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.662 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.768752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.768832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.662 [2024-04-26 20:47:51.768845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.662 [2024-04-26 20:47:51.768850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.662 [2024-04-26 20:47:51.768856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.662 [2024-04-26 20:47:51.768868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.662 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.778748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.778818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.662 [2024-04-26 20:47:51.778831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.662 [2024-04-26 20:47:51.778836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.662 [2024-04-26 20:47:51.778841] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.662 [2024-04-26 20:47:51.778852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.662 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.788725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.788806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.662 [2024-04-26 20:47:51.788819] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.662 [2024-04-26 20:47:51.788824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.662 [2024-04-26 20:47:51.788829] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.662 [2024-04-26 20:47:51.788841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.662 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.798664] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.798739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.662 [2024-04-26 20:47:51.798753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.662 [2024-04-26 20:47:51.798759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.662 [2024-04-26 20:47:51.798764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.662 [2024-04-26 20:47:51.798777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.662 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.808825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.808906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.662 [2024-04-26 20:47:51.808920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.662 [2024-04-26 20:47:51.808926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.662 [2024-04-26 20:47:51.808931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.662 [2024-04-26 20:47:51.808943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.662 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.818738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.818843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.662 [2024-04-26 20:47:51.818857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.662 [2024-04-26 20:47:51.818865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.662 [2024-04-26 20:47:51.818870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.662 [2024-04-26 20:47:51.818881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.662 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.828871] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.828948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.662 [2024-04-26 20:47:51.828967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.662 [2024-04-26 20:47:51.828974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.662 [2024-04-26 20:47:51.828979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.662 [2024-04-26 20:47:51.828994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.662 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.838899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.838976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.662 [2024-04-26 20:47:51.838995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.662 [2024-04-26 20:47:51.839002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.662 [2024-04-26 20:47:51.839007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.662 [2024-04-26 20:47:51.839022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.662 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.848976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.849069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.662 [2024-04-26 20:47:51.849089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.662 [2024-04-26 20:47:51.849097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.662 [2024-04-26 20:47:51.849102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.662 [2024-04-26 20:47:51.849117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.662 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.858978] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.859103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.662 [2024-04-26 20:47:51.859124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.662 [2024-04-26 20:47:51.859130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.662 [2024-04-26 20:47:51.859135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.662 [2024-04-26 20:47:51.859150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.662 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.868970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.869042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.662 [2024-04-26 20:47:51.869057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.662 [2024-04-26 20:47:51.869062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.662 [2024-04-26 20:47:51.869068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.662 [2024-04-26 20:47:51.869081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.662 qpair failed and we were unable to recover it. 00:30:33.662 [2024-04-26 20:47:51.879027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.662 [2024-04-26 20:47:51.879103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.663 [2024-04-26 20:47:51.879117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.663 [2024-04-26 20:47:51.879123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.663 [2024-04-26 20:47:51.879128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.663 [2024-04-26 20:47:51.879139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.663 qpair failed and we were unable to recover it. 00:30:33.663 [2024-04-26 20:47:51.889082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.663 [2024-04-26 20:47:51.889167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.663 [2024-04-26 20:47:51.889187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.663 [2024-04-26 20:47:51.889194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.663 [2024-04-26 20:47:51.889199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.663 [2024-04-26 20:47:51.889214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.663 qpair failed and we were unable to recover it. 00:30:33.663 [2024-04-26 20:47:51.898940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.663 [2024-04-26 20:47:51.899012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.663 [2024-04-26 20:47:51.899027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.663 [2024-04-26 20:47:51.899033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.663 [2024-04-26 20:47:51.899038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.663 [2024-04-26 20:47:51.899051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.663 qpair failed and we were unable to recover it. 00:30:33.663 [2024-04-26 20:47:51.909061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.663 [2024-04-26 20:47:51.909139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.663 [2024-04-26 20:47:51.909157] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.663 [2024-04-26 20:47:51.909164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.663 [2024-04-26 20:47:51.909168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.663 [2024-04-26 20:47:51.909181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.663 qpair failed and we were unable to recover it. 00:30:33.663 [2024-04-26 20:47:51.919095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.663 [2024-04-26 20:47:51.919166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.663 [2024-04-26 20:47:51.919180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.663 [2024-04-26 20:47:51.919185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.663 [2024-04-26 20:47:51.919190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.663 [2024-04-26 20:47:51.919201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.663 qpair failed and we were unable to recover it. 00:30:33.663 [2024-04-26 20:47:51.929116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.663 [2024-04-26 20:47:51.929194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.663 [2024-04-26 20:47:51.929207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.663 [2024-04-26 20:47:51.929212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.663 [2024-04-26 20:47:51.929217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.663 [2024-04-26 20:47:51.929228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.663 qpair failed and we were unable to recover it. 00:30:33.663 [2024-04-26 20:47:51.939144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.663 [2024-04-26 20:47:51.939211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.663 [2024-04-26 20:47:51.939225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.663 [2024-04-26 20:47:51.939230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.663 [2024-04-26 20:47:51.939234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.663 [2024-04-26 20:47:51.939246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.663 qpair failed and we were unable to recover it. 00:30:33.663 [2024-04-26 20:47:51.949070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.663 [2024-04-26 20:47:51.949142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.663 [2024-04-26 20:47:51.949155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.663 [2024-04-26 20:47:51.949161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.663 [2024-04-26 20:47:51.949166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.663 [2024-04-26 20:47:51.949181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.663 qpair failed and we were unable to recover it. 00:30:33.663 [2024-04-26 20:47:51.959239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.663 [2024-04-26 20:47:51.959451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.663 [2024-04-26 20:47:51.959465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.663 [2024-04-26 20:47:51.959471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.663 [2024-04-26 20:47:51.959476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.663 [2024-04-26 20:47:51.959488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.663 qpair failed and we were unable to recover it. 00:30:33.663 [2024-04-26 20:47:51.969166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.663 [2024-04-26 20:47:51.969246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.663 [2024-04-26 20:47:51.969259] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.663 [2024-04-26 20:47:51.969265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.663 [2024-04-26 20:47:51.969270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.663 [2024-04-26 20:47:51.969287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.663 qpair failed and we were unable to recover it. 00:30:33.663 [2024-04-26 20:47:51.979300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.663 [2024-04-26 20:47:51.979383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.663 [2024-04-26 20:47:51.979397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.663 [2024-04-26 20:47:51.979403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.663 [2024-04-26 20:47:51.979407] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.663 [2024-04-26 20:47:51.979419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.663 qpair failed and we were unable to recover it. 00:30:33.663 [2024-04-26 20:47:51.989304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.663 [2024-04-26 20:47:51.989379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.663 [2024-04-26 20:47:51.989393] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.663 [2024-04-26 20:47:51.989399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.663 [2024-04-26 20:47:51.989404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.663 [2024-04-26 20:47:51.989415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.663 qpair failed and we were unable to recover it. 00:30:33.663 [2024-04-26 20:47:51.999327] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.663 [2024-04-26 20:47:51.999401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.663 [2024-04-26 20:47:51.999417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.663 [2024-04-26 20:47:51.999422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.663 [2024-04-26 20:47:51.999427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.663 [2024-04-26 20:47:51.999439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.663 qpair failed and we were unable to recover it. 00:30:33.926 [2024-04-26 20:47:52.009273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.926 [2024-04-26 20:47:52.009358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.926 [2024-04-26 20:47:52.009371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.926 [2024-04-26 20:47:52.009377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.926 [2024-04-26 20:47:52.009382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.926 [2024-04-26 20:47:52.009394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.926 qpair failed and we were unable to recover it. 00:30:33.926 [2024-04-26 20:47:52.019270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.926 [2024-04-26 20:47:52.019348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.926 [2024-04-26 20:47:52.019362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.926 [2024-04-26 20:47:52.019367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.926 [2024-04-26 20:47:52.019372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.926 [2024-04-26 20:47:52.019384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.926 qpair failed and we were unable to recover it. 00:30:33.926 [2024-04-26 20:47:52.029564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.926 [2024-04-26 20:47:52.029639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.926 [2024-04-26 20:47:52.029652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.926 [2024-04-26 20:47:52.029658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.926 [2024-04-26 20:47:52.029662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.926 [2024-04-26 20:47:52.029675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.926 qpair failed and we were unable to recover it. 00:30:33.926 [2024-04-26 20:47:52.039572] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.926 [2024-04-26 20:47:52.039649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.926 [2024-04-26 20:47:52.039663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.926 [2024-04-26 20:47:52.039668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.926 [2024-04-26 20:47:52.039673] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.926 [2024-04-26 20:47:52.039688] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.926 qpair failed and we were unable to recover it. 00:30:33.926 [2024-04-26 20:47:52.049494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.926 [2024-04-26 20:47:52.049573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.926 [2024-04-26 20:47:52.049586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.926 [2024-04-26 20:47:52.049592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.926 [2024-04-26 20:47:52.049597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.926 [2024-04-26 20:47:52.049608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.926 qpair failed and we were unable to recover it. 00:30:33.926 [2024-04-26 20:47:52.059514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.926 [2024-04-26 20:47:52.059598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.926 [2024-04-26 20:47:52.059611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.926 [2024-04-26 20:47:52.059617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.926 [2024-04-26 20:47:52.059621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.926 [2024-04-26 20:47:52.059632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.926 qpair failed and we were unable to recover it. 00:30:33.926 [2024-04-26 20:47:52.069508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.926 [2024-04-26 20:47:52.069578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.926 [2024-04-26 20:47:52.069591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.926 [2024-04-26 20:47:52.069596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.926 [2024-04-26 20:47:52.069601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.926 [2024-04-26 20:47:52.069612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.926 qpair failed and we were unable to recover it. 00:30:33.926 [2024-04-26 20:47:52.079578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.927 [2024-04-26 20:47:52.079652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.927 [2024-04-26 20:47:52.079665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.927 [2024-04-26 20:47:52.079671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.927 [2024-04-26 20:47:52.079675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.927 [2024-04-26 20:47:52.079687] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.927 qpair failed and we were unable to recover it. 00:30:33.927 [2024-04-26 20:47:52.089667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.927 [2024-04-26 20:47:52.089755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.927 [2024-04-26 20:47:52.089772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.927 [2024-04-26 20:47:52.089778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.927 [2024-04-26 20:47:52.089783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.927 [2024-04-26 20:47:52.089794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.927 qpair failed and we were unable to recover it. 00:30:33.927 [2024-04-26 20:47:52.099636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.927 [2024-04-26 20:47:52.099712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.927 [2024-04-26 20:47:52.099726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.927 [2024-04-26 20:47:52.099732] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.927 [2024-04-26 20:47:52.099737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.927 [2024-04-26 20:47:52.099750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.927 qpair failed and we were unable to recover it. 00:30:33.927 [2024-04-26 20:47:52.109783] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.927 [2024-04-26 20:47:52.109855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.927 [2024-04-26 20:47:52.109868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.927 [2024-04-26 20:47:52.109874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.927 [2024-04-26 20:47:52.109878] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.927 [2024-04-26 20:47:52.109891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.927 qpair failed and we were unable to recover it. 00:30:33.927 [2024-04-26 20:47:52.119649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.927 [2024-04-26 20:47:52.119728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.927 [2024-04-26 20:47:52.119747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.927 [2024-04-26 20:47:52.119754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.927 [2024-04-26 20:47:52.119759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.927 [2024-04-26 20:47:52.119774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.927 qpair failed and we were unable to recover it. 00:30:33.927 [2024-04-26 20:47:52.129726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.927 [2024-04-26 20:47:52.129815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.927 [2024-04-26 20:47:52.129830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.927 [2024-04-26 20:47:52.129836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.927 [2024-04-26 20:47:52.129844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.927 [2024-04-26 20:47:52.129857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.927 qpair failed and we were unable to recover it. 00:30:33.927 [2024-04-26 20:47:52.139717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.927 [2024-04-26 20:47:52.139791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.927 [2024-04-26 20:47:52.139811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.927 [2024-04-26 20:47:52.139818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.927 [2024-04-26 20:47:52.139823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.927 [2024-04-26 20:47:52.139839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.927 qpair failed and we were unable to recover it. 00:30:33.927 [2024-04-26 20:47:52.149755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.927 [2024-04-26 20:47:52.149827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.927 [2024-04-26 20:47:52.149841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.927 [2024-04-26 20:47:52.149846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.927 [2024-04-26 20:47:52.149851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.927 [2024-04-26 20:47:52.149864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.927 qpair failed and we were unable to recover it. 00:30:33.927 [2024-04-26 20:47:52.159936] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.927 [2024-04-26 20:47:52.160016] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.927 [2024-04-26 20:47:52.160036] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.927 [2024-04-26 20:47:52.160043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.927 [2024-04-26 20:47:52.160047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.927 [2024-04-26 20:47:52.160062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.927 qpair failed and we were unable to recover it. 00:30:33.927 [2024-04-26 20:47:52.169865] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.927 [2024-04-26 20:47:52.169949] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.927 [2024-04-26 20:47:52.169969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.927 [2024-04-26 20:47:52.169976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.927 [2024-04-26 20:47:52.169981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.927 [2024-04-26 20:47:52.169996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.927 qpair failed and we were unable to recover it. 00:30:33.927 [2024-04-26 20:47:52.179851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.927 [2024-04-26 20:47:52.179934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.927 [2024-04-26 20:47:52.179954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.927 [2024-04-26 20:47:52.179961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.927 [2024-04-26 20:47:52.179966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.927 [2024-04-26 20:47:52.179982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.927 qpair failed and we were unable to recover it. 00:30:33.927 [2024-04-26 20:47:52.189856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.927 [2024-04-26 20:47:52.189969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.927 [2024-04-26 20:47:52.189984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.927 [2024-04-26 20:47:52.189990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.927 [2024-04-26 20:47:52.189994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.927 [2024-04-26 20:47:52.190007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.927 qpair failed and we were unable to recover it. 00:30:33.927 [2024-04-26 20:47:52.199882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.927 [2024-04-26 20:47:52.199957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.927 [2024-04-26 20:47:52.199970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.927 [2024-04-26 20:47:52.199976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.927 [2024-04-26 20:47:52.199980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.927 [2024-04-26 20:47:52.199992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.927 qpair failed and we were unable to recover it. 00:30:33.927 [2024-04-26 20:47:52.209980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.928 [2024-04-26 20:47:52.210059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.928 [2024-04-26 20:47:52.210072] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.928 [2024-04-26 20:47:52.210078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.928 [2024-04-26 20:47:52.210083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.928 [2024-04-26 20:47:52.210095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.928 qpair failed and we were unable to recover it. 00:30:33.928 [2024-04-26 20:47:52.219944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.928 [2024-04-26 20:47:52.220013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.928 [2024-04-26 20:47:52.220026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.928 [2024-04-26 20:47:52.220032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.928 [2024-04-26 20:47:52.220040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.928 [2024-04-26 20:47:52.220052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.928 qpair failed and we were unable to recover it. 00:30:33.928 [2024-04-26 20:47:52.229996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.928 [2024-04-26 20:47:52.230075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.928 [2024-04-26 20:47:52.230089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.928 [2024-04-26 20:47:52.230094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.928 [2024-04-26 20:47:52.230099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.928 [2024-04-26 20:47:52.230111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.928 qpair failed and we were unable to recover it. 00:30:33.928 [2024-04-26 20:47:52.240001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.928 [2024-04-26 20:47:52.240077] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.928 [2024-04-26 20:47:52.240097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.928 [2024-04-26 20:47:52.240104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.928 [2024-04-26 20:47:52.240110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.928 [2024-04-26 20:47:52.240125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.928 qpair failed and we were unable to recover it. 00:30:33.928 [2024-04-26 20:47:52.250048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.928 [2024-04-26 20:47:52.250131] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.928 [2024-04-26 20:47:52.250151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.928 [2024-04-26 20:47:52.250158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.928 [2024-04-26 20:47:52.250163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.928 [2024-04-26 20:47:52.250178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.928 qpair failed and we were unable to recover it. 00:30:33.928 [2024-04-26 20:47:52.260061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:33.928 [2024-04-26 20:47:52.260136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:33.928 [2024-04-26 20:47:52.260151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:33.928 [2024-04-26 20:47:52.260157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:33.928 [2024-04-26 20:47:52.260162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:33.928 [2024-04-26 20:47:52.260174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:33.928 qpair failed and we were unable to recover it. 00:30:34.190 [2024-04-26 20:47:52.270057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.190 [2024-04-26 20:47:52.270285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.190 [2024-04-26 20:47:52.270299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.190 [2024-04-26 20:47:52.270305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.190 [2024-04-26 20:47:52.270309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.190 [2024-04-26 20:47:52.270322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.190 qpair failed and we were unable to recover it. 00:30:34.190 [2024-04-26 20:47:52.280107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.190 [2024-04-26 20:47:52.280180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.190 [2024-04-26 20:47:52.280193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.190 [2024-04-26 20:47:52.280198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.190 [2024-04-26 20:47:52.280203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.190 [2024-04-26 20:47:52.280216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.190 qpair failed and we were unable to recover it. 00:30:34.190 [2024-04-26 20:47:52.290035] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.190 [2024-04-26 20:47:52.290118] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.190 [2024-04-26 20:47:52.290131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.190 [2024-04-26 20:47:52.290136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.190 [2024-04-26 20:47:52.290141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.190 [2024-04-26 20:47:52.290153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.190 qpair failed and we were unable to recover it. 00:30:34.190 [2024-04-26 20:47:52.300036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.190 [2024-04-26 20:47:52.300147] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.190 [2024-04-26 20:47:52.300160] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.190 [2024-04-26 20:47:52.300166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.190 [2024-04-26 20:47:52.300170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.190 [2024-04-26 20:47:52.300182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.190 qpair failed and we were unable to recover it. 00:30:34.190 [2024-04-26 20:47:52.310225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.190 [2024-04-26 20:47:52.310349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.190 [2024-04-26 20:47:52.310363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.190 [2024-04-26 20:47:52.310376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.190 [2024-04-26 20:47:52.310380] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.190 [2024-04-26 20:47:52.310392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.190 qpair failed and we were unable to recover it. 00:30:34.190 [2024-04-26 20:47:52.320201] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.190 [2024-04-26 20:47:52.320273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.190 [2024-04-26 20:47:52.320289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.190 [2024-04-26 20:47:52.320295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.190 [2024-04-26 20:47:52.320299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.190 [2024-04-26 20:47:52.320312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.190 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.330246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.330327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.191 [2024-04-26 20:47:52.330341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.191 [2024-04-26 20:47:52.330346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.191 [2024-04-26 20:47:52.330351] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.191 [2024-04-26 20:47:52.330364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.191 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.340287] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.340369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.191 [2024-04-26 20:47:52.340382] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.191 [2024-04-26 20:47:52.340387] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.191 [2024-04-26 20:47:52.340392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.191 [2024-04-26 20:47:52.340404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.191 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.350308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.350385] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.191 [2024-04-26 20:47:52.350398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.191 [2024-04-26 20:47:52.350404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.191 [2024-04-26 20:47:52.350408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.191 [2024-04-26 20:47:52.350419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.191 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.360318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.360393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.191 [2024-04-26 20:47:52.360406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.191 [2024-04-26 20:47:52.360412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.191 [2024-04-26 20:47:52.360416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.191 [2024-04-26 20:47:52.360428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.191 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.370359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.370439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.191 [2024-04-26 20:47:52.370452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.191 [2024-04-26 20:47:52.370458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.191 [2024-04-26 20:47:52.370462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.191 [2024-04-26 20:47:52.370474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.191 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.380345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.380419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.191 [2024-04-26 20:47:52.380432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.191 [2024-04-26 20:47:52.380437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.191 [2024-04-26 20:47:52.380442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.191 [2024-04-26 20:47:52.380453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.191 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.390375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.390450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.191 [2024-04-26 20:47:52.390463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.191 [2024-04-26 20:47:52.390469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.191 [2024-04-26 20:47:52.390473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.191 [2024-04-26 20:47:52.390485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.191 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.400310] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.400383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.191 [2024-04-26 20:47:52.400396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.191 [2024-04-26 20:47:52.400404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.191 [2024-04-26 20:47:52.400409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.191 [2024-04-26 20:47:52.400421] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.191 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.410514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.410593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.191 [2024-04-26 20:47:52.410606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.191 [2024-04-26 20:47:52.410612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.191 [2024-04-26 20:47:52.410617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.191 [2024-04-26 20:47:52.410628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.191 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.420506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.420581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.191 [2024-04-26 20:47:52.420594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.191 [2024-04-26 20:47:52.420599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.191 [2024-04-26 20:47:52.420604] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.191 [2024-04-26 20:47:52.420616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.191 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.430506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.430580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.191 [2024-04-26 20:47:52.430593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.191 [2024-04-26 20:47:52.430598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.191 [2024-04-26 20:47:52.430603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.191 [2024-04-26 20:47:52.430615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.191 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.440462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.440533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.191 [2024-04-26 20:47:52.440546] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.191 [2024-04-26 20:47:52.440552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.191 [2024-04-26 20:47:52.440556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.191 [2024-04-26 20:47:52.440568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.191 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.450652] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.450734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.191 [2024-04-26 20:47:52.450748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.191 [2024-04-26 20:47:52.450753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.191 [2024-04-26 20:47:52.450758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.191 [2024-04-26 20:47:52.450771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.191 qpair failed and we were unable to recover it. 00:30:34.191 [2024-04-26 20:47:52.460604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.191 [2024-04-26 20:47:52.460674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.192 [2024-04-26 20:47:52.460687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.192 [2024-04-26 20:47:52.460693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.192 [2024-04-26 20:47:52.460698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.192 [2024-04-26 20:47:52.460709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.192 qpair failed and we were unable to recover it. 00:30:34.192 [2024-04-26 20:47:52.470500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.192 [2024-04-26 20:47:52.470572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.192 [2024-04-26 20:47:52.470585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.192 [2024-04-26 20:47:52.470591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.192 [2024-04-26 20:47:52.470595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.192 [2024-04-26 20:47:52.470607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.192 qpair failed and we were unable to recover it. 00:30:34.192 [2024-04-26 20:47:52.480667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.192 [2024-04-26 20:47:52.480741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.192 [2024-04-26 20:47:52.480754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.192 [2024-04-26 20:47:52.480760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.192 [2024-04-26 20:47:52.480764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.192 [2024-04-26 20:47:52.480777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.192 qpair failed and we were unable to recover it. 00:30:34.192 [2024-04-26 20:47:52.490732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.192 [2024-04-26 20:47:52.490818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.192 [2024-04-26 20:47:52.490834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.192 [2024-04-26 20:47:52.490840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.192 [2024-04-26 20:47:52.490845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.192 [2024-04-26 20:47:52.490857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.192 qpair failed and we were unable to recover it. 00:30:34.192 [2024-04-26 20:47:52.500724] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.192 [2024-04-26 20:47:52.500802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.192 [2024-04-26 20:47:52.500815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.192 [2024-04-26 20:47:52.500821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.192 [2024-04-26 20:47:52.500825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.192 [2024-04-26 20:47:52.500837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.192 qpair failed and we were unable to recover it. 00:30:34.192 [2024-04-26 20:47:52.510746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.192 [2024-04-26 20:47:52.510962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.192 [2024-04-26 20:47:52.510976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.192 [2024-04-26 20:47:52.510982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.192 [2024-04-26 20:47:52.510987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.192 [2024-04-26 20:47:52.510998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.192 qpair failed and we were unable to recover it. 00:30:34.192 [2024-04-26 20:47:52.520776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.192 [2024-04-26 20:47:52.520854] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.192 [2024-04-26 20:47:52.520870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.192 [2024-04-26 20:47:52.520876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.192 [2024-04-26 20:47:52.520882] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.192 [2024-04-26 20:47:52.520894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.192 qpair failed and we were unable to recover it. 00:30:34.192 [2024-04-26 20:47:52.530845] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.192 [2024-04-26 20:47:52.530934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.192 [2024-04-26 20:47:52.530948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.192 [2024-04-26 20:47:52.530954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.192 [2024-04-26 20:47:52.530958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.192 [2024-04-26 20:47:52.530973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.192 qpair failed and we were unable to recover it. 00:30:34.455 [2024-04-26 20:47:52.540844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.455 [2024-04-26 20:47:52.540917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.455 [2024-04-26 20:47:52.540930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.455 [2024-04-26 20:47:52.540935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.455 [2024-04-26 20:47:52.540940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.455 [2024-04-26 20:47:52.540952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.455 qpair failed and we were unable to recover it. 00:30:34.455 [2024-04-26 20:47:52.550833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.455 [2024-04-26 20:47:52.550950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.455 [2024-04-26 20:47:52.550963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.455 [2024-04-26 20:47:52.550969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.455 [2024-04-26 20:47:52.550973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.455 [2024-04-26 20:47:52.550985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.455 qpair failed and we were unable to recover it. 00:30:34.455 [2024-04-26 20:47:52.560889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.455 [2024-04-26 20:47:52.560967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.455 [2024-04-26 20:47:52.560980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.455 [2024-04-26 20:47:52.560986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.455 [2024-04-26 20:47:52.560991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.455 [2024-04-26 20:47:52.561003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.455 qpair failed and we were unable to recover it. 00:30:34.455 [2024-04-26 20:47:52.570938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.455 [2024-04-26 20:47:52.571017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.455 [2024-04-26 20:47:52.571030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.455 [2024-04-26 20:47:52.571036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.455 [2024-04-26 20:47:52.571040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.455 [2024-04-26 20:47:52.571052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.455 qpair failed and we were unable to recover it. 00:30:34.455 [2024-04-26 20:47:52.581102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.455 [2024-04-26 20:47:52.581179] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.455 [2024-04-26 20:47:52.581195] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.455 [2024-04-26 20:47:52.581200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.455 [2024-04-26 20:47:52.581206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.455 [2024-04-26 20:47:52.581218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.455 qpair failed and we were unable to recover it. 00:30:34.455 [2024-04-26 20:47:52.590980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.455 [2024-04-26 20:47:52.591056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.455 [2024-04-26 20:47:52.591069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.455 [2024-04-26 20:47:52.591075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.455 [2024-04-26 20:47:52.591079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.455 [2024-04-26 20:47:52.591092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.455 qpair failed and we were unable to recover it. 00:30:34.455 [2024-04-26 20:47:52.600975] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.455 [2024-04-26 20:47:52.601048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.455 [2024-04-26 20:47:52.601062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.455 [2024-04-26 20:47:52.601067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.455 [2024-04-26 20:47:52.601072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.455 [2024-04-26 20:47:52.601084] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.455 qpair failed and we were unable to recover it. 00:30:34.455 [2024-04-26 20:47:52.611032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.455 [2024-04-26 20:47:52.611112] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.455 [2024-04-26 20:47:52.611125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.455 [2024-04-26 20:47:52.611130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.455 [2024-04-26 20:47:52.611135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.455 [2024-04-26 20:47:52.611146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.455 qpair failed and we were unable to recover it. 00:30:34.455 [2024-04-26 20:47:52.621029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.455 [2024-04-26 20:47:52.621105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.455 [2024-04-26 20:47:52.621118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.455 [2024-04-26 20:47:52.621124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.455 [2024-04-26 20:47:52.621132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.455 [2024-04-26 20:47:52.621144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.455 qpair failed and we were unable to recover it. 00:30:34.455 [2024-04-26 20:47:52.631039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.455 [2024-04-26 20:47:52.631114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.455 [2024-04-26 20:47:52.631128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.455 [2024-04-26 20:47:52.631134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.455 [2024-04-26 20:47:52.631138] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.455 [2024-04-26 20:47:52.631150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.455 qpair failed and we were unable to recover it. 00:30:34.455 [2024-04-26 20:47:52.641100] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.455 [2024-04-26 20:47:52.641173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.455 [2024-04-26 20:47:52.641187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.455 [2024-04-26 20:47:52.641192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.455 [2024-04-26 20:47:52.641197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.455 [2024-04-26 20:47:52.641209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.455 qpair failed and we were unable to recover it. 00:30:34.455 [2024-04-26 20:47:52.651151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.455 [2024-04-26 20:47:52.651237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.455 [2024-04-26 20:47:52.651250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.455 [2024-04-26 20:47:52.651257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.455 [2024-04-26 20:47:52.651262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.455 [2024-04-26 20:47:52.651273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.455 qpair failed and we were unable to recover it. 00:30:34.455 [2024-04-26 20:47:52.661127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.455 [2024-04-26 20:47:52.661198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.455 [2024-04-26 20:47:52.661211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.455 [2024-04-26 20:47:52.661217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.455 [2024-04-26 20:47:52.661222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.661233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.456 [2024-04-26 20:47:52.671106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.456 [2024-04-26 20:47:52.671183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.456 [2024-04-26 20:47:52.671196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.456 [2024-04-26 20:47:52.671202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.456 [2024-04-26 20:47:52.671206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.671218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.456 [2024-04-26 20:47:52.681220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.456 [2024-04-26 20:47:52.681308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.456 [2024-04-26 20:47:52.681322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.456 [2024-04-26 20:47:52.681328] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.456 [2024-04-26 20:47:52.681332] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.681344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.456 [2024-04-26 20:47:52.691260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.456 [2024-04-26 20:47:52.691344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.456 [2024-04-26 20:47:52.691357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.456 [2024-04-26 20:47:52.691363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.456 [2024-04-26 20:47:52.691367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.691380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.456 [2024-04-26 20:47:52.701297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.456 [2024-04-26 20:47:52.701412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.456 [2024-04-26 20:47:52.701426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.456 [2024-04-26 20:47:52.701431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.456 [2024-04-26 20:47:52.701436] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.701447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.456 [2024-04-26 20:47:52.711168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.456 [2024-04-26 20:47:52.711244] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.456 [2024-04-26 20:47:52.711258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.456 [2024-04-26 20:47:52.711264] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.456 [2024-04-26 20:47:52.711272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.711290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.456 [2024-04-26 20:47:52.721286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.456 [2024-04-26 20:47:52.721361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.456 [2024-04-26 20:47:52.721375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.456 [2024-04-26 20:47:52.721381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.456 [2024-04-26 20:47:52.721385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.721397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.456 [2024-04-26 20:47:52.731299] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.456 [2024-04-26 20:47:52.731381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.456 [2024-04-26 20:47:52.731395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.456 [2024-04-26 20:47:52.731400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.456 [2024-04-26 20:47:52.731405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.731417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.456 [2024-04-26 20:47:52.741340] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.456 [2024-04-26 20:47:52.741414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.456 [2024-04-26 20:47:52.741427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.456 [2024-04-26 20:47:52.741433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.456 [2024-04-26 20:47:52.741437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.741449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.456 [2024-04-26 20:47:52.751437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.456 [2024-04-26 20:47:52.751515] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.456 [2024-04-26 20:47:52.751528] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.456 [2024-04-26 20:47:52.751534] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.456 [2024-04-26 20:47:52.751539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.751551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.456 [2024-04-26 20:47:52.761433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.456 [2024-04-26 20:47:52.761510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.456 [2024-04-26 20:47:52.761523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.456 [2024-04-26 20:47:52.761529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.456 [2024-04-26 20:47:52.761534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.761545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.456 [2024-04-26 20:47:52.771464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.456 [2024-04-26 20:47:52.771550] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.456 [2024-04-26 20:47:52.771563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.456 [2024-04-26 20:47:52.771569] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.456 [2024-04-26 20:47:52.771574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.771585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.456 [2024-04-26 20:47:52.781502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.456 [2024-04-26 20:47:52.781573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.456 [2024-04-26 20:47:52.781588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.456 [2024-04-26 20:47:52.781594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.456 [2024-04-26 20:47:52.781599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.781611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.456 [2024-04-26 20:47:52.791470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.456 [2024-04-26 20:47:52.791582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.456 [2024-04-26 20:47:52.791598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.456 [2024-04-26 20:47:52.791603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.456 [2024-04-26 20:47:52.791608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.456 [2024-04-26 20:47:52.791620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.456 qpair failed and we were unable to recover it. 00:30:34.719 [2024-04-26 20:47:52.801584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.719 [2024-04-26 20:47:52.801679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.719 [2024-04-26 20:47:52.801693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.719 [2024-04-26 20:47:52.801702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.719 [2024-04-26 20:47:52.801707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.719 [2024-04-26 20:47:52.801718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.719 qpair failed and we were unable to recover it. 00:30:34.719 [2024-04-26 20:47:52.811593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.719 [2024-04-26 20:47:52.811673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.719 [2024-04-26 20:47:52.811687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.719 [2024-04-26 20:47:52.811692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.719 [2024-04-26 20:47:52.811698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.719 [2024-04-26 20:47:52.811709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.719 qpair failed and we were unable to recover it. 00:30:34.719 [2024-04-26 20:47:52.821575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.719 [2024-04-26 20:47:52.821647] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.719 [2024-04-26 20:47:52.821660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.719 [2024-04-26 20:47:52.821666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.719 [2024-04-26 20:47:52.821670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.719 [2024-04-26 20:47:52.821682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.719 qpair failed and we were unable to recover it. 00:30:34.719 [2024-04-26 20:47:52.831604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.719 [2024-04-26 20:47:52.831678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.719 [2024-04-26 20:47:52.831693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.831699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.831703] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.831716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.720 [2024-04-26 20:47:52.841658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.720 [2024-04-26 20:47:52.841732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.720 [2024-04-26 20:47:52.841746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.841751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.841756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.841767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.720 [2024-04-26 20:47:52.851690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.720 [2024-04-26 20:47:52.851773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.720 [2024-04-26 20:47:52.851787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.851793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.851798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.851810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.720 [2024-04-26 20:47:52.861669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.720 [2024-04-26 20:47:52.861738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.720 [2024-04-26 20:47:52.861751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.861757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.861761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.861773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.720 [2024-04-26 20:47:52.871685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.720 [2024-04-26 20:47:52.871762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.720 [2024-04-26 20:47:52.871775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.871780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.871785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.871796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.720 [2024-04-26 20:47:52.881767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.720 [2024-04-26 20:47:52.881839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.720 [2024-04-26 20:47:52.881852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.881858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.881862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.881874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.720 [2024-04-26 20:47:52.891781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.720 [2024-04-26 20:47:52.891865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.720 [2024-04-26 20:47:52.891878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.891886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.891891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.891903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.720 [2024-04-26 20:47:52.901864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.720 [2024-04-26 20:47:52.901981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.720 [2024-04-26 20:47:52.902001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.902008] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.902014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.902029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.720 [2024-04-26 20:47:52.911848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.720 [2024-04-26 20:47:52.911927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.720 [2024-04-26 20:47:52.911947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.911954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.911959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.911974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.720 [2024-04-26 20:47:52.921751] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.720 [2024-04-26 20:47:52.921830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.720 [2024-04-26 20:47:52.921850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.921857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.921862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.921877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.720 [2024-04-26 20:47:52.931943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.720 [2024-04-26 20:47:52.932032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.720 [2024-04-26 20:47:52.932052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.932059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.932064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.932079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.720 [2024-04-26 20:47:52.941931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.720 [2024-04-26 20:47:52.941999] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.720 [2024-04-26 20:47:52.942013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.942019] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.942024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.942037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.720 [2024-04-26 20:47:52.951961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.720 [2024-04-26 20:47:52.952043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.720 [2024-04-26 20:47:52.952062] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.952069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.952074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.952089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.720 [2024-04-26 20:47:52.961969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.720 [2024-04-26 20:47:52.962043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.720 [2024-04-26 20:47:52.962058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.720 [2024-04-26 20:47:52.962064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.720 [2024-04-26 20:47:52.962069] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.720 [2024-04-26 20:47:52.962082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.720 qpair failed and we were unable to recover it. 00:30:34.721 [2024-04-26 20:47:52.972060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.721 [2024-04-26 20:47:52.972151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.721 [2024-04-26 20:47:52.972172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.721 [2024-04-26 20:47:52.972179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.721 [2024-04-26 20:47:52.972184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.721 [2024-04-26 20:47:52.972198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.721 qpair failed and we were unable to recover it. 00:30:34.721 [2024-04-26 20:47:52.982025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.721 [2024-04-26 20:47:52.982102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.721 [2024-04-26 20:47:52.982120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.721 [2024-04-26 20:47:52.982127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.721 [2024-04-26 20:47:52.982132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.721 [2024-04-26 20:47:52.982143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.721 qpair failed and we were unable to recover it. 00:30:34.721 [2024-04-26 20:47:52.992090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.721 [2024-04-26 20:47:52.992193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.721 [2024-04-26 20:47:52.992207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.721 [2024-04-26 20:47:52.992213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.721 [2024-04-26 20:47:52.992218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.721 [2024-04-26 20:47:52.992229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.721 qpair failed and we were unable to recover it. 00:30:34.721 [2024-04-26 20:47:53.002101] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.721 [2024-04-26 20:47:53.002174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.721 [2024-04-26 20:47:53.002188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.721 [2024-04-26 20:47:53.002193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.721 [2024-04-26 20:47:53.002198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.721 [2024-04-26 20:47:53.002211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.721 qpair failed and we were unable to recover it. 00:30:34.721 [2024-04-26 20:47:53.012180] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.721 [2024-04-26 20:47:53.012264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.721 [2024-04-26 20:47:53.012283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.721 [2024-04-26 20:47:53.012289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.721 [2024-04-26 20:47:53.012294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.721 [2024-04-26 20:47:53.012306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.721 qpair failed and we were unable to recover it. 00:30:34.721 [2024-04-26 20:47:53.022132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.721 [2024-04-26 20:47:53.022208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.721 [2024-04-26 20:47:53.022221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.721 [2024-04-26 20:47:53.022227] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.721 [2024-04-26 20:47:53.022232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.721 [2024-04-26 20:47:53.022249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.721 qpair failed and we were unable to recover it. 00:30:34.721 [2024-04-26 20:47:53.032156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.721 [2024-04-26 20:47:53.032230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.721 [2024-04-26 20:47:53.032244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.721 [2024-04-26 20:47:53.032249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.721 [2024-04-26 20:47:53.032254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.721 [2024-04-26 20:47:53.032266] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.721 qpair failed and we were unable to recover it. 00:30:34.721 [2024-04-26 20:47:53.042230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.721 [2024-04-26 20:47:53.042307] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.721 [2024-04-26 20:47:53.042320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.721 [2024-04-26 20:47:53.042326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.721 [2024-04-26 20:47:53.042331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.721 [2024-04-26 20:47:53.042343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.721 qpair failed and we were unable to recover it. 00:30:34.721 [2024-04-26 20:47:53.052296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.721 [2024-04-26 20:47:53.052378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.721 [2024-04-26 20:47:53.052392] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.721 [2024-04-26 20:47:53.052397] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.721 [2024-04-26 20:47:53.052402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.721 [2024-04-26 20:47:53.052414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.721 qpair failed and we were unable to recover it. 00:30:34.984 [2024-04-26 20:47:53.062281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.984 [2024-04-26 20:47:53.062357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.984 [2024-04-26 20:47:53.062370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.984 [2024-04-26 20:47:53.062376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.984 [2024-04-26 20:47:53.062381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.062394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.072274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.072347] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.985 [2024-04-26 20:47:53.072364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.985 [2024-04-26 20:47:53.072370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.985 [2024-04-26 20:47:53.072375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.072387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.082355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.082476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.985 [2024-04-26 20:47:53.082489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.985 [2024-04-26 20:47:53.082495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.985 [2024-04-26 20:47:53.082500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.082512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.092379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.092463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.985 [2024-04-26 20:47:53.092476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.985 [2024-04-26 20:47:53.092482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.985 [2024-04-26 20:47:53.092486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.092498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.102304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.102378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.985 [2024-04-26 20:47:53.102392] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.985 [2024-04-26 20:47:53.102397] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.985 [2024-04-26 20:47:53.102402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.102413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.112373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.112450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.985 [2024-04-26 20:47:53.112463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.985 [2024-04-26 20:47:53.112469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.985 [2024-04-26 20:47:53.112473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.112488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.122470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.122545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.985 [2024-04-26 20:47:53.122560] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.985 [2024-04-26 20:47:53.122566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.985 [2024-04-26 20:47:53.122572] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.122584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.132466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.132548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.985 [2024-04-26 20:47:53.132562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.985 [2024-04-26 20:47:53.132568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.985 [2024-04-26 20:47:53.132573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.132585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.142498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.142573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.985 [2024-04-26 20:47:53.142586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.985 [2024-04-26 20:47:53.142592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.985 [2024-04-26 20:47:53.142597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.142609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.152592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.152664] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.985 [2024-04-26 20:47:53.152677] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.985 [2024-04-26 20:47:53.152682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.985 [2024-04-26 20:47:53.152687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.152698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.162547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.162624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.985 [2024-04-26 20:47:53.162637] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.985 [2024-04-26 20:47:53.162643] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.985 [2024-04-26 20:47:53.162647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.162659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.172511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.172605] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.985 [2024-04-26 20:47:53.172620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.985 [2024-04-26 20:47:53.172625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.985 [2024-04-26 20:47:53.172630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.172641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.182582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.182651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.985 [2024-04-26 20:47:53.182665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.985 [2024-04-26 20:47:53.182670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.985 [2024-04-26 20:47:53.182675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.182686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.192619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.192694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.985 [2024-04-26 20:47:53.192707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.985 [2024-04-26 20:47:53.192713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.985 [2024-04-26 20:47:53.192718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.985 [2024-04-26 20:47:53.192729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.985 qpair failed and we were unable to recover it. 00:30:34.985 [2024-04-26 20:47:53.202670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.985 [2024-04-26 20:47:53.202774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.986 [2024-04-26 20:47:53.202788] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.986 [2024-04-26 20:47:53.202794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.986 [2024-04-26 20:47:53.202801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.986 [2024-04-26 20:47:53.202813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.986 qpair failed and we were unable to recover it. 00:30:34.986 [2024-04-26 20:47:53.212624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.986 [2024-04-26 20:47:53.212704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.986 [2024-04-26 20:47:53.212717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.986 [2024-04-26 20:47:53.212723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.986 [2024-04-26 20:47:53.212727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.986 [2024-04-26 20:47:53.212740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.986 qpair failed and we were unable to recover it. 00:30:34.986 [2024-04-26 20:47:53.222702] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.986 [2024-04-26 20:47:53.222777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.986 [2024-04-26 20:47:53.222791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.986 [2024-04-26 20:47:53.222796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.986 [2024-04-26 20:47:53.222800] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.986 [2024-04-26 20:47:53.222812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.986 qpair failed and we were unable to recover it. 00:30:34.986 [2024-04-26 20:47:53.232744] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.986 [2024-04-26 20:47:53.232830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.986 [2024-04-26 20:47:53.232843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.986 [2024-04-26 20:47:53.232849] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.986 [2024-04-26 20:47:53.232854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.986 [2024-04-26 20:47:53.232865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.986 qpair failed and we were unable to recover it. 00:30:34.986 [2024-04-26 20:47:53.242793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.986 [2024-04-26 20:47:53.242873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.986 [2024-04-26 20:47:53.242893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.986 [2024-04-26 20:47:53.242900] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.986 [2024-04-26 20:47:53.242905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.986 [2024-04-26 20:47:53.242921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.986 qpair failed and we were unable to recover it. 00:30:34.986 [2024-04-26 20:47:53.252817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.986 [2024-04-26 20:47:53.252910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.986 [2024-04-26 20:47:53.252931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.986 [2024-04-26 20:47:53.252939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.986 [2024-04-26 20:47:53.252944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.986 [2024-04-26 20:47:53.252959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.986 qpair failed and we were unable to recover it. 00:30:34.986 [2024-04-26 20:47:53.262840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.986 [2024-04-26 20:47:53.262918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.986 [2024-04-26 20:47:53.262938] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.986 [2024-04-26 20:47:53.262945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.986 [2024-04-26 20:47:53.262950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.986 [2024-04-26 20:47:53.262964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.986 qpair failed and we were unable to recover it. 00:30:34.986 [2024-04-26 20:47:53.272757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.986 [2024-04-26 20:47:53.272870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.986 [2024-04-26 20:47:53.272890] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.986 [2024-04-26 20:47:53.272896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.986 [2024-04-26 20:47:53.272901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.986 [2024-04-26 20:47:53.272916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.986 qpair failed and we were unable to recover it. 00:30:34.986 [2024-04-26 20:47:53.282906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.986 [2024-04-26 20:47:53.282977] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.986 [2024-04-26 20:47:53.282992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.986 [2024-04-26 20:47:53.282997] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.986 [2024-04-26 20:47:53.283002] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.986 [2024-04-26 20:47:53.283014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.986 qpair failed and we were unable to recover it. 00:30:34.986 [2024-04-26 20:47:53.292901] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.986 [2024-04-26 20:47:53.292979] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.986 [2024-04-26 20:47:53.292993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.986 [2024-04-26 20:47:53.293002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.986 [2024-04-26 20:47:53.293006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.986 [2024-04-26 20:47:53.293018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.986 qpair failed and we were unable to recover it. 00:30:34.986 [2024-04-26 20:47:53.302945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.986 [2024-04-26 20:47:53.303033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.986 [2024-04-26 20:47:53.303052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.986 [2024-04-26 20:47:53.303059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.986 [2024-04-26 20:47:53.303064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.986 [2024-04-26 20:47:53.303079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.986 qpair failed and we were unable to recover it. 00:30:34.986 [2024-04-26 20:47:53.312970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.986 [2024-04-26 20:47:53.313042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.986 [2024-04-26 20:47:53.313057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.986 [2024-04-26 20:47:53.313062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.986 [2024-04-26 20:47:53.313067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.986 [2024-04-26 20:47:53.313079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.986 qpair failed and we were unable to recover it. 00:30:34.986 [2024-04-26 20:47:53.322973] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:34.986 [2024-04-26 20:47:53.323046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:34.986 [2024-04-26 20:47:53.323059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:34.986 [2024-04-26 20:47:53.323066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:34.986 [2024-04-26 20:47:53.323070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:34.986 [2024-04-26 20:47:53.323082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.986 qpair failed and we were unable to recover it. 00:30:35.249 [2024-04-26 20:47:53.333028] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.249 [2024-04-26 20:47:53.333106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.249 [2024-04-26 20:47:53.333119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.249 [2024-04-26 20:47:53.333124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.249 [2024-04-26 20:47:53.333129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.249 [2024-04-26 20:47:53.333141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-04-26 20:47:53.343020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.249 [2024-04-26 20:47:53.343101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.249 [2024-04-26 20:47:53.343120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.249 [2024-04-26 20:47:53.343127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.249 [2024-04-26 20:47:53.343132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.249 [2024-04-26 20:47:53.343147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-04-26 20:47:53.353056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.249 [2024-04-26 20:47:53.353168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.249 [2024-04-26 20:47:53.353183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.249 [2024-04-26 20:47:53.353189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.249 [2024-04-26 20:47:53.353194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.249 [2024-04-26 20:47:53.353206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.363129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.363239] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.250 [2024-04-26 20:47:53.363252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.250 [2024-04-26 20:47:53.363258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.250 [2024-04-26 20:47:53.363263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.250 [2024-04-26 20:47:53.363274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.373089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.373165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.250 [2024-04-26 20:47:53.373178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.250 [2024-04-26 20:47:53.373183] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.250 [2024-04-26 20:47:53.373188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.250 [2024-04-26 20:47:53.373199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.383224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.383307] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.250 [2024-04-26 20:47:53.383322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.250 [2024-04-26 20:47:53.383331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.250 [2024-04-26 20:47:53.383336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.250 [2024-04-26 20:47:53.383351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.393161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.393237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.250 [2024-04-26 20:47:53.393250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.250 [2024-04-26 20:47:53.393256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.250 [2024-04-26 20:47:53.393260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.250 [2024-04-26 20:47:53.393272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.403088] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.403160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.250 [2024-04-26 20:47:53.403173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.250 [2024-04-26 20:47:53.403179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.250 [2024-04-26 20:47:53.403183] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.250 [2024-04-26 20:47:53.403194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.413146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.413265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.250 [2024-04-26 20:47:53.413282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.250 [2024-04-26 20:47:53.413288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.250 [2024-04-26 20:47:53.413292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.250 [2024-04-26 20:47:53.413304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.423253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.423329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.250 [2024-04-26 20:47:53.423342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.250 [2024-04-26 20:47:53.423348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.250 [2024-04-26 20:47:53.423352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.250 [2024-04-26 20:47:53.423363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.433168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.433245] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.250 [2024-04-26 20:47:53.433258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.250 [2024-04-26 20:47:53.433264] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.250 [2024-04-26 20:47:53.433268] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.250 [2024-04-26 20:47:53.433282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.443383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.443503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.250 [2024-04-26 20:47:53.443516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.250 [2024-04-26 20:47:53.443521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.250 [2024-04-26 20:47:53.443526] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.250 [2024-04-26 20:47:53.443538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.453319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.453416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.250 [2024-04-26 20:47:53.453429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.250 [2024-04-26 20:47:53.453435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.250 [2024-04-26 20:47:53.453439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.250 [2024-04-26 20:47:53.453451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.463353] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.463423] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.250 [2024-04-26 20:47:53.463436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.250 [2024-04-26 20:47:53.463442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.250 [2024-04-26 20:47:53.463446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.250 [2024-04-26 20:47:53.463457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.473425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.473519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.250 [2024-04-26 20:47:53.473536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.250 [2024-04-26 20:47:53.473542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.250 [2024-04-26 20:47:53.473546] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.250 [2024-04-26 20:47:53.473558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.483452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.483527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.250 [2024-04-26 20:47:53.483541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.250 [2024-04-26 20:47:53.483547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.250 [2024-04-26 20:47:53.483551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.250 [2024-04-26 20:47:53.483563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-04-26 20:47:53.493466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.250 [2024-04-26 20:47:53.493543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.251 [2024-04-26 20:47:53.493557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.251 [2024-04-26 20:47:53.493562] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.251 [2024-04-26 20:47:53.493567] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.251 [2024-04-26 20:47:53.493578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-04-26 20:47:53.503469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.251 [2024-04-26 20:47:53.503543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.251 [2024-04-26 20:47:53.503555] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.251 [2024-04-26 20:47:53.503561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.251 [2024-04-26 20:47:53.503566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.251 [2024-04-26 20:47:53.503577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-04-26 20:47:53.513483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.251 [2024-04-26 20:47:53.513561] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.251 [2024-04-26 20:47:53.513574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.251 [2024-04-26 20:47:53.513580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.251 [2024-04-26 20:47:53.513584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.251 [2024-04-26 20:47:53.513599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-04-26 20:47:53.523579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.251 [2024-04-26 20:47:53.523651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.251 [2024-04-26 20:47:53.523664] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.251 [2024-04-26 20:47:53.523670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.251 [2024-04-26 20:47:53.523674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.251 [2024-04-26 20:47:53.523686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-04-26 20:47:53.533591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.251 [2024-04-26 20:47:53.533685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.251 [2024-04-26 20:47:53.533699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.251 [2024-04-26 20:47:53.533704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.251 [2024-04-26 20:47:53.533709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.251 [2024-04-26 20:47:53.533720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-04-26 20:47:53.543480] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.251 [2024-04-26 20:47:53.543555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.251 [2024-04-26 20:47:53.543569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.251 [2024-04-26 20:47:53.543574] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.251 [2024-04-26 20:47:53.543579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.251 [2024-04-26 20:47:53.543591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-04-26 20:47:53.553675] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.251 [2024-04-26 20:47:53.553747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.251 [2024-04-26 20:47:53.553760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.251 [2024-04-26 20:47:53.553766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.251 [2024-04-26 20:47:53.553770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.251 [2024-04-26 20:47:53.553782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-04-26 20:47:53.563676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.251 [2024-04-26 20:47:53.563764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.251 [2024-04-26 20:47:53.563780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.251 [2024-04-26 20:47:53.563786] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.251 [2024-04-26 20:47:53.563790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.251 [2024-04-26 20:47:53.563802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-04-26 20:47:53.573678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.251 [2024-04-26 20:47:53.573779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.251 [2024-04-26 20:47:53.573793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.251 [2024-04-26 20:47:53.573798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.251 [2024-04-26 20:47:53.573803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.251 [2024-04-26 20:47:53.573814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-04-26 20:47:53.583677] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.251 [2024-04-26 20:47:53.583749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.251 [2024-04-26 20:47:53.583763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.251 [2024-04-26 20:47:53.583768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.251 [2024-04-26 20:47:53.583773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.251 [2024-04-26 20:47:53.583784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.513 [2024-04-26 20:47:53.593701] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.593789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.593802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.593808] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.514 [2024-04-26 20:47:53.593813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.514 [2024-04-26 20:47:53.593825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.514 qpair failed and we were unable to recover it. 00:30:35.514 [2024-04-26 20:47:53.603746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.603825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.603837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.603843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.514 [2024-04-26 20:47:53.603848] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.514 [2024-04-26 20:47:53.603862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.514 qpair failed and we were unable to recover it. 00:30:35.514 [2024-04-26 20:47:53.613823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.613900] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.613914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.613919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.514 [2024-04-26 20:47:53.613924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.514 [2024-04-26 20:47:53.613935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.514 qpair failed and we were unable to recover it. 00:30:35.514 [2024-04-26 20:47:53.623822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.623933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.623948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.623953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.514 [2024-04-26 20:47:53.623958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.514 [2024-04-26 20:47:53.623969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.514 qpair failed and we were unable to recover it. 00:30:35.514 [2024-04-26 20:47:53.633842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.633914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.633927] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.633933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.514 [2024-04-26 20:47:53.633937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.514 [2024-04-26 20:47:53.633948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.514 qpair failed and we were unable to recover it. 00:30:35.514 [2024-04-26 20:47:53.643909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.643986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.644000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.644006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.514 [2024-04-26 20:47:53.644010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.514 [2024-04-26 20:47:53.644022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.514 qpair failed and we were unable to recover it. 00:30:35.514 [2024-04-26 20:47:53.653818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.653894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.653910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.653916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.514 [2024-04-26 20:47:53.653920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.514 [2024-04-26 20:47:53.653932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.514 qpair failed and we were unable to recover it. 00:30:35.514 [2024-04-26 20:47:53.663903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.663978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.663991] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.663996] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.514 [2024-04-26 20:47:53.664000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.514 [2024-04-26 20:47:53.664011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.514 qpair failed and we were unable to recover it. 00:30:35.514 [2024-04-26 20:47:53.673941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.674019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.674039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.674046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.514 [2024-04-26 20:47:53.674050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.514 [2024-04-26 20:47:53.674065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.514 qpair failed and we were unable to recover it. 00:30:35.514 [2024-04-26 20:47:53.683998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.684093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.684112] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.684119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.514 [2024-04-26 20:47:53.684124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.514 [2024-04-26 20:47:53.684139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.514 qpair failed and we were unable to recover it. 00:30:35.514 [2024-04-26 20:47:53.694038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.694145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.694165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.694172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.514 [2024-04-26 20:47:53.694180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.514 [2024-04-26 20:47:53.694195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.514 qpair failed and we were unable to recover it. 00:30:35.514 [2024-04-26 20:47:53.704032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.704103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.704117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.704123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.514 [2024-04-26 20:47:53.704128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.514 [2024-04-26 20:47:53.704140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.514 qpair failed and we were unable to recover it. 00:30:35.514 [2024-04-26 20:47:53.714087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.714166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.714179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.714185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.514 [2024-04-26 20:47:53.714190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.514 [2024-04-26 20:47:53.714202] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.514 qpair failed and we were unable to recover it. 00:30:35.514 [2024-04-26 20:47:53.724098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.514 [2024-04-26 20:47:53.724171] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.514 [2024-04-26 20:47:53.724184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.514 [2024-04-26 20:47:53.724190] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.724194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.724205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.515 [2024-04-26 20:47:53.734152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.515 [2024-04-26 20:47:53.734230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.515 [2024-04-26 20:47:53.734244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.515 [2024-04-26 20:47:53.734250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.734254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.734265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.515 [2024-04-26 20:47:53.744103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.515 [2024-04-26 20:47:53.744172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.515 [2024-04-26 20:47:53.744186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.515 [2024-04-26 20:47:53.744191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.744196] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.744207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.515 [2024-04-26 20:47:53.754052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.515 [2024-04-26 20:47:53.754168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.515 [2024-04-26 20:47:53.754182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.515 [2024-04-26 20:47:53.754187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.754192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.754203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.515 [2024-04-26 20:47:53.764244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.515 [2024-04-26 20:47:53.764320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.515 [2024-04-26 20:47:53.764334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.515 [2024-04-26 20:47:53.764339] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.764344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.764355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.515 [2024-04-26 20:47:53.774104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.515 [2024-04-26 20:47:53.774178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.515 [2024-04-26 20:47:53.774191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.515 [2024-04-26 20:47:53.774196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.774201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.774212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.515 [2024-04-26 20:47:53.784208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.515 [2024-04-26 20:47:53.784279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.515 [2024-04-26 20:47:53.784292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.515 [2024-04-26 20:47:53.784298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.784306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.784318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.515 [2024-04-26 20:47:53.794268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.515 [2024-04-26 20:47:53.794341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.515 [2024-04-26 20:47:53.794362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.515 [2024-04-26 20:47:53.794369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.794373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.794385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.515 [2024-04-26 20:47:53.804333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.515 [2024-04-26 20:47:53.804448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.515 [2024-04-26 20:47:53.804462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.515 [2024-04-26 20:47:53.804468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.804472] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.804484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.515 [2024-04-26 20:47:53.814341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.515 [2024-04-26 20:47:53.814418] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.515 [2024-04-26 20:47:53.814431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.515 [2024-04-26 20:47:53.814438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.814442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.814454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.515 [2024-04-26 20:47:53.824365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.515 [2024-04-26 20:47:53.824442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.515 [2024-04-26 20:47:53.824455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.515 [2024-04-26 20:47:53.824461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.824466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.824478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.515 [2024-04-26 20:47:53.834426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.515 [2024-04-26 20:47:53.834499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.515 [2024-04-26 20:47:53.834513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.515 [2024-04-26 20:47:53.834519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.834524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.834536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.515 [2024-04-26 20:47:53.844420] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.515 [2024-04-26 20:47:53.844494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.515 [2024-04-26 20:47:53.844507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.515 [2024-04-26 20:47:53.844513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.844518] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.844531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.515 [2024-04-26 20:47:53.854489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.515 [2024-04-26 20:47:53.854603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.515 [2024-04-26 20:47:53.854617] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.515 [2024-04-26 20:47:53.854623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.515 [2024-04-26 20:47:53.854627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.515 [2024-04-26 20:47:53.854639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.515 qpair failed and we were unable to recover it. 00:30:35.779 [2024-04-26 20:47:53.864500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.779 [2024-04-26 20:47:53.864576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.779 [2024-04-26 20:47:53.864589] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.779 [2024-04-26 20:47:53.864595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.779 [2024-04-26 20:47:53.864599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.779 [2024-04-26 20:47:53.864611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.779 qpair failed and we were unable to recover it. 00:30:35.779 [2024-04-26 20:47:53.874536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.779 [2024-04-26 20:47:53.874635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.779 [2024-04-26 20:47:53.874650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.779 [2024-04-26 20:47:53.874658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.779 [2024-04-26 20:47:53.874663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.779 [2024-04-26 20:47:53.874675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.779 qpair failed and we were unable to recover it. 00:30:35.779 [2024-04-26 20:47:53.884553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.779 [2024-04-26 20:47:53.884627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.779 [2024-04-26 20:47:53.884641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.779 [2024-04-26 20:47:53.884646] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.779 [2024-04-26 20:47:53.884651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.779 [2024-04-26 20:47:53.884662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.779 qpair failed and we were unable to recover it. 00:30:35.779 [2024-04-26 20:47:53.894440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.779 [2024-04-26 20:47:53.894513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.779 [2024-04-26 20:47:53.894526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.779 [2024-04-26 20:47:53.894532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.779 [2024-04-26 20:47:53.894536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.779 [2024-04-26 20:47:53.894548] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.779 qpair failed and we were unable to recover it. 00:30:35.779 [2024-04-26 20:47:53.904645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.779 [2024-04-26 20:47:53.904756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.779 [2024-04-26 20:47:53.904769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.779 [2024-04-26 20:47:53.904774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.779 [2024-04-26 20:47:53.904779] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.779 [2024-04-26 20:47:53.904791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.779 qpair failed and we were unable to recover it. 00:30:35.779 [2024-04-26 20:47:53.914623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.779 [2024-04-26 20:47:53.914735] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.779 [2024-04-26 20:47:53.914748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.779 [2024-04-26 20:47:53.914753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.779 [2024-04-26 20:47:53.914758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.779 [2024-04-26 20:47:53.914770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.779 qpair failed and we were unable to recover it. 00:30:35.779 [2024-04-26 20:47:53.924634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.779 [2024-04-26 20:47:53.924706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.779 [2024-04-26 20:47:53.924719] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.779 [2024-04-26 20:47:53.924724] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.779 [2024-04-26 20:47:53.924729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.779 [2024-04-26 20:47:53.924740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.779 qpair failed and we were unable to recover it. 00:30:35.779 [2024-04-26 20:47:53.934652] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.779 [2024-04-26 20:47:53.934726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.779 [2024-04-26 20:47:53.934739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.779 [2024-04-26 20:47:53.934744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.779 [2024-04-26 20:47:53.934749] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.779 [2024-04-26 20:47:53.934760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.779 qpair failed and we were unable to recover it. 00:30:35.779 [2024-04-26 20:47:53.944712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.779 [2024-04-26 20:47:53.944790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.779 [2024-04-26 20:47:53.944803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.779 [2024-04-26 20:47:53.944808] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.779 [2024-04-26 20:47:53.944813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.779 [2024-04-26 20:47:53.944824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.779 qpair failed and we were unable to recover it. 00:30:35.779 [2024-04-26 20:47:53.954701] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.779 [2024-04-26 20:47:53.954774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.779 [2024-04-26 20:47:53.954787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.779 [2024-04-26 20:47:53.954793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.779 [2024-04-26 20:47:53.954797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.779 [2024-04-26 20:47:53.954809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.779 qpair failed and we were unable to recover it. 00:30:35.779 [2024-04-26 20:47:53.964764] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.779 [2024-04-26 20:47:53.964837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.779 [2024-04-26 20:47:53.964853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.779 [2024-04-26 20:47:53.964858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.779 [2024-04-26 20:47:53.964863] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.779 [2024-04-26 20:47:53.964874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.779 qpair failed and we were unable to recover it. 00:30:35.779 [2024-04-26 20:47:53.974814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.779 [2024-04-26 20:47:53.974895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.779 [2024-04-26 20:47:53.974915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.779 [2024-04-26 20:47:53.974922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.779 [2024-04-26 20:47:53.974927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.779 [2024-04-26 20:47:53.974942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.779 qpair failed and we were unable to recover it. 00:30:35.779 [2024-04-26 20:47:53.984822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.779 [2024-04-26 20:47:53.984896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.779 [2024-04-26 20:47:53.984910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.780 [2024-04-26 20:47:53.984916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.780 [2024-04-26 20:47:53.984921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.780 [2024-04-26 20:47:53.984933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.780 qpair failed and we were unable to recover it. 00:30:35.780 [2024-04-26 20:47:53.994803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.780 [2024-04-26 20:47:53.994876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.780 [2024-04-26 20:47:53.994890] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.780 [2024-04-26 20:47:53.994896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.780 [2024-04-26 20:47:53.994900] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.780 [2024-04-26 20:47:53.994912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.780 qpair failed and we were unable to recover it. 00:30:35.780 [2024-04-26 20:47:54.004740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.780 [2024-04-26 20:47:54.004813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.780 [2024-04-26 20:47:54.004826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.780 [2024-04-26 20:47:54.004832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.780 [2024-04-26 20:47:54.004836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.780 [2024-04-26 20:47:54.004848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.780 qpair failed and we were unable to recover it. 00:30:35.780 [2024-04-26 20:47:54.014893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.780 [2024-04-26 20:47:54.014998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.780 [2024-04-26 20:47:54.015017] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.780 [2024-04-26 20:47:54.015024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.780 [2024-04-26 20:47:54.015028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.780 [2024-04-26 20:47:54.015044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.780 qpair failed and we were unable to recover it. 00:30:35.780 [2024-04-26 20:47:54.024892] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.780 [2024-04-26 20:47:54.024967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.780 [2024-04-26 20:47:54.024987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.780 [2024-04-26 20:47:54.024994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.780 [2024-04-26 20:47:54.024998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d8c000b90 00:30:35.780 [2024-04-26 20:47:54.025013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:35.780 qpair failed and we were unable to recover it. 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 [2024-04-26 20:47:54.025447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.780 [2024-04-26 20:47:54.034951] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.780 [2024-04-26 20:47:54.035052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.780 [2024-04-26 20:47:54.035074] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.780 [2024-04-26 20:47:54.035083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.780 [2024-04-26 20:47:54.035090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d94000b90 00:30:35.780 [2024-04-26 20:47:54.035109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.780 qpair failed and we were unable to recover it. 00:30:35.780 [2024-04-26 20:47:54.044988] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.780 [2024-04-26 20:47:54.045087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.780 [2024-04-26 20:47:54.045113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.780 [2024-04-26 20:47:54.045121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.780 [2024-04-26 20:47:54.045128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d94000b90 00:30:35.780 [2024-04-26 20:47:54.045148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:35.780 qpair failed and we were unable to recover it. 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Write completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.780 Read completed with error (sct=0, sc=8) 00:30:35.780 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 [2024-04-26 20:47:54.045572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:35.781 [2024-04-26 20:47:54.055076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.781 [2024-04-26 20:47:54.055204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.781 [2024-04-26 20:47:54.055230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.781 [2024-04-26 20:47:54.055238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.781 [2024-04-26 20:47:54.055245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1cadd90 00:30:35.781 [2024-04-26 20:47:54.055262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:35.781 qpair failed and we were unable to recover it. 00:30:35.781 [2024-04-26 20:47:54.065055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.781 [2024-04-26 20:47:54.065162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.781 [2024-04-26 20:47:54.065188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.781 [2024-04-26 20:47:54.065201] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.781 [2024-04-26 20:47:54.065208] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1cadd90 00:30:35.781 [2024-04-26 20:47:54.065228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:35.781 qpair failed and we were unable to recover it. 00:30:35.781 [2024-04-26 20:47:54.065591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cacb50 is same with the state(5) to be set 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Write completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Write completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Write completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Write completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Write completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Write completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Write completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Read completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Write completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Write completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 Write completed with error (sct=0, sc=8) 00:30:35.781 starting I/O failed 00:30:35.781 [2024-04-26 20:47:54.066045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:35.781 [2024-04-26 20:47:54.075091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.781 [2024-04-26 20:47:54.075192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.781 [2024-04-26 20:47:54.075218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.781 [2024-04-26 20:47:54.075227] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.781 [2024-04-26 20:47:54.075234] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d84000b90 00:30:35.781 [2024-04-26 20:47:54.075252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:35.781 qpair failed and we were unable to recover it. 00:30:35.781 [2024-04-26 20:47:54.085085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:35.781 [2024-04-26 20:47:54.085179] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:35.781 [2024-04-26 20:47:54.085197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:35.781 [2024-04-26 20:47:54.085205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:35.781 [2024-04-26 20:47:54.085213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f6d84000b90 00:30:35.781 [2024-04-26 20:47:54.085230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:35.781 qpair failed and we were unable to recover it. 00:30:35.781 [2024-04-26 20:47:54.085735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cacb50 (9): Bad file descriptor 00:30:35.781 Initializing NVMe Controllers 00:30:35.781 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:35.781 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:35.781 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:35.781 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:35.781 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:35.781 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:35.781 Initialization complete. Launching workers. 00:30:35.781 Starting thread on core 1 00:30:35.781 Starting thread on core 2 00:30:35.781 Starting thread on core 3 00:30:35.781 Starting thread on core 0 00:30:35.781 20:47:54 -- host/target_disconnect.sh@59 -- # sync 00:30:35.781 00:30:35.781 real 0m11.279s 00:30:35.781 user 0m19.878s 00:30:35.781 sys 0m4.347s 00:30:35.781 20:47:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:35.781 20:47:54 -- common/autotest_common.sh@10 -- # set +x 00:30:35.781 ************************************ 00:30:35.781 END TEST nvmf_target_disconnect_tc2 00:30:35.781 ************************************ 00:30:36.042 20:47:54 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:36.042 20:47:54 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:36.042 20:47:54 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:36.042 20:47:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:36.042 20:47:54 -- nvmf/common.sh@116 -- # sync 00:30:36.042 20:47:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:36.042 20:47:54 -- nvmf/common.sh@119 -- # set +e 00:30:36.042 20:47:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:36.042 20:47:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:36.042 rmmod nvme_tcp 00:30:36.042 rmmod nvme_fabrics 00:30:36.042 rmmod nvme_keyring 00:30:36.042 20:47:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:36.042 20:47:54 -- nvmf/common.sh@123 -- # set -e 00:30:36.042 20:47:54 -- nvmf/common.sh@124 -- # return 0 00:30:36.042 20:47:54 -- nvmf/common.sh@477 -- # '[' -n 61359 ']' 00:30:36.042 20:47:54 -- nvmf/common.sh@478 -- # killprocess 61359 00:30:36.042 20:47:54 -- common/autotest_common.sh@926 -- # '[' -z 61359 ']' 00:30:36.042 20:47:54 -- common/autotest_common.sh@930 -- # kill -0 61359 00:30:36.042 20:47:54 -- common/autotest_common.sh@931 -- # uname 00:30:36.042 20:47:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:36.042 20:47:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 61359 00:30:36.042 20:47:54 -- common/autotest_common.sh@932 -- # process_name=reactor_4 00:30:36.042 20:47:54 -- common/autotest_common.sh@936 -- # '[' reactor_4 = sudo ']' 00:30:36.042 20:47:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 61359' 00:30:36.042 killing process with pid 61359 00:30:36.042 20:47:54 -- common/autotest_common.sh@945 -- # kill 61359 00:30:36.042 20:47:54 -- common/autotest_common.sh@950 -- # wait 61359 00:30:36.042 20:47:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:36.042 20:47:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:36.042 20:47:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:36.042 20:47:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:36.042 20:47:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:36.042 20:47:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:36.042 20:47:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:36.042 20:47:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:38.591 20:47:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:38.591 00:30:38.591 real 0m20.989s 00:30:38.591 user 0m47.043s 00:30:38.591 sys 0m10.035s 00:30:38.591 20:47:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:38.591 20:47:56 -- common/autotest_common.sh@10 -- # set +x 00:30:38.591 ************************************ 00:30:38.591 END TEST nvmf_target_disconnect 00:30:38.591 ************************************ 00:30:38.591 20:47:56 -- nvmf/nvmf.sh@126 -- # timing_exit host 00:30:38.591 20:47:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:38.591 20:47:56 -- common/autotest_common.sh@10 -- # set +x 00:30:38.591 20:47:56 -- nvmf/nvmf.sh@128 -- # trap - SIGINT SIGTERM EXIT 00:30:38.591 00:30:38.591 real 24m5.879s 00:30:38.591 user 63m39.668s 00:30:38.591 sys 6m28.076s 00:30:38.591 20:47:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:38.591 20:47:56 -- common/autotest_common.sh@10 -- # set +x 00:30:38.591 ************************************ 00:30:38.591 END TEST nvmf_tcp 00:30:38.591 ************************************ 00:30:38.591 20:47:56 -- spdk/autotest.sh@296 -- # [[ 0 -eq 0 ]] 00:30:38.591 20:47:56 -- spdk/autotest.sh@297 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:38.591 20:47:56 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:30:38.591 20:47:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:38.591 20:47:56 -- common/autotest_common.sh@10 -- # set +x 00:30:38.591 ************************************ 00:30:38.591 START TEST spdkcli_nvmf_tcp 00:30:38.591 ************************************ 00:30:38.591 20:47:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:38.591 * Looking for test storage... 00:30:38.591 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:38.591 20:47:56 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:38.591 20:47:56 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:38.591 20:47:56 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:38.591 20:47:56 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:38.591 20:47:56 -- nvmf/common.sh@7 -- # uname -s 00:30:38.591 20:47:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:38.591 20:47:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:38.591 20:47:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:38.591 20:47:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:38.591 20:47:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:38.591 20:47:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:38.591 20:47:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:38.591 20:47:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:38.591 20:47:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:38.591 20:47:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:38.591 20:47:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:30:38.591 20:47:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:30:38.591 20:47:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:38.591 20:47:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:38.591 20:47:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:38.591 20:47:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:38.591 20:47:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:38.591 20:47:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:38.591 20:47:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:38.591 20:47:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:38.591 20:47:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:38.591 20:47:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:38.591 20:47:56 -- paths/export.sh@5 -- # export PATH 00:30:38.591 20:47:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:38.591 20:47:56 -- nvmf/common.sh@46 -- # : 0 00:30:38.591 20:47:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:38.591 20:47:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:38.591 20:47:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:38.591 20:47:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:38.591 20:47:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:38.591 20:47:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:38.591 20:47:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:38.591 20:47:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:38.591 20:47:56 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:38.591 20:47:56 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:38.591 20:47:56 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:38.591 20:47:56 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:38.591 20:47:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:38.591 20:47:56 -- common/autotest_common.sh@10 -- # set +x 00:30:38.591 20:47:56 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:38.591 20:47:56 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=63193 00:30:38.591 20:47:56 -- spdkcli/common.sh@34 -- # waitforlisten 63193 00:30:38.591 20:47:56 -- common/autotest_common.sh@819 -- # '[' -z 63193 ']' 00:30:38.591 20:47:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:38.591 20:47:56 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:38.591 20:47:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:38.591 20:47:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:38.591 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:38.591 20:47:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:38.591 20:47:56 -- common/autotest_common.sh@10 -- # set +x 00:30:38.591 [2024-04-26 20:47:56.763290] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:30:38.591 [2024-04-26 20:47:56.763351] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid63193 ] 00:30:38.591 EAL: No free 2048 kB hugepages reported on node 1 00:30:38.591 [2024-04-26 20:47:56.822517] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:38.591 [2024-04-26 20:47:56.887185] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:38.592 [2024-04-26 20:47:56.887348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:38.592 [2024-04-26 20:47:56.887370] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:39.534 20:47:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:39.534 20:47:57 -- common/autotest_common.sh@852 -- # return 0 00:30:39.534 20:47:57 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:39.534 20:47:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:39.534 20:47:57 -- common/autotest_common.sh@10 -- # set +x 00:30:39.534 20:47:57 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:39.534 20:47:57 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:39.534 20:47:57 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:39.534 20:47:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:39.534 20:47:57 -- common/autotest_common.sh@10 -- # set +x 00:30:39.534 20:47:57 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:39.534 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:39.534 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:39.534 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:39.534 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:39.534 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:39.534 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:39.534 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:39.534 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:39.534 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:39.534 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:39.534 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:39.534 ' 00:30:39.796 [2024-04-26 20:47:57.883703] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:41.710 [2024-04-26 20:47:59.891838] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:43.099 [2024-04-26 20:48:01.055758] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:45.101 [2024-04-26 20:48:03.238200] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:47.015 [2024-04-26 20:48:05.119992] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:30:48.401 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:48.401 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:48.401 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:48.401 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:48.401 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:48.401 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:48.401 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:48.401 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:48.401 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:48.401 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:48.401 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:48.401 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:48.401 20:48:06 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:48.401 20:48:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:48.401 20:48:06 -- common/autotest_common.sh@10 -- # set +x 00:30:48.401 20:48:06 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:48.401 20:48:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:48.401 20:48:06 -- common/autotest_common.sh@10 -- # set +x 00:30:48.401 20:48:06 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:48.401 20:48:06 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:48.973 20:48:07 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:48.973 20:48:07 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:48.973 20:48:07 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:48.973 20:48:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:48.973 20:48:07 -- common/autotest_common.sh@10 -- # set +x 00:30:48.973 20:48:07 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:48.973 20:48:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:48.973 20:48:07 -- common/autotest_common.sh@10 -- # set +x 00:30:48.973 20:48:07 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:48.973 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:48.973 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:48.973 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:48.973 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:30:48.973 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:30:48.973 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:48.973 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:48.973 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:48.973 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:48.973 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:48.973 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:48.973 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:48.973 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:48.973 ' 00:30:54.267 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:30:54.267 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:30:54.267 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:54.267 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:30:54.267 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:30:54.267 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:30:54.267 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:30:54.267 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:54.267 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:30:54.267 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:30:54.267 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:30:54.267 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:30:54.267 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:30:54.267 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:30:54.267 20:48:12 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:30:54.267 20:48:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:54.267 20:48:12 -- common/autotest_common.sh@10 -- # set +x 00:30:54.267 20:48:12 -- spdkcli/nvmf.sh@90 -- # killprocess 63193 00:30:54.267 20:48:12 -- common/autotest_common.sh@926 -- # '[' -z 63193 ']' 00:30:54.267 20:48:12 -- common/autotest_common.sh@930 -- # kill -0 63193 00:30:54.267 20:48:12 -- common/autotest_common.sh@931 -- # uname 00:30:54.267 20:48:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:54.267 20:48:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 63193 00:30:54.267 20:48:12 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:30:54.267 20:48:12 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:30:54.267 20:48:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 63193' 00:30:54.267 killing process with pid 63193 00:30:54.267 20:48:12 -- common/autotest_common.sh@945 -- # kill 63193 00:30:54.267 [2024-04-26 20:48:12.101720] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:54.267 20:48:12 -- common/autotest_common.sh@950 -- # wait 63193 00:30:54.267 20:48:12 -- spdkcli/nvmf.sh@1 -- # cleanup 00:30:54.267 20:48:12 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:30:54.267 20:48:12 -- spdkcli/common.sh@13 -- # '[' -n 63193 ']' 00:30:54.267 20:48:12 -- spdkcli/common.sh@14 -- # killprocess 63193 00:30:54.267 20:48:12 -- common/autotest_common.sh@926 -- # '[' -z 63193 ']' 00:30:54.267 20:48:12 -- common/autotest_common.sh@930 -- # kill -0 63193 00:30:54.267 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (63193) - No such process 00:30:54.267 20:48:12 -- common/autotest_common.sh@953 -- # echo 'Process with pid 63193 is not found' 00:30:54.267 Process with pid 63193 is not found 00:30:54.267 20:48:12 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:30:54.267 20:48:12 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:30:54.267 20:48:12 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:30:54.267 00:30:54.267 real 0m15.654s 00:30:54.267 user 0m32.340s 00:30:54.267 sys 0m0.690s 00:30:54.267 20:48:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:54.267 20:48:12 -- common/autotest_common.sh@10 -- # set +x 00:30:54.267 ************************************ 00:30:54.267 END TEST spdkcli_nvmf_tcp 00:30:54.267 ************************************ 00:30:54.267 20:48:12 -- spdk/autotest.sh@298 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:54.267 20:48:12 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:30:54.267 20:48:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:54.267 20:48:12 -- common/autotest_common.sh@10 -- # set +x 00:30:54.267 ************************************ 00:30:54.267 START TEST nvmf_identify_passthru 00:30:54.267 ************************************ 00:30:54.267 20:48:12 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:54.267 * Looking for test storage... 00:30:54.267 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:54.267 20:48:12 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:54.267 20:48:12 -- nvmf/common.sh@7 -- # uname -s 00:30:54.267 20:48:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:54.267 20:48:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:54.267 20:48:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:54.267 20:48:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:54.267 20:48:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:54.267 20:48:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:54.267 20:48:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:54.267 20:48:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:54.267 20:48:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:54.267 20:48:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:54.267 20:48:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:30:54.267 20:48:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:30:54.267 20:48:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:54.267 20:48:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:54.268 20:48:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:54.268 20:48:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:54.268 20:48:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:54.268 20:48:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:54.268 20:48:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:54.268 20:48:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:54.268 20:48:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:54.268 20:48:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:54.268 20:48:12 -- paths/export.sh@5 -- # export PATH 00:30:54.268 20:48:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:54.268 20:48:12 -- nvmf/common.sh@46 -- # : 0 00:30:54.268 20:48:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:54.268 20:48:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:54.268 20:48:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:54.268 20:48:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:54.268 20:48:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:54.268 20:48:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:54.268 20:48:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:54.268 20:48:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:54.268 20:48:12 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:54.268 20:48:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:54.268 20:48:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:54.268 20:48:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:54.268 20:48:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:54.268 20:48:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:54.268 20:48:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:54.268 20:48:12 -- paths/export.sh@5 -- # export PATH 00:30:54.268 20:48:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:54.268 20:48:12 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:30:54.268 20:48:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:54.268 20:48:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:54.268 20:48:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:54.268 20:48:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:54.268 20:48:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:54.268 20:48:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:54.268 20:48:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:54.268 20:48:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:54.268 20:48:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:54.268 20:48:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:54.268 20:48:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:54.268 20:48:12 -- common/autotest_common.sh@10 -- # set +x 00:31:00.858 20:48:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:00.858 20:48:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:00.858 20:48:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:00.858 20:48:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:00.858 20:48:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:00.858 20:48:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:00.858 20:48:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:00.858 20:48:18 -- nvmf/common.sh@294 -- # net_devs=() 00:31:00.858 20:48:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:00.858 20:48:18 -- nvmf/common.sh@295 -- # e810=() 00:31:00.858 20:48:18 -- nvmf/common.sh@295 -- # local -ga e810 00:31:00.858 20:48:18 -- nvmf/common.sh@296 -- # x722=() 00:31:00.858 20:48:18 -- nvmf/common.sh@296 -- # local -ga x722 00:31:00.858 20:48:18 -- nvmf/common.sh@297 -- # mlx=() 00:31:00.858 20:48:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:00.858 20:48:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:00.858 20:48:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:00.858 20:48:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:00.858 20:48:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:00.858 20:48:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:00.858 20:48:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:00.858 20:48:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:00.858 20:48:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:00.858 20:48:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:00.858 20:48:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:00.858 20:48:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:00.858 20:48:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:00.858 20:48:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:00.858 20:48:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:00.858 20:48:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:00.858 20:48:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:31:00.858 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:31:00.858 20:48:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:00.858 20:48:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:31:00.858 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:31:00.858 20:48:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:00.858 20:48:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:00.858 20:48:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:00.858 20:48:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:00.858 20:48:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:00.858 20:48:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:31:00.858 Found net devices under 0000:4b:00.0: cvl_0_0 00:31:00.858 20:48:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:00.858 20:48:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:00.858 20:48:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:00.858 20:48:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:00.858 20:48:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:00.858 20:48:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:31:00.858 Found net devices under 0000:4b:00.1: cvl_0_1 00:31:00.858 20:48:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:00.858 20:48:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:00.858 20:48:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:00.858 20:48:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:00.858 20:48:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:00.858 20:48:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:00.858 20:48:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:00.858 20:48:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:00.858 20:48:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:00.858 20:48:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:00.858 20:48:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:00.858 20:48:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:00.858 20:48:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:00.858 20:48:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:00.858 20:48:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:00.858 20:48:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:00.858 20:48:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:00.858 20:48:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:00.858 20:48:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:00.858 20:48:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:00.858 20:48:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:00.858 20:48:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:00.858 20:48:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:00.858 20:48:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:01.119 20:48:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:01.119 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:01.119 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.434 ms 00:31:01.119 00:31:01.119 --- 10.0.0.2 ping statistics --- 00:31:01.119 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:01.119 rtt min/avg/max/mdev = 0.434/0.434/0.434/0.000 ms 00:31:01.119 20:48:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:01.119 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:01.119 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.426 ms 00:31:01.119 00:31:01.119 --- 10.0.0.1 ping statistics --- 00:31:01.119 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:01.119 rtt min/avg/max/mdev = 0.426/0.426/0.426/0.000 ms 00:31:01.119 20:48:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:01.119 20:48:19 -- nvmf/common.sh@410 -- # return 0 00:31:01.119 20:48:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:01.119 20:48:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:01.119 20:48:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:01.119 20:48:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:01.119 20:48:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:01.119 20:48:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:01.119 20:48:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:01.119 20:48:19 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:31:01.119 20:48:19 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:01.119 20:48:19 -- common/autotest_common.sh@10 -- # set +x 00:31:01.119 20:48:19 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:31:01.119 20:48:19 -- common/autotest_common.sh@1509 -- # bdfs=() 00:31:01.119 20:48:19 -- common/autotest_common.sh@1509 -- # local bdfs 00:31:01.119 20:48:19 -- common/autotest_common.sh@1510 -- # bdfs=($(get_nvme_bdfs)) 00:31:01.119 20:48:19 -- common/autotest_common.sh@1510 -- # get_nvme_bdfs 00:31:01.119 20:48:19 -- common/autotest_common.sh@1498 -- # bdfs=() 00:31:01.119 20:48:19 -- common/autotest_common.sh@1498 -- # local bdfs 00:31:01.119 20:48:19 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:31:01.119 20:48:19 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:31:01.119 20:48:19 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:31:01.119 20:48:19 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:31:01.119 20:48:19 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:65:00.0 00:31:01.119 20:48:19 -- common/autotest_common.sh@1512 -- # echo 0000:65:00.0 00:31:01.119 20:48:19 -- target/identify_passthru.sh@16 -- # bdf=0000:65:00.0 00:31:01.119 20:48:19 -- target/identify_passthru.sh@17 -- # '[' -z 0000:65:00.0 ']' 00:31:01.119 20:48:19 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:65:00.0' -i 0 00:31:01.119 20:48:19 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:31:01.119 20:48:19 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:31:01.119 EAL: No free 2048 kB hugepages reported on node 1 00:31:01.691 20:48:19 -- target/identify_passthru.sh@23 -- # nvme_serial_number=S64GNE0R605487 00:31:01.691 20:48:19 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:65:00.0' -i 0 00:31:01.691 20:48:19 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:31:01.691 20:48:19 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:31:01.691 EAL: No free 2048 kB hugepages reported on node 1 00:31:02.262 20:48:20 -- target/identify_passthru.sh@24 -- # nvme_model_number=SAMSUNG 00:31:02.262 20:48:20 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:31:02.262 20:48:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:02.262 20:48:20 -- common/autotest_common.sh@10 -- # set +x 00:31:02.262 20:48:20 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:31:02.262 20:48:20 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:02.262 20:48:20 -- common/autotest_common.sh@10 -- # set +x 00:31:02.262 20:48:20 -- target/identify_passthru.sh@31 -- # nvmfpid=70559 00:31:02.262 20:48:20 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:02.262 20:48:20 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:31:02.262 20:48:20 -- target/identify_passthru.sh@35 -- # waitforlisten 70559 00:31:02.262 20:48:20 -- common/autotest_common.sh@819 -- # '[' -z 70559 ']' 00:31:02.262 20:48:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:02.262 20:48:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:31:02.262 20:48:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:02.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:02.262 20:48:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:31:02.262 20:48:20 -- common/autotest_common.sh@10 -- # set +x 00:31:02.262 [2024-04-26 20:48:20.403161] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:31:02.262 [2024-04-26 20:48:20.403217] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:02.262 EAL: No free 2048 kB hugepages reported on node 1 00:31:02.262 [2024-04-26 20:48:20.468645] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:02.262 [2024-04-26 20:48:20.531729] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:02.262 [2024-04-26 20:48:20.531864] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:02.262 [2024-04-26 20:48:20.531874] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:02.262 [2024-04-26 20:48:20.531883] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:02.262 [2024-04-26 20:48:20.532021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:02.262 [2024-04-26 20:48:20.532135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:02.262 [2024-04-26 20:48:20.532260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:02.262 [2024-04-26 20:48:20.532262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:02.832 20:48:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:31:02.832 20:48:21 -- common/autotest_common.sh@852 -- # return 0 00:31:02.832 20:48:21 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:31:02.832 20:48:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:02.832 20:48:21 -- common/autotest_common.sh@10 -- # set +x 00:31:02.832 INFO: Log level set to 20 00:31:02.832 INFO: Requests: 00:31:02.832 { 00:31:02.832 "jsonrpc": "2.0", 00:31:02.832 "method": "nvmf_set_config", 00:31:02.832 "id": 1, 00:31:02.832 "params": { 00:31:02.832 "admin_cmd_passthru": { 00:31:02.832 "identify_ctrlr": true 00:31:02.832 } 00:31:02.832 } 00:31:02.832 } 00:31:02.832 00:31:02.832 INFO: response: 00:31:02.832 { 00:31:02.832 "jsonrpc": "2.0", 00:31:02.832 "id": 1, 00:31:02.832 "result": true 00:31:02.832 } 00:31:02.832 00:31:02.832 20:48:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:02.832 20:48:21 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:31:03.093 20:48:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:03.093 20:48:21 -- common/autotest_common.sh@10 -- # set +x 00:31:03.093 INFO: Setting log level to 20 00:31:03.093 INFO: Setting log level to 20 00:31:03.093 INFO: Log level set to 20 00:31:03.093 INFO: Log level set to 20 00:31:03.093 INFO: Requests: 00:31:03.093 { 00:31:03.093 "jsonrpc": "2.0", 00:31:03.093 "method": "framework_start_init", 00:31:03.093 "id": 1 00:31:03.093 } 00:31:03.093 00:31:03.093 INFO: Requests: 00:31:03.093 { 00:31:03.093 "jsonrpc": "2.0", 00:31:03.093 "method": "framework_start_init", 00:31:03.093 "id": 1 00:31:03.093 } 00:31:03.093 00:31:03.093 [2024-04-26 20:48:21.246703] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:03.093 INFO: response: 00:31:03.093 { 00:31:03.093 "jsonrpc": "2.0", 00:31:03.093 "id": 1, 00:31:03.093 "result": true 00:31:03.093 } 00:31:03.093 00:31:03.093 INFO: response: 00:31:03.093 { 00:31:03.093 "jsonrpc": "2.0", 00:31:03.093 "id": 1, 00:31:03.093 "result": true 00:31:03.093 } 00:31:03.093 00:31:03.093 20:48:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:03.093 20:48:21 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:03.093 20:48:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:03.093 20:48:21 -- common/autotest_common.sh@10 -- # set +x 00:31:03.093 INFO: Setting log level to 40 00:31:03.093 INFO: Setting log level to 40 00:31:03.093 INFO: Setting log level to 40 00:31:03.093 [2024-04-26 20:48:21.259959] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:03.093 20:48:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:03.093 20:48:21 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:03.093 20:48:21 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:03.093 20:48:21 -- common/autotest_common.sh@10 -- # set +x 00:31:03.093 20:48:21 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:65:00.0 00:31:03.093 20:48:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:03.093 20:48:21 -- common/autotest_common.sh@10 -- # set +x 00:31:03.353 Nvme0n1 00:31:03.353 20:48:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:03.353 20:48:21 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:03.353 20:48:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:03.353 20:48:21 -- common/autotest_common.sh@10 -- # set +x 00:31:03.353 20:48:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:03.353 20:48:21 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:03.353 20:48:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:03.353 20:48:21 -- common/autotest_common.sh@10 -- # set +x 00:31:03.353 20:48:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:03.353 20:48:21 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:03.353 20:48:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:03.353 20:48:21 -- common/autotest_common.sh@10 -- # set +x 00:31:03.353 [2024-04-26 20:48:21.639655] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:03.353 20:48:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:03.353 20:48:21 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:03.353 20:48:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:03.353 20:48:21 -- common/autotest_common.sh@10 -- # set +x 00:31:03.353 [2024-04-26 20:48:21.651447] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:03.353 [ 00:31:03.353 { 00:31:03.353 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:03.353 "subtype": "Discovery", 00:31:03.353 "listen_addresses": [], 00:31:03.353 "allow_any_host": true, 00:31:03.353 "hosts": [] 00:31:03.353 }, 00:31:03.353 { 00:31:03.353 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:03.353 "subtype": "NVMe", 00:31:03.353 "listen_addresses": [ 00:31:03.353 { 00:31:03.353 "transport": "TCP", 00:31:03.353 "trtype": "TCP", 00:31:03.353 "adrfam": "IPv4", 00:31:03.353 "traddr": "10.0.0.2", 00:31:03.353 "trsvcid": "4420" 00:31:03.353 } 00:31:03.353 ], 00:31:03.353 "allow_any_host": true, 00:31:03.353 "hosts": [], 00:31:03.353 "serial_number": "SPDK00000000000001", 00:31:03.353 "model_number": "SPDK bdev Controller", 00:31:03.353 "max_namespaces": 1, 00:31:03.353 "min_cntlid": 1, 00:31:03.353 "max_cntlid": 65519, 00:31:03.353 "namespaces": [ 00:31:03.353 { 00:31:03.353 "nsid": 1, 00:31:03.353 "bdev_name": "Nvme0n1", 00:31:03.353 "name": "Nvme0n1", 00:31:03.353 "nguid": "3634473052605487002538450000003C", 00:31:03.354 "uuid": "36344730-5260-5487-0025-38450000003c" 00:31:03.354 } 00:31:03.354 ] 00:31:03.354 } 00:31:03.354 ] 00:31:03.354 20:48:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:03.354 20:48:21 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:03.354 20:48:21 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:03.354 20:48:21 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:03.354 EAL: No free 2048 kB hugepages reported on node 1 00:31:03.615 20:48:21 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=S64GNE0R605487 00:31:03.615 20:48:21 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:03.615 20:48:21 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:03.615 20:48:21 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:03.615 EAL: No free 2048 kB hugepages reported on node 1 00:31:03.875 20:48:22 -- target/identify_passthru.sh@61 -- # nvmf_model_number=SAMSUNG 00:31:03.875 20:48:22 -- target/identify_passthru.sh@63 -- # '[' S64GNE0R605487 '!=' S64GNE0R605487 ']' 00:31:03.875 20:48:22 -- target/identify_passthru.sh@68 -- # '[' SAMSUNG '!=' SAMSUNG ']' 00:31:03.875 20:48:22 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:03.875 20:48:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:03.875 20:48:22 -- common/autotest_common.sh@10 -- # set +x 00:31:03.875 20:48:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:03.875 20:48:22 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:03.875 20:48:22 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:03.875 20:48:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:03.875 20:48:22 -- nvmf/common.sh@116 -- # sync 00:31:03.875 20:48:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:03.875 20:48:22 -- nvmf/common.sh@119 -- # set +e 00:31:03.875 20:48:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:03.875 20:48:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:03.875 rmmod nvme_tcp 00:31:03.875 rmmod nvme_fabrics 00:31:03.875 rmmod nvme_keyring 00:31:03.875 20:48:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:03.875 20:48:22 -- nvmf/common.sh@123 -- # set -e 00:31:03.875 20:48:22 -- nvmf/common.sh@124 -- # return 0 00:31:03.875 20:48:22 -- nvmf/common.sh@477 -- # '[' -n 70559 ']' 00:31:03.875 20:48:22 -- nvmf/common.sh@478 -- # killprocess 70559 00:31:03.875 20:48:22 -- common/autotest_common.sh@926 -- # '[' -z 70559 ']' 00:31:03.875 20:48:22 -- common/autotest_common.sh@930 -- # kill -0 70559 00:31:03.875 20:48:22 -- common/autotest_common.sh@931 -- # uname 00:31:03.875 20:48:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:31:03.875 20:48:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 70559 00:31:03.875 20:48:22 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:31:03.875 20:48:22 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:31:03.875 20:48:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 70559' 00:31:03.875 killing process with pid 70559 00:31:03.875 20:48:22 -- common/autotest_common.sh@945 -- # kill 70559 00:31:03.875 [2024-04-26 20:48:22.187432] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:03.875 20:48:22 -- common/autotest_common.sh@950 -- # wait 70559 00:31:04.136 20:48:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:04.136 20:48:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:04.136 20:48:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:04.136 20:48:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:04.136 20:48:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:04.136 20:48:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:04.136 20:48:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:04.136 20:48:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:06.684 20:48:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:06.684 00:31:06.684 real 0m12.234s 00:31:06.684 user 0m9.896s 00:31:06.684 sys 0m5.739s 00:31:06.684 20:48:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:06.684 20:48:24 -- common/autotest_common.sh@10 -- # set +x 00:31:06.684 ************************************ 00:31:06.684 END TEST nvmf_identify_passthru 00:31:06.684 ************************************ 00:31:06.684 20:48:24 -- spdk/autotest.sh@300 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:06.684 20:48:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:06.684 20:48:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:06.684 20:48:24 -- common/autotest_common.sh@10 -- # set +x 00:31:06.684 ************************************ 00:31:06.684 START TEST nvmf_dif 00:31:06.684 ************************************ 00:31:06.684 20:48:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:06.684 * Looking for test storage... 00:31:06.684 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:06.684 20:48:24 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:06.684 20:48:24 -- nvmf/common.sh@7 -- # uname -s 00:31:06.684 20:48:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:06.684 20:48:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:06.684 20:48:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:06.684 20:48:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:06.684 20:48:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:06.684 20:48:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:06.684 20:48:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:06.684 20:48:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:06.684 20:48:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:06.684 20:48:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:06.684 20:48:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:31:06.684 20:48:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:31:06.684 20:48:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:06.684 20:48:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:06.684 20:48:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:06.684 20:48:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:06.684 20:48:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:06.684 20:48:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:06.684 20:48:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:06.684 20:48:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.684 20:48:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.684 20:48:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.684 20:48:24 -- paths/export.sh@5 -- # export PATH 00:31:06.684 20:48:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:06.684 20:48:24 -- nvmf/common.sh@46 -- # : 0 00:31:06.684 20:48:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:06.684 20:48:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:06.684 20:48:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:06.684 20:48:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:06.684 20:48:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:06.684 20:48:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:06.684 20:48:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:06.684 20:48:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:06.684 20:48:24 -- target/dif.sh@15 -- # NULL_META=16 00:31:06.684 20:48:24 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:06.684 20:48:24 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:06.684 20:48:24 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:06.684 20:48:24 -- target/dif.sh@135 -- # nvmftestinit 00:31:06.684 20:48:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:06.684 20:48:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:06.684 20:48:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:06.684 20:48:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:06.684 20:48:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:06.684 20:48:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:06.684 20:48:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:06.684 20:48:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:06.684 20:48:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:06.684 20:48:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:06.684 20:48:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:06.684 20:48:24 -- common/autotest_common.sh@10 -- # set +x 00:31:13.281 20:48:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:13.281 20:48:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:13.281 20:48:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:13.281 20:48:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:13.281 20:48:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:13.281 20:48:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:13.281 20:48:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:13.281 20:48:31 -- nvmf/common.sh@294 -- # net_devs=() 00:31:13.281 20:48:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:13.281 20:48:31 -- nvmf/common.sh@295 -- # e810=() 00:31:13.281 20:48:31 -- nvmf/common.sh@295 -- # local -ga e810 00:31:13.281 20:48:31 -- nvmf/common.sh@296 -- # x722=() 00:31:13.281 20:48:31 -- nvmf/common.sh@296 -- # local -ga x722 00:31:13.281 20:48:31 -- nvmf/common.sh@297 -- # mlx=() 00:31:13.281 20:48:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:13.281 20:48:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:13.281 20:48:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:13.281 20:48:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:13.281 20:48:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:13.281 20:48:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:13.281 20:48:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:13.281 20:48:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:13.281 20:48:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:13.281 20:48:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:13.281 20:48:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:13.281 20:48:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:13.281 20:48:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:13.281 20:48:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:13.281 20:48:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:13.281 20:48:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:13.281 20:48:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:31:13.281 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:31:13.281 20:48:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:13.281 20:48:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:31:13.281 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:31:13.281 20:48:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:13.281 20:48:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:13.281 20:48:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:13.281 20:48:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:13.281 20:48:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:13.281 20:48:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:31:13.281 Found net devices under 0000:4b:00.0: cvl_0_0 00:31:13.281 20:48:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:13.281 20:48:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:13.281 20:48:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:13.281 20:48:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:13.281 20:48:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:13.281 20:48:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:31:13.281 Found net devices under 0000:4b:00.1: cvl_0_1 00:31:13.281 20:48:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:13.281 20:48:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:13.281 20:48:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:13.281 20:48:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:13.281 20:48:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:13.281 20:48:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:13.281 20:48:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:13.281 20:48:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:13.281 20:48:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:13.281 20:48:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:13.281 20:48:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:13.281 20:48:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:13.281 20:48:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:13.281 20:48:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:13.281 20:48:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:13.281 20:48:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:13.281 20:48:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:13.281 20:48:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:13.543 20:48:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:13.543 20:48:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:13.543 20:48:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:13.543 20:48:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:13.543 20:48:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:13.543 20:48:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:13.805 20:48:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:13.805 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:13.805 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.474 ms 00:31:13.805 00:31:13.805 --- 10.0.0.2 ping statistics --- 00:31:13.805 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:13.805 rtt min/avg/max/mdev = 0.474/0.474/0.474/0.000 ms 00:31:13.805 20:48:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:13.805 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:13.805 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.389 ms 00:31:13.805 00:31:13.805 --- 10.0.0.1 ping statistics --- 00:31:13.805 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:13.805 rtt min/avg/max/mdev = 0.389/0.389/0.389/0.000 ms 00:31:13.805 20:48:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:13.805 20:48:31 -- nvmf/common.sh@410 -- # return 0 00:31:13.805 20:48:31 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:13.805 20:48:31 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:16.354 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:31:16.354 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:31:16.354 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:31:16.354 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:31:16.354 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:31:16.354 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:31:16.354 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:31:16.354 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:31:16.354 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:31:16.354 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:31:16.354 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:31:16.354 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:31:16.354 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:31:16.354 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:31:16.354 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:31:16.615 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:31:16.615 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:31:16.615 20:48:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:16.615 20:48:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:16.615 20:48:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:16.615 20:48:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:16.615 20:48:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:16.615 20:48:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:16.615 20:48:34 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:16.615 20:48:34 -- target/dif.sh@137 -- # nvmfappstart 00:31:16.615 20:48:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:16.615 20:48:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:16.615 20:48:34 -- common/autotest_common.sh@10 -- # set +x 00:31:16.615 20:48:34 -- nvmf/common.sh@469 -- # nvmfpid=76458 00:31:16.615 20:48:34 -- nvmf/common.sh@470 -- # waitforlisten 76458 00:31:16.615 20:48:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:16.615 20:48:34 -- common/autotest_common.sh@819 -- # '[' -z 76458 ']' 00:31:16.615 20:48:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:16.615 20:48:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:31:16.615 20:48:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:16.615 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:16.615 20:48:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:31:16.615 20:48:34 -- common/autotest_common.sh@10 -- # set +x 00:31:16.615 [2024-04-26 20:48:34.890196] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:31:16.615 [2024-04-26 20:48:34.890251] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:16.615 EAL: No free 2048 kB hugepages reported on node 1 00:31:16.615 [2024-04-26 20:48:34.955471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:16.876 [2024-04-26 20:48:35.018108] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:16.876 [2024-04-26 20:48:35.018225] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:16.876 [2024-04-26 20:48:35.018234] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:16.876 [2024-04-26 20:48:35.018241] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:16.876 [2024-04-26 20:48:35.018258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:17.449 20:48:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:31:17.449 20:48:35 -- common/autotest_common.sh@852 -- # return 0 00:31:17.449 20:48:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:17.449 20:48:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:17.449 20:48:35 -- common/autotest_common.sh@10 -- # set +x 00:31:17.449 20:48:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:17.449 20:48:35 -- target/dif.sh@139 -- # create_transport 00:31:17.449 20:48:35 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:17.449 20:48:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:17.449 20:48:35 -- common/autotest_common.sh@10 -- # set +x 00:31:17.449 [2024-04-26 20:48:35.692784] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:17.449 20:48:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:17.449 20:48:35 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:17.449 20:48:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:17.449 20:48:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:17.449 20:48:35 -- common/autotest_common.sh@10 -- # set +x 00:31:17.449 ************************************ 00:31:17.449 START TEST fio_dif_1_default 00:31:17.449 ************************************ 00:31:17.449 20:48:35 -- common/autotest_common.sh@1104 -- # fio_dif_1 00:31:17.449 20:48:35 -- target/dif.sh@86 -- # create_subsystems 0 00:31:17.449 20:48:35 -- target/dif.sh@28 -- # local sub 00:31:17.449 20:48:35 -- target/dif.sh@30 -- # for sub in "$@" 00:31:17.449 20:48:35 -- target/dif.sh@31 -- # create_subsystem 0 00:31:17.449 20:48:35 -- target/dif.sh@18 -- # local sub_id=0 00:31:17.449 20:48:35 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:17.449 20:48:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:17.449 20:48:35 -- common/autotest_common.sh@10 -- # set +x 00:31:17.449 bdev_null0 00:31:17.449 20:48:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:17.449 20:48:35 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:17.449 20:48:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:17.449 20:48:35 -- common/autotest_common.sh@10 -- # set +x 00:31:17.449 20:48:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:17.449 20:48:35 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:17.449 20:48:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:17.449 20:48:35 -- common/autotest_common.sh@10 -- # set +x 00:31:17.449 20:48:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:17.449 20:48:35 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:17.449 20:48:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:17.449 20:48:35 -- common/autotest_common.sh@10 -- # set +x 00:31:17.449 [2024-04-26 20:48:35.749060] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:17.449 20:48:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:17.449 20:48:35 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:17.449 20:48:35 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:17.449 20:48:35 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:17.449 20:48:35 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:17.449 20:48:35 -- nvmf/common.sh@520 -- # config=() 00:31:17.449 20:48:35 -- nvmf/common.sh@520 -- # local subsystem config 00:31:17.449 20:48:35 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:17.449 20:48:35 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:17.449 20:48:35 -- target/dif.sh@82 -- # gen_fio_conf 00:31:17.450 20:48:35 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:17.450 20:48:35 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:17.450 { 00:31:17.450 "params": { 00:31:17.450 "name": "Nvme$subsystem", 00:31:17.450 "trtype": "$TEST_TRANSPORT", 00:31:17.450 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:17.450 "adrfam": "ipv4", 00:31:17.450 "trsvcid": "$NVMF_PORT", 00:31:17.450 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:17.450 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:17.450 "hdgst": ${hdgst:-false}, 00:31:17.450 "ddgst": ${ddgst:-false} 00:31:17.450 }, 00:31:17.450 "method": "bdev_nvme_attach_controller" 00:31:17.450 } 00:31:17.450 EOF 00:31:17.450 )") 00:31:17.450 20:48:35 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:17.450 20:48:35 -- target/dif.sh@54 -- # local file 00:31:17.450 20:48:35 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:17.450 20:48:35 -- target/dif.sh@56 -- # cat 00:31:17.450 20:48:35 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:17.450 20:48:35 -- common/autotest_common.sh@1320 -- # shift 00:31:17.450 20:48:35 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:17.450 20:48:35 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:17.450 20:48:35 -- nvmf/common.sh@542 -- # cat 00:31:17.450 20:48:35 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:17.450 20:48:35 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:17.450 20:48:35 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:17.450 20:48:35 -- target/dif.sh@72 -- # (( file <= files )) 00:31:17.450 20:48:35 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:17.450 20:48:35 -- nvmf/common.sh@544 -- # jq . 00:31:17.450 20:48:35 -- nvmf/common.sh@545 -- # IFS=, 00:31:17.450 20:48:35 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:17.450 "params": { 00:31:17.450 "name": "Nvme0", 00:31:17.450 "trtype": "tcp", 00:31:17.450 "traddr": "10.0.0.2", 00:31:17.450 "adrfam": "ipv4", 00:31:17.450 "trsvcid": "4420", 00:31:17.450 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:17.450 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:17.450 "hdgst": false, 00:31:17.450 "ddgst": false 00:31:17.450 }, 00:31:17.450 "method": "bdev_nvme_attach_controller" 00:31:17.450 }' 00:31:17.746 20:48:35 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:17.746 20:48:35 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:17.746 20:48:35 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:17.746 20:48:35 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:17.746 20:48:35 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:17.746 20:48:35 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:17.746 20:48:35 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:17.746 20:48:35 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:17.746 20:48:35 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:17.746 20:48:35 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:18.008 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:18.008 fio-3.35 00:31:18.008 Starting 1 thread 00:31:18.008 EAL: No free 2048 kB hugepages reported on node 1 00:31:18.576 [2024-04-26 20:48:36.618837] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:18.576 [2024-04-26 20:48:36.618868] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:28.550 00:31:28.550 filename0: (groupid=0, jobs=1): err= 0: pid=77013: Fri Apr 26 20:48:46 2024 00:31:28.550 read: IOPS=181, BW=726KiB/s (743kB/s)(7280KiB/10031msec) 00:31:28.550 slat (nsec): min=5331, max=31704, avg=6112.57, stdev=1355.87 00:31:28.550 clat (usec): min=1360, max=43864, avg=22029.32, stdev=20370.78 00:31:28.550 lat (usec): min=1368, max=43895, avg=22035.44, stdev=20370.78 00:31:28.550 clat percentiles (usec): 00:31:28.550 | 1.00th=[ 1500], 5.00th=[ 1582], 10.00th=[ 1598], 20.00th=[ 1614], 00:31:28.550 | 30.00th=[ 1631], 40.00th=[ 1647], 50.00th=[41681], 60.00th=[42206], 00:31:28.550 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:31:28.550 | 99.00th=[42730], 99.50th=[42730], 99.90th=[43779], 99.95th=[43779], 00:31:28.550 | 99.99th=[43779] 00:31:28.550 bw ( KiB/s): min= 702, max= 768, per=100.00%, avg=726.30, stdev=29.63, samples=20 00:31:28.550 iops : min= 175, max= 192, avg=181.55, stdev= 7.43, samples=20 00:31:28.550 lat (msec) : 2=49.89%, 50=50.11% 00:31:28.550 cpu : usr=96.07%, sys=3.74%, ctx=10, majf=0, minf=228 00:31:28.550 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:28.550 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:28.550 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:28.550 issued rwts: total=1820,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:28.550 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:28.550 00:31:28.550 Run status group 0 (all jobs): 00:31:28.550 READ: bw=726KiB/s (743kB/s), 726KiB/s-726KiB/s (743kB/s-743kB/s), io=7280KiB (7455kB), run=10031-10031msec 00:31:28.550 20:48:46 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:28.550 20:48:46 -- target/dif.sh@43 -- # local sub 00:31:28.550 20:48:46 -- target/dif.sh@45 -- # for sub in "$@" 00:31:28.550 20:48:46 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:28.550 20:48:46 -- target/dif.sh@36 -- # local sub_id=0 00:31:28.550 20:48:46 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:28.550 20:48:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:28.550 20:48:46 -- common/autotest_common.sh@10 -- # set +x 00:31:28.550 20:48:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:28.550 20:48:46 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:28.550 20:48:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:28.550 20:48:46 -- common/autotest_common.sh@10 -- # set +x 00:31:28.810 20:48:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:28.810 00:31:28.810 real 0m11.195s 00:31:28.810 user 0m24.496s 00:31:28.810 sys 0m0.633s 00:31:28.810 20:48:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:28.810 20:48:46 -- common/autotest_common.sh@10 -- # set +x 00:31:28.810 ************************************ 00:31:28.810 END TEST fio_dif_1_default 00:31:28.810 ************************************ 00:31:28.810 20:48:46 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:28.810 20:48:46 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:28.810 20:48:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:28.810 20:48:46 -- common/autotest_common.sh@10 -- # set +x 00:31:28.810 ************************************ 00:31:28.810 START TEST fio_dif_1_multi_subsystems 00:31:28.810 ************************************ 00:31:28.810 20:48:46 -- common/autotest_common.sh@1104 -- # fio_dif_1_multi_subsystems 00:31:28.810 20:48:46 -- target/dif.sh@92 -- # local files=1 00:31:28.810 20:48:46 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:28.810 20:48:46 -- target/dif.sh@28 -- # local sub 00:31:28.810 20:48:46 -- target/dif.sh@30 -- # for sub in "$@" 00:31:28.810 20:48:46 -- target/dif.sh@31 -- # create_subsystem 0 00:31:28.810 20:48:46 -- target/dif.sh@18 -- # local sub_id=0 00:31:28.810 20:48:46 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:28.810 20:48:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:28.810 20:48:46 -- common/autotest_common.sh@10 -- # set +x 00:31:28.810 bdev_null0 00:31:28.810 20:48:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:28.810 20:48:46 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:28.810 20:48:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:28.810 20:48:46 -- common/autotest_common.sh@10 -- # set +x 00:31:28.810 20:48:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:28.810 20:48:46 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:28.810 20:48:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:28.810 20:48:46 -- common/autotest_common.sh@10 -- # set +x 00:31:28.810 20:48:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:28.810 20:48:46 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:28.810 20:48:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:28.810 20:48:46 -- common/autotest_common.sh@10 -- # set +x 00:31:28.810 [2024-04-26 20:48:46.991371] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:28.810 20:48:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:28.810 20:48:46 -- target/dif.sh@30 -- # for sub in "$@" 00:31:28.810 20:48:46 -- target/dif.sh@31 -- # create_subsystem 1 00:31:28.810 20:48:46 -- target/dif.sh@18 -- # local sub_id=1 00:31:28.810 20:48:46 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:28.810 20:48:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:28.810 20:48:46 -- common/autotest_common.sh@10 -- # set +x 00:31:28.810 bdev_null1 00:31:28.810 20:48:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:28.810 20:48:47 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:28.810 20:48:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:28.810 20:48:47 -- common/autotest_common.sh@10 -- # set +x 00:31:28.810 20:48:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:28.810 20:48:47 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:28.810 20:48:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:28.810 20:48:47 -- common/autotest_common.sh@10 -- # set +x 00:31:28.810 20:48:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:28.810 20:48:47 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:28.810 20:48:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:28.810 20:48:47 -- common/autotest_common.sh@10 -- # set +x 00:31:28.810 20:48:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:28.810 20:48:47 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:28.810 20:48:47 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:28.810 20:48:47 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:28.810 20:48:47 -- nvmf/common.sh@520 -- # config=() 00:31:28.810 20:48:47 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:28.810 20:48:47 -- nvmf/common.sh@520 -- # local subsystem config 00:31:28.810 20:48:47 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:28.810 20:48:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:28.811 20:48:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:28.811 { 00:31:28.811 "params": { 00:31:28.811 "name": "Nvme$subsystem", 00:31:28.811 "trtype": "$TEST_TRANSPORT", 00:31:28.811 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:28.811 "adrfam": "ipv4", 00:31:28.811 "trsvcid": "$NVMF_PORT", 00:31:28.811 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:28.811 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:28.811 "hdgst": ${hdgst:-false}, 00:31:28.811 "ddgst": ${ddgst:-false} 00:31:28.811 }, 00:31:28.811 "method": "bdev_nvme_attach_controller" 00:31:28.811 } 00:31:28.811 EOF 00:31:28.811 )") 00:31:28.811 20:48:47 -- target/dif.sh@82 -- # gen_fio_conf 00:31:28.811 20:48:47 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:28.811 20:48:47 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:28.811 20:48:47 -- target/dif.sh@54 -- # local file 00:31:28.811 20:48:47 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:28.811 20:48:47 -- target/dif.sh@56 -- # cat 00:31:28.811 20:48:47 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:28.811 20:48:47 -- common/autotest_common.sh@1320 -- # shift 00:31:28.811 20:48:47 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:28.811 20:48:47 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:28.811 20:48:47 -- nvmf/common.sh@542 -- # cat 00:31:28.811 20:48:47 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:28.811 20:48:47 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:28.811 20:48:47 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:28.811 20:48:47 -- target/dif.sh@72 -- # (( file <= files )) 00:31:28.811 20:48:47 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:28.811 20:48:47 -- target/dif.sh@73 -- # cat 00:31:28.811 20:48:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:28.811 20:48:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:28.811 { 00:31:28.811 "params": { 00:31:28.811 "name": "Nvme$subsystem", 00:31:28.811 "trtype": "$TEST_TRANSPORT", 00:31:28.811 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:28.811 "adrfam": "ipv4", 00:31:28.811 "trsvcid": "$NVMF_PORT", 00:31:28.811 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:28.811 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:28.811 "hdgst": ${hdgst:-false}, 00:31:28.811 "ddgst": ${ddgst:-false} 00:31:28.811 }, 00:31:28.811 "method": "bdev_nvme_attach_controller" 00:31:28.811 } 00:31:28.811 EOF 00:31:28.811 )") 00:31:28.811 20:48:47 -- target/dif.sh@72 -- # (( file++ )) 00:31:28.811 20:48:47 -- target/dif.sh@72 -- # (( file <= files )) 00:31:28.811 20:48:47 -- nvmf/common.sh@542 -- # cat 00:31:28.811 20:48:47 -- nvmf/common.sh@544 -- # jq . 00:31:28.811 20:48:47 -- nvmf/common.sh@545 -- # IFS=, 00:31:28.811 20:48:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:28.811 "params": { 00:31:28.811 "name": "Nvme0", 00:31:28.811 "trtype": "tcp", 00:31:28.811 "traddr": "10.0.0.2", 00:31:28.811 "adrfam": "ipv4", 00:31:28.811 "trsvcid": "4420", 00:31:28.811 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:28.811 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:28.811 "hdgst": false, 00:31:28.811 "ddgst": false 00:31:28.811 }, 00:31:28.811 "method": "bdev_nvme_attach_controller" 00:31:28.811 },{ 00:31:28.811 "params": { 00:31:28.811 "name": "Nvme1", 00:31:28.811 "trtype": "tcp", 00:31:28.811 "traddr": "10.0.0.2", 00:31:28.811 "adrfam": "ipv4", 00:31:28.811 "trsvcid": "4420", 00:31:28.811 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:28.811 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:28.811 "hdgst": false, 00:31:28.811 "ddgst": false 00:31:28.811 }, 00:31:28.811 "method": "bdev_nvme_attach_controller" 00:31:28.811 }' 00:31:28.811 20:48:47 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:28.811 20:48:47 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:28.811 20:48:47 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:28.811 20:48:47 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:28.811 20:48:47 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:28.811 20:48:47 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:28.811 20:48:47 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:28.811 20:48:47 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:28.811 20:48:47 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:28.811 20:48:47 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:29.390 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:29.390 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:29.390 fio-3.35 00:31:29.390 Starting 2 threads 00:31:29.390 EAL: No free 2048 kB hugepages reported on node 1 00:31:29.962 [2024-04-26 20:48:48.196947] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:29.962 [2024-04-26 20:48:48.196992] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:42.233 00:31:42.233 filename0: (groupid=0, jobs=1): err= 0: pid=79532: Fri Apr 26 20:48:58 2024 00:31:42.233 read: IOPS=181, BW=726KiB/s (743kB/s)(7280KiB/10033msec) 00:31:42.233 slat (nsec): min=5339, max=33709, avg=6094.25, stdev=1263.82 00:31:42.233 clat (usec): min=1480, max=44175, avg=22032.09, stdev=20338.77 00:31:42.233 lat (usec): min=1485, max=44209, avg=22038.19, stdev=20338.78 00:31:42.233 clat percentiles (usec): 00:31:42.233 | 1.00th=[ 1500], 5.00th=[ 1549], 10.00th=[ 1614], 20.00th=[ 1647], 00:31:42.233 | 30.00th=[ 1680], 40.00th=[ 1696], 50.00th=[42206], 60.00th=[42206], 00:31:42.233 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:31:42.233 | 99.00th=[42730], 99.50th=[42730], 99.90th=[44303], 99.95th=[44303], 00:31:42.233 | 99.99th=[44303] 00:31:42.233 bw ( KiB/s): min= 704, max= 768, per=50.03%, avg=726.40, stdev=31.32, samples=20 00:31:42.233 iops : min= 176, max= 192, avg=181.60, stdev= 7.83, samples=20 00:31:42.233 lat (msec) : 2=49.89%, 50=50.11% 00:31:42.233 cpu : usr=97.60%, sys=2.19%, ctx=10, majf=0, minf=88 00:31:42.233 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:42.233 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:42.233 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:42.233 issued rwts: total=1820,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:42.233 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:42.233 filename1: (groupid=0, jobs=1): err= 0: pid=79533: Fri Apr 26 20:48:58 2024 00:31:42.233 read: IOPS=181, BW=726KiB/s (743kB/s)(7280KiB/10032msec) 00:31:42.233 slat (nsec): min=5343, max=50627, avg=6138.78, stdev=1648.15 00:31:42.233 clat (usec): min=1519, max=43177, avg=22029.82, stdev=20278.53 00:31:42.233 lat (usec): min=1527, max=43212, avg=22035.95, stdev=20278.51 00:31:42.233 clat percentiles (usec): 00:31:42.233 | 1.00th=[ 1631], 5.00th=[ 1663], 10.00th=[ 1680], 20.00th=[ 1696], 00:31:42.233 | 30.00th=[ 1713], 40.00th=[ 1745], 50.00th=[42206], 60.00th=[42206], 00:31:42.233 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:31:42.233 | 99.00th=[42206], 99.50th=[42206], 99.90th=[43254], 99.95th=[43254], 00:31:42.233 | 99.99th=[43254] 00:31:42.233 bw ( KiB/s): min= 704, max= 768, per=50.03%, avg=726.40, stdev=29.55, samples=20 00:31:42.233 iops : min= 176, max= 192, avg=181.60, stdev= 7.39, samples=20 00:31:42.233 lat (msec) : 2=49.89%, 50=50.11% 00:31:42.234 cpu : usr=97.54%, sys=2.25%, ctx=9, majf=0, minf=196 00:31:42.234 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:42.234 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:42.234 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:42.234 issued rwts: total=1820,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:42.234 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:42.234 00:31:42.234 Run status group 0 (all jobs): 00:31:42.234 READ: bw=1451KiB/s (1486kB/s), 726KiB/s-726KiB/s (743kB/s-743kB/s), io=14.2MiB (14.9MB), run=10032-10033msec 00:31:42.234 20:48:58 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:42.234 20:48:58 -- target/dif.sh@43 -- # local sub 00:31:42.234 20:48:58 -- target/dif.sh@45 -- # for sub in "$@" 00:31:42.234 20:48:58 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:42.234 20:48:58 -- target/dif.sh@36 -- # local sub_id=0 00:31:42.234 20:48:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:42.234 20:48:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:42.234 20:48:58 -- common/autotest_common.sh@10 -- # set +x 00:31:42.234 20:48:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:42.234 20:48:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:42.234 20:48:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:42.234 20:48:58 -- common/autotest_common.sh@10 -- # set +x 00:31:42.234 20:48:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:42.234 20:48:58 -- target/dif.sh@45 -- # for sub in "$@" 00:31:42.234 20:48:58 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:42.234 20:48:58 -- target/dif.sh@36 -- # local sub_id=1 00:31:42.234 20:48:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:42.234 20:48:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:42.234 20:48:58 -- common/autotest_common.sh@10 -- # set +x 00:31:42.234 20:48:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:42.234 20:48:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:42.234 20:48:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:42.234 20:48:58 -- common/autotest_common.sh@10 -- # set +x 00:31:42.234 20:48:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:42.234 00:31:42.234 real 0m11.585s 00:31:42.234 user 0m34.841s 00:31:42.234 sys 0m0.795s 00:31:42.234 20:48:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:42.234 20:48:58 -- common/autotest_common.sh@10 -- # set +x 00:31:42.234 ************************************ 00:31:42.234 END TEST fio_dif_1_multi_subsystems 00:31:42.234 ************************************ 00:31:42.234 20:48:58 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:42.234 20:48:58 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:42.234 20:48:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:42.234 20:48:58 -- common/autotest_common.sh@10 -- # set +x 00:31:42.234 ************************************ 00:31:42.234 START TEST fio_dif_rand_params 00:31:42.234 ************************************ 00:31:42.234 20:48:58 -- common/autotest_common.sh@1104 -- # fio_dif_rand_params 00:31:42.234 20:48:58 -- target/dif.sh@100 -- # local NULL_DIF 00:31:42.234 20:48:58 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:42.234 20:48:58 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:42.234 20:48:58 -- target/dif.sh@103 -- # bs=128k 00:31:42.234 20:48:58 -- target/dif.sh@103 -- # numjobs=3 00:31:42.234 20:48:58 -- target/dif.sh@103 -- # iodepth=3 00:31:42.234 20:48:58 -- target/dif.sh@103 -- # runtime=5 00:31:42.234 20:48:58 -- target/dif.sh@105 -- # create_subsystems 0 00:31:42.234 20:48:58 -- target/dif.sh@28 -- # local sub 00:31:42.234 20:48:58 -- target/dif.sh@30 -- # for sub in "$@" 00:31:42.234 20:48:58 -- target/dif.sh@31 -- # create_subsystem 0 00:31:42.234 20:48:58 -- target/dif.sh@18 -- # local sub_id=0 00:31:42.234 20:48:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:42.234 20:48:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:42.234 20:48:58 -- common/autotest_common.sh@10 -- # set +x 00:31:42.234 bdev_null0 00:31:42.234 20:48:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:42.234 20:48:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:42.234 20:48:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:42.234 20:48:58 -- common/autotest_common.sh@10 -- # set +x 00:31:42.234 20:48:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:42.234 20:48:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:42.234 20:48:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:42.234 20:48:58 -- common/autotest_common.sh@10 -- # set +x 00:31:42.234 20:48:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:42.234 20:48:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:42.234 20:48:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:42.234 20:48:58 -- common/autotest_common.sh@10 -- # set +x 00:31:42.234 [2024-04-26 20:48:58.624356] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:42.234 20:48:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:42.234 20:48:58 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:42.234 20:48:58 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:42.234 20:48:58 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:42.234 20:48:58 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:42.234 20:48:58 -- nvmf/common.sh@520 -- # config=() 00:31:42.234 20:48:58 -- nvmf/common.sh@520 -- # local subsystem config 00:31:42.234 20:48:58 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:42.234 20:48:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:42.234 20:48:58 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:42.234 20:48:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:42.234 { 00:31:42.234 "params": { 00:31:42.234 "name": "Nvme$subsystem", 00:31:42.234 "trtype": "$TEST_TRANSPORT", 00:31:42.234 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:42.234 "adrfam": "ipv4", 00:31:42.234 "trsvcid": "$NVMF_PORT", 00:31:42.234 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:42.234 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:42.234 "hdgst": ${hdgst:-false}, 00:31:42.234 "ddgst": ${ddgst:-false} 00:31:42.234 }, 00:31:42.234 "method": "bdev_nvme_attach_controller" 00:31:42.234 } 00:31:42.234 EOF 00:31:42.234 )") 00:31:42.234 20:48:58 -- target/dif.sh@82 -- # gen_fio_conf 00:31:42.234 20:48:58 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:42.234 20:48:58 -- target/dif.sh@54 -- # local file 00:31:42.234 20:48:58 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:42.234 20:48:58 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:42.234 20:48:58 -- target/dif.sh@56 -- # cat 00:31:42.234 20:48:58 -- common/autotest_common.sh@1320 -- # shift 00:31:42.234 20:48:58 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:42.234 20:48:58 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:42.234 20:48:58 -- nvmf/common.sh@542 -- # cat 00:31:42.234 20:48:58 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:42.234 20:48:58 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:42.234 20:48:58 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:42.234 20:48:58 -- target/dif.sh@72 -- # (( file <= files )) 00:31:42.234 20:48:58 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:42.234 20:48:58 -- nvmf/common.sh@544 -- # jq . 00:31:42.234 20:48:58 -- nvmf/common.sh@545 -- # IFS=, 00:31:42.234 20:48:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:42.234 "params": { 00:31:42.234 "name": "Nvme0", 00:31:42.234 "trtype": "tcp", 00:31:42.234 "traddr": "10.0.0.2", 00:31:42.234 "adrfam": "ipv4", 00:31:42.234 "trsvcid": "4420", 00:31:42.234 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:42.234 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:42.234 "hdgst": false, 00:31:42.234 "ddgst": false 00:31:42.234 }, 00:31:42.234 "method": "bdev_nvme_attach_controller" 00:31:42.234 }' 00:31:42.234 20:48:58 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:42.234 20:48:58 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:42.234 20:48:58 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:42.234 20:48:58 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:42.234 20:48:58 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:42.234 20:48:58 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:42.234 20:48:58 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:42.234 20:48:58 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:42.234 20:48:58 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:42.234 20:48:58 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:42.234 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:42.234 ... 00:31:42.234 fio-3.35 00:31:42.234 Starting 3 threads 00:31:42.234 EAL: No free 2048 kB hugepages reported on node 1 00:31:42.234 [2024-04-26 20:48:59.383985] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:42.235 [2024-04-26 20:48:59.384024] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:46.435 00:31:46.435 filename0: (groupid=0, jobs=1): err= 0: pid=81757: Fri Apr 26 20:49:04 2024 00:31:46.435 read: IOPS=98, BW=12.4MiB/s (13.0MB/s)(61.9MiB/5004msec) 00:31:46.435 slat (nsec): min=5334, max=31231, avg=7411.53, stdev=1856.10 00:31:46.435 clat (usec): min=7100, max=99246, avg=30309.02, stdev=22675.57 00:31:46.435 lat (usec): min=7106, max=99254, avg=30316.43, stdev=22675.63 00:31:46.435 clat percentiles (usec): 00:31:46.435 | 1.00th=[ 7963], 5.00th=[ 9110], 10.00th=[10159], 20.00th=[11338], 00:31:46.435 | 30.00th=[12256], 40.00th=[13173], 50.00th=[14484], 60.00th=[50594], 00:31:46.435 | 70.00th=[53216], 80.00th=[54264], 90.00th=[55837], 95.00th=[56886], 00:31:46.435 | 99.00th=[95945], 99.50th=[96994], 99.90th=[99091], 99.95th=[99091], 00:31:46.435 | 99.99th=[99091] 00:31:46.435 bw ( KiB/s): min= 9216, max=18176, per=23.50%, avg=12999.11, stdev=2738.65, samples=9 00:31:46.435 iops : min= 72, max= 142, avg=101.56, stdev=21.40, samples=9 00:31:46.435 lat (msec) : 10=8.89%, 20=50.30%, 50=0.20%, 100=40.61% 00:31:46.435 cpu : usr=97.26%, sys=2.46%, ctx=11, majf=0, minf=132 00:31:46.435 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:46.435 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.435 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.435 issued rwts: total=495,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.435 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:46.435 filename0: (groupid=0, jobs=1): err= 0: pid=81758: Fri Apr 26 20:49:04 2024 00:31:46.435 read: IOPS=211, BW=26.5MiB/s (27.8MB/s)(134MiB/5047msec) 00:31:46.435 slat (nsec): min=5344, max=30221, avg=7362.10, stdev=1609.20 00:31:46.435 clat (usec): min=5994, max=93481, avg=14115.32, stdev=14572.01 00:31:46.435 lat (usec): min=5999, max=93488, avg=14122.69, stdev=14572.15 00:31:46.435 clat percentiles (usec): 00:31:46.435 | 1.00th=[ 6652], 5.00th=[ 7046], 10.00th=[ 7308], 20.00th=[ 7635], 00:31:46.435 | 30.00th=[ 7963], 40.00th=[ 8356], 50.00th=[ 8848], 60.00th=[ 9372], 00:31:46.435 | 70.00th=[10028], 80.00th=[11076], 90.00th=[48497], 95.00th=[49021], 00:31:46.435 | 99.00th=[52691], 99.50th=[89654], 99.90th=[93848], 99.95th=[93848], 00:31:46.435 | 99.99th=[93848] 00:31:46.435 bw ( KiB/s): min=10752, max=41472, per=49.34%, avg=27289.60, stdev=9227.21, samples=10 00:31:46.435 iops : min= 84, max= 324, avg=213.20, stdev=72.09, samples=10 00:31:46.435 lat (msec) : 10=68.57%, 20=19.08%, 50=10.29%, 100=2.06% 00:31:46.435 cpu : usr=97.17%, sys=2.58%, ctx=18, majf=0, minf=63 00:31:46.435 IO depths : 1=0.7%, 2=99.3%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:46.435 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.435 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.435 issued rwts: total=1069,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.435 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:46.435 filename0: (groupid=0, jobs=1): err= 0: pid=81759: Fri Apr 26 20:49:04 2024 00:31:46.435 read: IOPS=122, BW=15.3MiB/s (16.0MB/s)(77.1MiB/5045msec) 00:31:46.435 slat (nsec): min=5337, max=29909, avg=6009.04, stdev=1303.96 00:31:46.435 clat (usec): min=6428, max=96364, avg=24452.36, stdev=20421.41 00:31:46.435 lat (usec): min=6434, max=96370, avg=24458.37, stdev=20421.52 00:31:46.435 clat percentiles (usec): 00:31:46.435 | 1.00th=[ 6915], 5.00th=[ 7898], 10.00th=[ 8848], 20.00th=[ 9896], 00:31:46.435 | 30.00th=[10814], 40.00th=[11994], 50.00th=[12780], 60.00th=[13698], 00:31:46.435 | 70.00th=[50070], 80.00th=[53216], 90.00th=[54264], 95.00th=[55313], 00:31:46.435 | 99.00th=[60556], 99.50th=[94897], 99.90th=[95945], 99.95th=[95945], 00:31:46.435 | 99.99th=[95945] 00:31:46.435 bw ( KiB/s): min=10752, max=25856, per=28.46%, avg=15744.00, stdev=5263.41, samples=10 00:31:46.435 iops : min= 84, max= 202, avg=123.00, stdev=41.12, samples=10 00:31:46.435 lat (msec) : 10=21.56%, 20=48.30%, 50=0.16%, 100=29.98% 00:31:46.435 cpu : usr=96.77%, sys=2.93%, ctx=6, majf=0, minf=84 00:31:46.435 IO depths : 1=3.4%, 2=96.6%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:46.435 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.435 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.435 issued rwts: total=617,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.435 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:46.435 00:31:46.435 Run status group 0 (all jobs): 00:31:46.435 READ: bw=54.0MiB/s (56.6MB/s), 12.4MiB/s-26.5MiB/s (13.0MB/s-27.8MB/s), io=273MiB (286MB), run=5004-5047msec 00:31:46.435 20:49:04 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:46.435 20:49:04 -- target/dif.sh@43 -- # local sub 00:31:46.435 20:49:04 -- target/dif.sh@45 -- # for sub in "$@" 00:31:46.435 20:49:04 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:46.435 20:49:04 -- target/dif.sh@36 -- # local sub_id=0 00:31:46.435 20:49:04 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:46.435 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.435 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.435 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.435 20:49:04 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:46.435 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.435 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.435 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.436 20:49:04 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:46.436 20:49:04 -- target/dif.sh@109 -- # bs=4k 00:31:46.436 20:49:04 -- target/dif.sh@109 -- # numjobs=8 00:31:46.436 20:49:04 -- target/dif.sh@109 -- # iodepth=16 00:31:46.436 20:49:04 -- target/dif.sh@109 -- # runtime= 00:31:46.436 20:49:04 -- target/dif.sh@109 -- # files=2 00:31:46.436 20:49:04 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:46.436 20:49:04 -- target/dif.sh@28 -- # local sub 00:31:46.436 20:49:04 -- target/dif.sh@30 -- # for sub in "$@" 00:31:46.436 20:49:04 -- target/dif.sh@31 -- # create_subsystem 0 00:31:46.436 20:49:04 -- target/dif.sh@18 -- # local sub_id=0 00:31:46.436 20:49:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:46.436 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.436 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.436 bdev_null0 00:31:46.436 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.436 20:49:04 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:46.436 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.436 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.436 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.436 20:49:04 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:46.436 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.436 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.436 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.436 20:49:04 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:46.436 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.436 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.436 [2024-04-26 20:49:04.727692] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:46.436 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.436 20:49:04 -- target/dif.sh@30 -- # for sub in "$@" 00:31:46.436 20:49:04 -- target/dif.sh@31 -- # create_subsystem 1 00:31:46.436 20:49:04 -- target/dif.sh@18 -- # local sub_id=1 00:31:46.436 20:49:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:46.436 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.436 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.436 bdev_null1 00:31:46.436 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.436 20:49:04 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:46.436 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.436 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.436 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.436 20:49:04 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:46.436 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.436 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.436 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.436 20:49:04 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:46.436 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.436 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.698 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.698 20:49:04 -- target/dif.sh@30 -- # for sub in "$@" 00:31:46.698 20:49:04 -- target/dif.sh@31 -- # create_subsystem 2 00:31:46.698 20:49:04 -- target/dif.sh@18 -- # local sub_id=2 00:31:46.698 20:49:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:46.698 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.698 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.698 bdev_null2 00:31:46.698 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.698 20:49:04 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:46.698 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.698 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.698 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.698 20:49:04 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:46.698 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.698 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.698 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.698 20:49:04 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:46.698 20:49:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:46.698 20:49:04 -- common/autotest_common.sh@10 -- # set +x 00:31:46.698 20:49:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:46.698 20:49:04 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:46.698 20:49:04 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:46.698 20:49:04 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:46.698 20:49:04 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:46.698 20:49:04 -- nvmf/common.sh@520 -- # config=() 00:31:46.698 20:49:04 -- nvmf/common.sh@520 -- # local subsystem config 00:31:46.698 20:49:04 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:46.698 20:49:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:46.698 20:49:04 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:46.698 20:49:04 -- target/dif.sh@82 -- # gen_fio_conf 00:31:46.698 20:49:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:46.698 { 00:31:46.698 "params": { 00:31:46.698 "name": "Nvme$subsystem", 00:31:46.698 "trtype": "$TEST_TRANSPORT", 00:31:46.698 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:46.698 "adrfam": "ipv4", 00:31:46.698 "trsvcid": "$NVMF_PORT", 00:31:46.698 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:46.698 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:46.698 "hdgst": ${hdgst:-false}, 00:31:46.698 "ddgst": ${ddgst:-false} 00:31:46.698 }, 00:31:46.698 "method": "bdev_nvme_attach_controller" 00:31:46.698 } 00:31:46.698 EOF 00:31:46.698 )") 00:31:46.698 20:49:04 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:46.698 20:49:04 -- target/dif.sh@54 -- # local file 00:31:46.698 20:49:04 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:46.698 20:49:04 -- target/dif.sh@56 -- # cat 00:31:46.698 20:49:04 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:46.698 20:49:04 -- common/autotest_common.sh@1320 -- # shift 00:31:46.698 20:49:04 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:46.698 20:49:04 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:46.698 20:49:04 -- nvmf/common.sh@542 -- # cat 00:31:46.698 20:49:04 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:46.698 20:49:04 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:46.698 20:49:04 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:46.698 20:49:04 -- target/dif.sh@72 -- # (( file <= files )) 00:31:46.698 20:49:04 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:46.698 20:49:04 -- target/dif.sh@73 -- # cat 00:31:46.698 20:49:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:46.698 20:49:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:46.698 { 00:31:46.698 "params": { 00:31:46.698 "name": "Nvme$subsystem", 00:31:46.698 "trtype": "$TEST_TRANSPORT", 00:31:46.698 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:46.698 "adrfam": "ipv4", 00:31:46.698 "trsvcid": "$NVMF_PORT", 00:31:46.698 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:46.698 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:46.698 "hdgst": ${hdgst:-false}, 00:31:46.698 "ddgst": ${ddgst:-false} 00:31:46.698 }, 00:31:46.698 "method": "bdev_nvme_attach_controller" 00:31:46.698 } 00:31:46.698 EOF 00:31:46.698 )") 00:31:46.698 20:49:04 -- target/dif.sh@72 -- # (( file++ )) 00:31:46.698 20:49:04 -- target/dif.sh@72 -- # (( file <= files )) 00:31:46.698 20:49:04 -- nvmf/common.sh@542 -- # cat 00:31:46.698 20:49:04 -- target/dif.sh@73 -- # cat 00:31:46.698 20:49:04 -- target/dif.sh@72 -- # (( file++ )) 00:31:46.698 20:49:04 -- target/dif.sh@72 -- # (( file <= files )) 00:31:46.698 20:49:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:46.698 20:49:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:46.698 { 00:31:46.698 "params": { 00:31:46.698 "name": "Nvme$subsystem", 00:31:46.698 "trtype": "$TEST_TRANSPORT", 00:31:46.698 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:46.698 "adrfam": "ipv4", 00:31:46.698 "trsvcid": "$NVMF_PORT", 00:31:46.698 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:46.698 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:46.698 "hdgst": ${hdgst:-false}, 00:31:46.698 "ddgst": ${ddgst:-false} 00:31:46.698 }, 00:31:46.698 "method": "bdev_nvme_attach_controller" 00:31:46.698 } 00:31:46.698 EOF 00:31:46.698 )") 00:31:46.698 20:49:04 -- nvmf/common.sh@542 -- # cat 00:31:46.698 20:49:04 -- nvmf/common.sh@544 -- # jq . 00:31:46.698 20:49:04 -- nvmf/common.sh@545 -- # IFS=, 00:31:46.698 20:49:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:46.698 "params": { 00:31:46.698 "name": "Nvme0", 00:31:46.698 "trtype": "tcp", 00:31:46.698 "traddr": "10.0.0.2", 00:31:46.698 "adrfam": "ipv4", 00:31:46.698 "trsvcid": "4420", 00:31:46.698 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:46.698 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:46.698 "hdgst": false, 00:31:46.698 "ddgst": false 00:31:46.698 }, 00:31:46.698 "method": "bdev_nvme_attach_controller" 00:31:46.698 },{ 00:31:46.698 "params": { 00:31:46.698 "name": "Nvme1", 00:31:46.698 "trtype": "tcp", 00:31:46.698 "traddr": "10.0.0.2", 00:31:46.698 "adrfam": "ipv4", 00:31:46.698 "trsvcid": "4420", 00:31:46.698 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:46.698 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:46.698 "hdgst": false, 00:31:46.698 "ddgst": false 00:31:46.698 }, 00:31:46.698 "method": "bdev_nvme_attach_controller" 00:31:46.698 },{ 00:31:46.698 "params": { 00:31:46.698 "name": "Nvme2", 00:31:46.698 "trtype": "tcp", 00:31:46.698 "traddr": "10.0.0.2", 00:31:46.698 "adrfam": "ipv4", 00:31:46.698 "trsvcid": "4420", 00:31:46.698 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:46.698 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:46.698 "hdgst": false, 00:31:46.698 "ddgst": false 00:31:46.699 }, 00:31:46.699 "method": "bdev_nvme_attach_controller" 00:31:46.699 }' 00:31:46.699 20:49:04 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:46.699 20:49:04 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:46.699 20:49:04 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:46.699 20:49:04 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:46.699 20:49:04 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:46.699 20:49:04 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:46.699 20:49:04 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:46.699 20:49:04 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:46.699 20:49:04 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:46.699 20:49:04 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:46.959 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:46.959 ... 00:31:46.959 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:46.959 ... 00:31:46.959 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:46.959 ... 00:31:46.959 fio-3.35 00:31:46.959 Starting 24 threads 00:31:46.959 EAL: No free 2048 kB hugepages reported on node 1 00:31:47.899 [2024-04-26 20:49:06.099966] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:47.900 [2024-04-26 20:49:06.100005] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:00.135 00:32:00.135 filename0: (groupid=0, jobs=1): err= 0: pid=83281: Fri Apr 26 20:49:16 2024 00:32:00.135 read: IOPS=538, BW=2152KiB/s (2204kB/s)(21.0MiB/10013msec) 00:32:00.135 slat (usec): min=5, max=115, avg=22.56, stdev=18.37 00:32:00.135 clat (usec): min=12087, max=52738, avg=29538.35, stdev=2994.08 00:32:00.135 lat (usec): min=12096, max=52769, avg=29560.91, stdev=2994.60 00:32:00.135 clat percentiles (usec): 00:32:00.135 | 1.00th=[19792], 5.00th=[24249], 10.00th=[28181], 20.00th=[28967], 00:32:00.135 | 30.00th=[29230], 40.00th=[29492], 50.00th=[29754], 60.00th=[30016], 00:32:00.135 | 70.00th=[30278], 80.00th=[30278], 90.00th=[30540], 95.00th=[31065], 00:32:00.135 | 99.00th=[40109], 99.50th=[47449], 99.90th=[52691], 99.95th=[52691], 00:32:00.135 | 99.99th=[52691] 00:32:00.135 bw ( KiB/s): min= 2043, max= 2304, per=4.27%, avg=2148.30, stdev=76.40, samples=20 00:32:00.135 iops : min= 510, max= 576, avg=537.00, stdev=19.14, samples=20 00:32:00.135 lat (msec) : 20=1.35%, 50=98.35%, 100=0.30% 00:32:00.135 cpu : usr=99.08%, sys=0.59%, ctx=20, majf=0, minf=63 00:32:00.135 IO depths : 1=4.8%, 2=10.2%, 4=22.5%, 8=54.4%, 16=8.1%, 32=0.0%, >=64=0.0% 00:32:00.135 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.135 complete : 0=0.0%, 4=93.8%, 8=0.7%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.135 issued rwts: total=5388,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.135 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.135 filename0: (groupid=0, jobs=1): err= 0: pid=83282: Fri Apr 26 20:49:16 2024 00:32:00.135 read: IOPS=514, BW=2057KiB/s (2106kB/s)(20.1MiB/10019msec) 00:32:00.135 slat (nsec): min=5513, max=82518, avg=15329.02, stdev=12076.03 00:32:00.135 clat (usec): min=12508, max=60263, avg=31005.82, stdev=4770.85 00:32:00.135 lat (usec): min=12517, max=60272, avg=31021.15, stdev=4770.48 00:32:00.135 clat percentiles (usec): 00:32:00.135 | 1.00th=[18482], 5.00th=[25822], 10.00th=[28443], 20.00th=[29230], 00:32:00.135 | 30.00th=[29492], 40.00th=[29754], 50.00th=[30016], 60.00th=[30278], 00:32:00.135 | 70.00th=[30540], 80.00th=[30802], 90.00th=[36963], 95.00th=[42206], 00:32:00.135 | 99.00th=[46924], 99.50th=[50070], 99.90th=[54789], 99.95th=[60031], 00:32:00.135 | 99.99th=[60031] 00:32:00.135 bw ( KiB/s): min= 1852, max= 2176, per=4.08%, avg=2053.26, stdev=85.65, samples=19 00:32:00.135 iops : min= 463, max= 544, avg=513.32, stdev=21.41, samples=19 00:32:00.135 lat (msec) : 20=1.24%, 50=98.16%, 100=0.60% 00:32:00.135 cpu : usr=98.87%, sys=0.77%, ctx=78, majf=0, minf=62 00:32:00.135 IO depths : 1=1.9%, 2=3.9%, 4=11.2%, 8=69.6%, 16=13.5%, 32=0.0%, >=64=0.0% 00:32:00.135 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.135 complete : 0=0.0%, 4=91.3%, 8=5.6%, 16=3.1%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.135 issued rwts: total=5152,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.135 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.135 filename0: (groupid=0, jobs=1): err= 0: pid=83283: Fri Apr 26 20:49:16 2024 00:32:00.135 read: IOPS=543, BW=2173KiB/s (2225kB/s)(21.2MiB/10008msec) 00:32:00.135 slat (nsec): min=5572, max=89346, avg=9267.43, stdev=6726.25 00:32:00.135 clat (usec): min=2040, max=54019, avg=29381.23, stdev=3844.19 00:32:00.135 lat (usec): min=2055, max=54028, avg=29390.49, stdev=3843.65 00:32:00.135 clat percentiles (usec): 00:32:00.135 | 1.00th=[10421], 5.00th=[26346], 10.00th=[28443], 20.00th=[28967], 00:32:00.135 | 30.00th=[29492], 40.00th=[29754], 50.00th=[30016], 60.00th=[30016], 00:32:00.135 | 70.00th=[30278], 80.00th=[30540], 90.00th=[30802], 95.00th=[31065], 00:32:00.135 | 99.00th=[36963], 99.50th=[49021], 99.90th=[53740], 99.95th=[54264], 00:32:00.135 | 99.99th=[54264] 00:32:00.135 bw ( KiB/s): min= 2048, max= 2741, per=4.32%, avg=2173.79, stdev=147.41, samples=19 00:32:00.135 iops : min= 512, max= 685, avg=543.32, stdev=36.80, samples=19 00:32:00.135 lat (msec) : 4=0.39%, 10=0.50%, 20=1.84%, 50=97.09%, 100=0.18% 00:32:00.135 cpu : usr=99.31%, sys=0.41%, ctx=29, majf=0, minf=57 00:32:00.135 IO depths : 1=5.7%, 2=11.5%, 4=23.7%, 8=52.2%, 16=7.0%, 32=0.0%, >=64=0.0% 00:32:00.136 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 complete : 0=0.0%, 4=93.9%, 8=0.4%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 issued rwts: total=5436,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.136 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.136 filename0: (groupid=0, jobs=1): err= 0: pid=83284: Fri Apr 26 20:49:16 2024 00:32:00.136 read: IOPS=520, BW=2082KiB/s (2132kB/s)(20.4MiB/10013msec) 00:32:00.136 slat (usec): min=5, max=105, avg=18.07, stdev=15.72 00:32:00.136 clat (usec): min=10265, max=59953, avg=30636.85, stdev=4532.40 00:32:00.136 lat (usec): min=10272, max=59982, avg=30654.91, stdev=4531.50 00:32:00.136 clat percentiles (usec): 00:32:00.136 | 1.00th=[17433], 5.00th=[27919], 10.00th=[28705], 20.00th=[29230], 00:32:00.136 | 30.00th=[29492], 40.00th=[29754], 50.00th=[30016], 60.00th=[30278], 00:32:00.136 | 70.00th=[30540], 80.00th=[30540], 90.00th=[32900], 95.00th=[41157], 00:32:00.136 | 99.00th=[49546], 99.50th=[51643], 99.90th=[55837], 99.95th=[59507], 00:32:00.136 | 99.99th=[60031] 00:32:00.136 bw ( KiB/s): min= 1744, max= 2176, per=4.13%, avg=2079.53, stdev=122.01, samples=19 00:32:00.136 iops : min= 436, max= 544, avg=519.84, stdev=30.47, samples=19 00:32:00.136 lat (msec) : 20=1.71%, 50=97.60%, 100=0.69% 00:32:00.136 cpu : usr=98.82%, sys=0.73%, ctx=75, majf=0, minf=64 00:32:00.136 IO depths : 1=0.4%, 2=0.8%, 4=6.9%, 8=78.4%, 16=13.6%, 32=0.0%, >=64=0.0% 00:32:00.136 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 complete : 0=0.0%, 4=89.6%, 8=6.2%, 16=4.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 issued rwts: total=5212,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.136 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.136 filename0: (groupid=0, jobs=1): err= 0: pid=83285: Fri Apr 26 20:49:16 2024 00:32:00.136 read: IOPS=524, BW=2098KiB/s (2149kB/s)(20.5MiB/10004msec) 00:32:00.136 slat (usec): min=5, max=167, avg=14.87, stdev=12.60 00:32:00.136 clat (usec): min=6305, max=50874, avg=30408.12, stdev=5166.38 00:32:00.136 lat (usec): min=6311, max=50882, avg=30422.99, stdev=5166.55 00:32:00.136 clat percentiles (usec): 00:32:00.136 | 1.00th=[13960], 5.00th=[22938], 10.00th=[27395], 20.00th=[28967], 00:32:00.136 | 30.00th=[29492], 40.00th=[29754], 50.00th=[30016], 60.00th=[30278], 00:32:00.136 | 70.00th=[30540], 80.00th=[30802], 90.00th=[35914], 95.00th=[41681], 00:32:00.136 | 99.00th=[47449], 99.50th=[48497], 99.90th=[50070], 99.95th=[50594], 00:32:00.136 | 99.99th=[51119] 00:32:00.136 bw ( KiB/s): min= 1856, max= 2200, per=4.15%, avg=2088.32, stdev=100.70, samples=19 00:32:00.136 iops : min= 464, max= 550, avg=522.00, stdev=25.21, samples=19 00:32:00.136 lat (msec) : 10=0.40%, 20=3.24%, 50=96.28%, 100=0.08% 00:32:00.136 cpu : usr=97.86%, sys=1.00%, ctx=34, majf=0, minf=113 00:32:00.136 IO depths : 1=1.0%, 2=2.9%, 4=13.2%, 8=69.2%, 16=13.6%, 32=0.0%, >=64=0.0% 00:32:00.136 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 complete : 0=0.0%, 4=92.0%, 8=4.3%, 16=3.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 issued rwts: total=5248,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.136 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.136 filename0: (groupid=0, jobs=1): err= 0: pid=83286: Fri Apr 26 20:49:16 2024 00:32:00.136 read: IOPS=536, BW=2147KiB/s (2199kB/s)(21.0MiB/10015msec) 00:32:00.136 slat (nsec): min=5644, max=74818, avg=9877.94, stdev=5644.93 00:32:00.136 clat (usec): min=12527, max=32214, avg=29717.62, stdev=1348.24 00:32:00.136 lat (usec): min=12534, max=32223, avg=29727.49, stdev=1347.74 00:32:00.136 clat percentiles (usec): 00:32:00.136 | 1.00th=[27132], 5.00th=[28181], 10.00th=[28705], 20.00th=[29230], 00:32:00.136 | 30.00th=[29492], 40.00th=[29754], 50.00th=[30016], 60.00th=[30016], 00:32:00.136 | 70.00th=[30278], 80.00th=[30540], 90.00th=[30540], 95.00th=[31065], 00:32:00.136 | 99.00th=[31589], 99.50th=[32113], 99.90th=[32113], 99.95th=[32113], 00:32:00.136 | 99.99th=[32113] 00:32:00.136 bw ( KiB/s): min= 2048, max= 2176, per=4.26%, avg=2142.05, stdev=57.76, samples=19 00:32:00.136 iops : min= 512, max= 544, avg=535.47, stdev=14.42, samples=19 00:32:00.136 lat (msec) : 20=0.30%, 50=99.70% 00:32:00.136 cpu : usr=98.99%, sys=0.58%, ctx=79, majf=0, minf=91 00:32:00.136 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:00.136 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 issued rwts: total=5376,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.136 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.136 filename0: (groupid=0, jobs=1): err= 0: pid=83287: Fri Apr 26 20:49:16 2024 00:32:00.136 read: IOPS=503, BW=2015KiB/s (2064kB/s)(19.7MiB/10010msec) 00:32:00.136 slat (nsec): min=5503, max=74233, avg=12607.70, stdev=9218.86 00:32:00.136 clat (usec): min=10315, max=59512, avg=31692.78, stdev=5845.81 00:32:00.136 lat (usec): min=10333, max=59533, avg=31705.39, stdev=5845.06 00:32:00.136 clat percentiles (usec): 00:32:00.136 | 1.00th=[17171], 5.00th=[25035], 10.00th=[28443], 20.00th=[29230], 00:32:00.136 | 30.00th=[29492], 40.00th=[30016], 50.00th=[30278], 60.00th=[30540], 00:32:00.136 | 70.00th=[30802], 80.00th=[34866], 90.00th=[39060], 95.00th=[44827], 00:32:00.136 | 99.00th=[51643], 99.50th=[54264], 99.90th=[58983], 99.95th=[59507], 00:32:00.136 | 99.99th=[59507] 00:32:00.136 bw ( KiB/s): min= 1776, max= 2128, per=3.99%, avg=2008.11, stdev=89.42, samples=19 00:32:00.136 iops : min= 444, max= 532, avg=501.95, stdev=22.30, samples=19 00:32:00.136 lat (msec) : 20=2.02%, 50=96.49%, 100=1.49% 00:32:00.136 cpu : usr=98.97%, sys=0.74%, ctx=20, majf=0, minf=51 00:32:00.136 IO depths : 1=0.2%, 2=0.4%, 4=6.1%, 8=77.6%, 16=15.7%, 32=0.0%, >=64=0.0% 00:32:00.136 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 complete : 0=0.0%, 4=90.1%, 8=7.5%, 16=2.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 issued rwts: total=5043,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.136 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.136 filename0: (groupid=0, jobs=1): err= 0: pid=83288: Fri Apr 26 20:49:16 2024 00:32:00.136 read: IOPS=531, BW=2127KiB/s (2178kB/s)(20.8MiB/10014msec) 00:32:00.136 slat (nsec): min=5547, max=93203, avg=14115.22, stdev=11047.46 00:32:00.136 clat (usec): min=10144, max=53643, avg=29991.62, stdev=2987.92 00:32:00.136 lat (usec): min=10152, max=53649, avg=30005.74, stdev=2987.50 00:32:00.136 clat percentiles (usec): 00:32:00.136 | 1.00th=[21365], 5.00th=[27395], 10.00th=[28443], 20.00th=[28967], 00:32:00.136 | 30.00th=[29492], 40.00th=[29754], 50.00th=[30016], 60.00th=[30016], 00:32:00.136 | 70.00th=[30278], 80.00th=[30540], 90.00th=[31065], 95.00th=[34341], 00:32:00.136 | 99.00th=[42206], 99.50th=[49021], 99.90th=[52167], 99.95th=[53740], 00:32:00.136 | 99.99th=[53740] 00:32:00.136 bw ( KiB/s): min= 2000, max= 2184, per=4.23%, avg=2130.26, stdev=53.64, samples=19 00:32:00.136 iops : min= 500, max= 546, avg=532.53, stdev=13.38, samples=19 00:32:00.136 lat (msec) : 20=0.84%, 50=98.85%, 100=0.30% 00:32:00.136 cpu : usr=99.14%, sys=0.54%, ctx=79, majf=0, minf=56 00:32:00.136 IO depths : 1=0.4%, 2=1.0%, 4=8.3%, 8=77.7%, 16=12.6%, 32=0.0%, >=64=0.0% 00:32:00.136 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 complete : 0=0.0%, 4=89.6%, 8=5.3%, 16=5.1%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 issued rwts: total=5326,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.136 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.136 filename1: (groupid=0, jobs=1): err= 0: pid=83289: Fri Apr 26 20:49:16 2024 00:32:00.136 read: IOPS=497, BW=1990KiB/s (2038kB/s)(19.5MiB/10014msec) 00:32:00.136 slat (usec): min=5, max=102, avg=18.07, stdev=16.35 00:32:00.136 clat (usec): min=10329, max=59619, avg=32035.30, stdev=5889.78 00:32:00.136 lat (usec): min=10336, max=59625, avg=32053.37, stdev=5888.81 00:32:00.136 clat percentiles (usec): 00:32:00.136 | 1.00th=[18482], 5.00th=[25035], 10.00th=[28443], 20.00th=[29230], 00:32:00.136 | 30.00th=[29492], 40.00th=[30016], 50.00th=[30278], 60.00th=[30540], 00:32:00.136 | 70.00th=[31065], 80.00th=[35914], 90.00th=[40633], 95.00th=[44827], 00:32:00.136 | 99.00th=[52691], 99.50th=[54264], 99.90th=[58459], 99.95th=[59507], 00:32:00.136 | 99.99th=[59507] 00:32:00.136 bw ( KiB/s): min= 1896, max= 2176, per=3.97%, avg=1996.42, stdev=77.04, samples=19 00:32:00.136 iops : min= 474, max= 544, avg=499.11, stdev=19.26, samples=19 00:32:00.136 lat (msec) : 20=1.12%, 50=97.59%, 100=1.28% 00:32:00.136 cpu : usr=99.15%, sys=0.56%, ctx=12, majf=0, minf=93 00:32:00.136 IO depths : 1=1.5%, 2=3.1%, 4=11.3%, 8=71.4%, 16=12.7%, 32=0.0%, >=64=0.0% 00:32:00.136 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 complete : 0=0.0%, 4=90.9%, 8=5.1%, 16=4.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 issued rwts: total=4982,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.136 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.136 filename1: (groupid=0, jobs=1): err= 0: pid=83290: Fri Apr 26 20:49:16 2024 00:32:00.136 read: IOPS=543, BW=2173KiB/s (2225kB/s)(21.2MiB/10005msec) 00:32:00.136 slat (nsec): min=5517, max=99717, avg=10576.68, stdev=7665.15 00:32:00.136 clat (usec): min=6635, max=68025, avg=29378.52, stdev=4260.65 00:32:00.136 lat (usec): min=6641, max=68040, avg=29389.10, stdev=4261.30 00:32:00.136 clat percentiles (usec): 00:32:00.136 | 1.00th=[15795], 5.00th=[21627], 10.00th=[26084], 20.00th=[28967], 00:32:00.136 | 30.00th=[29230], 40.00th=[29492], 50.00th=[29754], 60.00th=[30016], 00:32:00.136 | 70.00th=[30278], 80.00th=[30540], 90.00th=[30802], 95.00th=[31589], 00:32:00.136 | 99.00th=[47973], 99.50th=[49021], 99.90th=[53216], 99.95th=[53216], 00:32:00.136 | 99.99th=[67634] 00:32:00.136 bw ( KiB/s): min= 1896, max= 2395, per=4.31%, avg=2168.16, stdev=108.73, samples=19 00:32:00.136 iops : min= 474, max= 598, avg=542.00, stdev=27.10, samples=19 00:32:00.136 lat (msec) : 10=0.28%, 20=3.97%, 50=95.56%, 100=0.18% 00:32:00.136 cpu : usr=96.12%, sys=1.82%, ctx=96, majf=0, minf=81 00:32:00.136 IO depths : 1=2.9%, 2=7.1%, 4=18.3%, 8=61.0%, 16=10.7%, 32=0.0%, >=64=0.0% 00:32:00.136 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 complete : 0=0.0%, 4=92.6%, 8=2.7%, 16=4.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.136 issued rwts: total=5434,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.136 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.136 filename1: (groupid=0, jobs=1): err= 0: pid=83291: Fri Apr 26 20:49:16 2024 00:32:00.136 read: IOPS=494, BW=1979KiB/s (2027kB/s)(19.4MiB/10015msec) 00:32:00.136 slat (usec): min=5, max=100, avg=14.81, stdev=12.55 00:32:00.136 clat (usec): min=9929, max=57965, avg=32243.90, stdev=6527.15 00:32:00.136 lat (usec): min=9938, max=57975, avg=32258.71, stdev=6527.19 00:32:00.136 clat percentiles (usec): 00:32:00.136 | 1.00th=[15664], 5.00th=[23200], 10.00th=[27919], 20.00th=[29230], 00:32:00.137 | 30.00th=[29492], 40.00th=[30016], 50.00th=[30278], 60.00th=[30540], 00:32:00.137 | 70.00th=[33817], 80.00th=[36963], 90.00th=[41681], 95.00th=[46400], 00:32:00.137 | 99.00th=[50070], 99.50th=[51643], 99.90th=[56886], 99.95th=[57410], 00:32:00.137 | 99.99th=[57934] 00:32:00.137 bw ( KiB/s): min= 1744, max= 2176, per=3.93%, avg=1978.26, stdev=118.87, samples=19 00:32:00.137 iops : min= 436, max= 544, avg=494.53, stdev=29.68, samples=19 00:32:00.137 lat (msec) : 10=0.02%, 20=2.54%, 50=96.51%, 100=0.93% 00:32:00.137 cpu : usr=97.92%, sys=1.19%, ctx=54, majf=0, minf=70 00:32:00.137 IO depths : 1=1.3%, 2=2.6%, 4=10.7%, 8=72.4%, 16=13.1%, 32=0.0%, >=64=0.0% 00:32:00.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 complete : 0=0.0%, 4=90.8%, 8=5.4%, 16=3.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 issued rwts: total=4955,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.137 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.137 filename1: (groupid=0, jobs=1): err= 0: pid=83292: Fri Apr 26 20:49:16 2024 00:32:00.137 read: IOPS=534, BW=2137KiB/s (2189kB/s)(20.9MiB/10001msec) 00:32:00.137 slat (nsec): min=5579, max=59943, avg=10774.93, stdev=6834.72 00:32:00.137 clat (usec): min=23397, max=43872, avg=29845.16, stdev=1076.54 00:32:00.137 lat (usec): min=23404, max=43895, avg=29855.94, stdev=1076.73 00:32:00.137 clat percentiles (usec): 00:32:00.137 | 1.00th=[27395], 5.00th=[28443], 10.00th=[28705], 20.00th=[29230], 00:32:00.137 | 30.00th=[29492], 40.00th=[29754], 50.00th=[30016], 60.00th=[30016], 00:32:00.137 | 70.00th=[30278], 80.00th=[30540], 90.00th=[30540], 95.00th=[31065], 00:32:00.137 | 99.00th=[31851], 99.50th=[32113], 99.90th=[42206], 99.95th=[42206], 00:32:00.137 | 99.99th=[43779] 00:32:00.137 bw ( KiB/s): min= 2043, max= 2176, per=4.24%, avg=2135.53, stdev=61.23, samples=19 00:32:00.137 iops : min= 510, max= 544, avg=533.84, stdev=15.37, samples=19 00:32:00.137 lat (msec) : 50=100.00% 00:32:00.137 cpu : usr=99.06%, sys=0.53%, ctx=142, majf=0, minf=64 00:32:00.137 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:00.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 issued rwts: total=5344,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.137 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.137 filename1: (groupid=0, jobs=1): err= 0: pid=83293: Fri Apr 26 20:49:16 2024 00:32:00.137 read: IOPS=535, BW=2142KiB/s (2193kB/s)(20.9MiB/10010msec) 00:32:00.137 slat (usec): min=5, max=125, avg=29.99, stdev=20.28 00:32:00.137 clat (usec): min=14865, max=50102, avg=29585.17, stdev=1266.98 00:32:00.137 lat (usec): min=14888, max=50132, avg=29615.17, stdev=1268.75 00:32:00.137 clat percentiles (usec): 00:32:00.137 | 1.00th=[27395], 5.00th=[28443], 10.00th=[28705], 20.00th=[28967], 00:32:00.137 | 30.00th=[29230], 40.00th=[29492], 50.00th=[29754], 60.00th=[29754], 00:32:00.137 | 70.00th=[30016], 80.00th=[30278], 90.00th=[30540], 95.00th=[30802], 00:32:00.137 | 99.00th=[31327], 99.50th=[32113], 99.90th=[37487], 99.95th=[38011], 00:32:00.137 | 99.99th=[50070] 00:32:00.137 bw ( KiB/s): min= 2048, max= 2176, per=4.24%, avg=2135.00, stdev=60.29, samples=19 00:32:00.137 iops : min= 512, max= 544, avg=533.63, stdev=15.00, samples=19 00:32:00.137 lat (msec) : 20=0.34%, 50=99.65%, 100=0.02% 00:32:00.137 cpu : usr=98.29%, sys=1.03%, ctx=364, majf=0, minf=61 00:32:00.137 IO depths : 1=6.1%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:00.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 issued rwts: total=5360,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.137 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.137 filename1: (groupid=0, jobs=1): err= 0: pid=83294: Fri Apr 26 20:49:16 2024 00:32:00.137 read: IOPS=503, BW=2014KiB/s (2063kB/s)(19.7MiB/10004msec) 00:32:00.137 slat (usec): min=5, max=129, avg=19.95, stdev=17.88 00:32:00.137 clat (usec): min=7700, max=58826, avg=31624.13, stdev=5646.42 00:32:00.137 lat (usec): min=7706, max=58832, avg=31644.09, stdev=5644.07 00:32:00.137 clat percentiles (usec): 00:32:00.137 | 1.00th=[15795], 5.00th=[26608], 10.00th=[28443], 20.00th=[29230], 00:32:00.137 | 30.00th=[29492], 40.00th=[29754], 50.00th=[30016], 60.00th=[30278], 00:32:00.137 | 70.00th=[30802], 80.00th=[34866], 90.00th=[38536], 95.00th=[44303], 00:32:00.137 | 99.00th=[49546], 99.50th=[52691], 99.90th=[58983], 99.95th=[58983], 00:32:00.137 | 99.99th=[58983] 00:32:00.137 bw ( KiB/s): min= 1696, max= 2176, per=3.98%, avg=2001.63, stdev=126.70, samples=19 00:32:00.137 iops : min= 424, max= 544, avg=500.37, stdev=31.70, samples=19 00:32:00.137 lat (msec) : 10=0.20%, 20=1.95%, 50=97.00%, 100=0.85% 00:32:00.137 cpu : usr=95.12%, sys=2.34%, ctx=52, majf=0, minf=86 00:32:00.137 IO depths : 1=1.5%, 2=3.2%, 4=10.6%, 8=71.3%, 16=13.4%, 32=0.0%, >=64=0.0% 00:32:00.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 complete : 0=0.0%, 4=91.2%, 8=5.1%, 16=3.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 issued rwts: total=5038,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.137 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.137 filename1: (groupid=0, jobs=1): err= 0: pid=83295: Fri Apr 26 20:49:16 2024 00:32:00.137 read: IOPS=486, BW=1944KiB/s (1991kB/s)(19.0MiB/10003msec) 00:32:00.137 slat (usec): min=5, max=113, avg=17.05, stdev=16.11 00:32:00.137 clat (usec): min=5655, max=57679, avg=32824.68, stdev=7010.91 00:32:00.137 lat (usec): min=5661, max=57685, avg=32841.72, stdev=7009.02 00:32:00.137 clat percentiles (usec): 00:32:00.137 | 1.00th=[15008], 5.00th=[22938], 10.00th=[28181], 20.00th=[29230], 00:32:00.137 | 30.00th=[29754], 40.00th=[30016], 50.00th=[30540], 60.00th=[31065], 00:32:00.137 | 70.00th=[34866], 80.00th=[36963], 90.00th=[43779], 95.00th=[47973], 00:32:00.137 | 99.00th=[51119], 99.50th=[54264], 99.90th=[56886], 99.95th=[56886], 00:32:00.137 | 99.99th=[57934] 00:32:00.137 bw ( KiB/s): min= 1708, max= 2152, per=3.85%, avg=1935.95, stdev=126.61, samples=19 00:32:00.137 iops : min= 427, max= 538, avg=483.95, stdev=31.63, samples=19 00:32:00.137 lat (msec) : 10=0.35%, 20=2.57%, 50=95.43%, 100=1.65% 00:32:00.137 cpu : usr=98.97%, sys=0.64%, ctx=97, majf=0, minf=83 00:32:00.137 IO depths : 1=0.9%, 2=1.8%, 4=9.7%, 8=73.7%, 16=14.0%, 32=0.0%, >=64=0.0% 00:32:00.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 complete : 0=0.0%, 4=90.7%, 8=6.0%, 16=3.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 issued rwts: total=4862,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.137 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.137 filename1: (groupid=0, jobs=1): err= 0: pid=83296: Fri Apr 26 20:49:16 2024 00:32:00.137 read: IOPS=519, BW=2078KiB/s (2128kB/s)(20.3MiB/10019msec) 00:32:00.137 slat (usec): min=5, max=105, avg=23.38, stdev=19.15 00:32:00.137 clat (usec): min=12765, max=57584, avg=30596.18, stdev=4769.50 00:32:00.137 lat (usec): min=12780, max=57612, avg=30619.56, stdev=4767.85 00:32:00.137 clat percentiles (usec): 00:32:00.137 | 1.00th=[17171], 5.00th=[23725], 10.00th=[28181], 20.00th=[28967], 00:32:00.137 | 30.00th=[29492], 40.00th=[29754], 50.00th=[30016], 60.00th=[30016], 00:32:00.137 | 70.00th=[30278], 80.00th=[30802], 90.00th=[35914], 95.00th=[41681], 00:32:00.137 | 99.00th=[46924], 99.50th=[49021], 99.90th=[54789], 99.95th=[57410], 00:32:00.137 | 99.99th=[57410] 00:32:00.137 bw ( KiB/s): min= 1944, max= 2288, per=4.13%, avg=2077.26, stdev=85.83, samples=19 00:32:00.137 iops : min= 486, max= 572, avg=519.32, stdev=21.46, samples=19 00:32:00.137 lat (msec) : 20=2.07%, 50=97.46%, 100=0.46% 00:32:00.137 cpu : usr=99.06%, sys=0.63%, ctx=13, majf=0, minf=67 00:32:00.137 IO depths : 1=2.0%, 2=4.2%, 4=12.9%, 8=69.0%, 16=11.9%, 32=0.0%, >=64=0.0% 00:32:00.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 complete : 0=0.0%, 4=91.4%, 8=4.0%, 16=4.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 issued rwts: total=5206,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.137 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.137 filename2: (groupid=0, jobs=1): err= 0: pid=83297: Fri Apr 26 20:49:16 2024 00:32:00.137 read: IOPS=534, BW=2136KiB/s (2188kB/s)(20.9MiB/10006msec) 00:32:00.137 slat (usec): min=5, max=101, avg=15.17, stdev=15.84 00:32:00.137 clat (usec): min=15006, max=61867, avg=29835.66, stdev=1479.14 00:32:00.137 lat (usec): min=15014, max=61889, avg=29850.83, stdev=1479.06 00:32:00.137 clat percentiles (usec): 00:32:00.137 | 1.00th=[26608], 5.00th=[28443], 10.00th=[28967], 20.00th=[29230], 00:32:00.137 | 30.00th=[29492], 40.00th=[29754], 50.00th=[29754], 60.00th=[30016], 00:32:00.137 | 70.00th=[30278], 80.00th=[30278], 90.00th=[30540], 95.00th=[30802], 00:32:00.137 | 99.00th=[31851], 99.50th=[36963], 99.90th=[45351], 99.95th=[47973], 00:32:00.137 | 99.99th=[62129] 00:32:00.137 bw ( KiB/s): min= 2048, max= 2176, per=4.24%, avg=2135.32, stdev=60.96, samples=19 00:32:00.137 iops : min= 512, max= 544, avg=533.79, stdev=15.22, samples=19 00:32:00.137 lat (msec) : 20=0.07%, 50=99.89%, 100=0.04% 00:32:00.137 cpu : usr=98.65%, sys=0.84%, ctx=135, majf=0, minf=64 00:32:00.137 IO depths : 1=6.0%, 2=12.1%, 4=24.9%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:32:00.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 issued rwts: total=5344,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.137 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.137 filename2: (groupid=0, jobs=1): err= 0: pid=83298: Fri Apr 26 20:49:16 2024 00:32:00.137 read: IOPS=516, BW=2067KiB/s (2117kB/s)(20.2MiB/10015msec) 00:32:00.137 slat (nsec): min=2727, max=83072, avg=17221.17, stdev=13511.63 00:32:00.137 clat (usec): min=11599, max=51839, avg=30838.67, stdev=4798.86 00:32:00.137 lat (usec): min=11606, max=51845, avg=30855.89, stdev=4798.25 00:32:00.137 clat percentiles (usec): 00:32:00.137 | 1.00th=[18744], 5.00th=[23987], 10.00th=[27919], 20.00th=[28967], 00:32:00.137 | 30.00th=[29492], 40.00th=[29754], 50.00th=[30016], 60.00th=[30278], 00:32:00.137 | 70.00th=[30540], 80.00th=[31065], 90.00th=[36439], 95.00th=[41681], 00:32:00.137 | 99.00th=[46924], 99.50th=[49021], 99.90th=[51643], 99.95th=[51643], 00:32:00.137 | 99.99th=[51643] 00:32:00.137 bw ( KiB/s): min= 1920, max= 2176, per=4.10%, avg=2064.16, stdev=74.28, samples=19 00:32:00.137 iops : min= 480, max= 544, avg=516.00, stdev=18.58, samples=19 00:32:00.137 lat (msec) : 20=1.33%, 50=98.36%, 100=0.31% 00:32:00.137 cpu : usr=98.91%, sys=0.77%, ctx=20, majf=0, minf=53 00:32:00.137 IO depths : 1=2.3%, 2=4.6%, 4=13.6%, 8=67.4%, 16=12.1%, 32=0.0%, >=64=0.0% 00:32:00.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 complete : 0=0.0%, 4=91.6%, 8=4.6%, 16=3.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.137 issued rwts: total=5175,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.137 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.137 filename2: (groupid=0, jobs=1): err= 0: pid=83299: Fri Apr 26 20:49:16 2024 00:32:00.138 read: IOPS=517, BW=2071KiB/s (2121kB/s)(20.2MiB/10005msec) 00:32:00.138 slat (usec): min=5, max=101, avg=17.68, stdev=16.03 00:32:00.138 clat (usec): min=6308, max=54170, avg=30780.57, stdev=5593.23 00:32:00.138 lat (usec): min=6313, max=54176, avg=30798.25, stdev=5593.10 00:32:00.138 clat percentiles (usec): 00:32:00.138 | 1.00th=[15926], 5.00th=[22676], 10.00th=[27395], 20.00th=[28967], 00:32:00.138 | 30.00th=[29492], 40.00th=[29754], 50.00th=[30016], 60.00th=[30278], 00:32:00.138 | 70.00th=[30540], 80.00th=[31851], 90.00th=[36963], 95.00th=[42206], 00:32:00.138 | 99.00th=[50070], 99.50th=[51119], 99.90th=[53740], 99.95th=[54264], 00:32:00.138 | 99.99th=[54264] 00:32:00.138 bw ( KiB/s): min= 1792, max= 2272, per=4.09%, avg=2057.00, stdev=128.57, samples=19 00:32:00.138 iops : min= 448, max= 568, avg=514.21, stdev=32.09, samples=19 00:32:00.138 lat (msec) : 10=0.31%, 20=3.71%, 50=95.10%, 100=0.89% 00:32:00.138 cpu : usr=98.75%, sys=0.77%, ctx=131, majf=0, minf=77 00:32:00.138 IO depths : 1=1.0%, 2=2.6%, 4=11.0%, 8=72.0%, 16=13.4%, 32=0.0%, >=64=0.0% 00:32:00.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.138 complete : 0=0.0%, 4=91.0%, 8=5.1%, 16=3.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.138 issued rwts: total=5180,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.138 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.138 filename2: (groupid=0, jobs=1): err= 0: pid=83300: Fri Apr 26 20:49:16 2024 00:32:00.138 read: IOPS=535, BW=2143KiB/s (2195kB/s)(20.9MiB/10003msec) 00:32:00.138 slat (nsec): min=5560, max=95841, avg=26636.90, stdev=16053.91 00:32:00.138 clat (usec): min=15015, max=35569, avg=29610.15, stdev=1101.48 00:32:00.138 lat (usec): min=15025, max=35626, avg=29636.79, stdev=1102.90 00:32:00.138 clat percentiles (usec): 00:32:00.138 | 1.00th=[27395], 5.00th=[28443], 10.00th=[28705], 20.00th=[28967], 00:32:00.138 | 30.00th=[29230], 40.00th=[29492], 50.00th=[29754], 60.00th=[30016], 00:32:00.138 | 70.00th=[30016], 80.00th=[30278], 90.00th=[30540], 95.00th=[30802], 00:32:00.138 | 99.00th=[31065], 99.50th=[31327], 99.90th=[31589], 99.95th=[31589], 00:32:00.138 | 99.99th=[35390] 00:32:00.138 bw ( KiB/s): min= 2048, max= 2180, per=4.24%, avg=2135.79, stdev=61.28, samples=19 00:32:00.138 iops : min= 512, max= 545, avg=533.95, stdev=15.32, samples=19 00:32:00.138 lat (msec) : 20=0.30%, 50=99.70% 00:32:00.138 cpu : usr=99.36%, sys=0.36%, ctx=11, majf=0, minf=78 00:32:00.138 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:00.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.138 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.138 issued rwts: total=5360,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.138 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.138 filename2: (groupid=0, jobs=1): err= 0: pid=83301: Fri Apr 26 20:49:16 2024 00:32:00.138 read: IOPS=534, BW=2136KiB/s (2188kB/s)(20.9MiB/10006msec) 00:32:00.138 slat (usec): min=5, max=115, avg=20.37, stdev=17.95 00:32:00.138 clat (usec): min=23140, max=51131, avg=29780.83, stdev=1124.08 00:32:00.138 lat (usec): min=23148, max=51156, avg=29801.20, stdev=1123.42 00:32:00.138 clat percentiles (usec): 00:32:00.138 | 1.00th=[27919], 5.00th=[28443], 10.00th=[28705], 20.00th=[29230], 00:32:00.138 | 30.00th=[29492], 40.00th=[29492], 50.00th=[29754], 60.00th=[30016], 00:32:00.138 | 70.00th=[30278], 80.00th=[30278], 90.00th=[30540], 95.00th=[30802], 00:32:00.138 | 99.00th=[31327], 99.50th=[31589], 99.90th=[44303], 99.95th=[44303], 00:32:00.138 | 99.99th=[51119] 00:32:00.138 bw ( KiB/s): min= 2048, max= 2176, per=4.24%, avg=2135.53, stdev=60.64, samples=19 00:32:00.138 iops : min= 512, max= 544, avg=533.84, stdev=15.14, samples=19 00:32:00.138 lat (msec) : 50=99.96%, 100=0.04% 00:32:00.138 cpu : usr=96.24%, sys=1.71%, ctx=49, majf=0, minf=64 00:32:00.138 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:00.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.138 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.138 issued rwts: total=5344,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.138 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.138 filename2: (groupid=0, jobs=1): err= 0: pid=83302: Fri Apr 26 20:49:16 2024 00:32:00.138 read: IOPS=548, BW=2193KiB/s (2246kB/s)(21.4MiB/10010msec) 00:32:00.138 slat (nsec): min=5547, max=90924, avg=17467.57, stdev=13897.74 00:32:00.138 clat (usec): min=2087, max=52941, avg=29045.70, stdev=4300.52 00:32:00.138 lat (usec): min=2105, max=52947, avg=29063.17, stdev=4301.27 00:32:00.138 clat percentiles (usec): 00:32:00.138 | 1.00th=[ 4752], 5.00th=[21890], 10.00th=[27919], 20.00th=[28967], 00:32:00.138 | 30.00th=[29230], 40.00th=[29492], 50.00th=[29754], 60.00th=[30016], 00:32:00.138 | 70.00th=[30278], 80.00th=[30278], 90.00th=[30540], 95.00th=[31065], 00:32:00.138 | 99.00th=[41157], 99.50th=[44827], 99.90th=[50594], 99.95th=[51643], 00:32:00.138 | 99.99th=[52691] 00:32:00.138 bw ( KiB/s): min= 2048, max= 2896, per=4.36%, avg=2195.42, stdev=178.69, samples=19 00:32:00.138 iops : min= 512, max= 724, avg=548.74, stdev=44.67, samples=19 00:32:00.138 lat (msec) : 4=0.87%, 10=0.58%, 20=2.53%, 50=95.83%, 100=0.18% 00:32:00.138 cpu : usr=99.07%, sys=0.64%, ctx=11, majf=0, minf=62 00:32:00.138 IO depths : 1=4.4%, 2=9.4%, 4=20.6%, 8=56.5%, 16=9.1%, 32=0.0%, >=64=0.0% 00:32:00.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.138 complete : 0=0.0%, 4=93.4%, 8=1.5%, 16=5.1%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.138 issued rwts: total=5488,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.138 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.138 filename2: (groupid=0, jobs=1): err= 0: pid=83303: Fri Apr 26 20:49:16 2024 00:32:00.138 read: IOPS=535, BW=2142KiB/s (2193kB/s)(20.9MiB/10011msec) 00:32:00.138 slat (usec): min=5, max=112, avg=25.26, stdev=16.49 00:32:00.138 clat (usec): min=15303, max=37464, avg=29669.58, stdev=1162.60 00:32:00.138 lat (usec): min=15331, max=37504, avg=29694.84, stdev=1162.82 00:32:00.138 clat percentiles (usec): 00:32:00.138 | 1.00th=[27395], 5.00th=[28443], 10.00th=[28705], 20.00th=[28967], 00:32:00.138 | 30.00th=[29230], 40.00th=[29492], 50.00th=[29754], 60.00th=[30016], 00:32:00.138 | 70.00th=[30016], 80.00th=[30278], 90.00th=[30540], 95.00th=[30802], 00:32:00.138 | 99.00th=[31327], 99.50th=[33162], 99.90th=[35914], 99.95th=[36439], 00:32:00.138 | 99.99th=[37487] 00:32:00.138 bw ( KiB/s): min= 2043, max= 2176, per=4.24%, avg=2134.53, stdev=59.43, samples=19 00:32:00.138 iops : min= 510, max= 544, avg=533.47, stdev=14.86, samples=19 00:32:00.138 lat (msec) : 20=0.30%, 50=99.70% 00:32:00.138 cpu : usr=99.31%, sys=0.41%, ctx=8, majf=0, minf=69 00:32:00.138 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:00.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.138 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.138 issued rwts: total=5360,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.138 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.138 filename2: (groupid=0, jobs=1): err= 0: pid=83304: Fri Apr 26 20:49:16 2024 00:32:00.138 read: IOPS=536, BW=2146KiB/s (2197kB/s)(21.0MiB/10003msec) 00:32:00.138 slat (nsec): min=5515, max=82445, avg=18669.79, stdev=12672.97 00:32:00.138 clat (usec): min=7543, max=65747, avg=29666.31, stdev=3557.22 00:32:00.138 lat (usec): min=7553, max=65763, avg=29684.98, stdev=3557.63 00:32:00.138 clat percentiles (usec): 00:32:00.138 | 1.00th=[11863], 5.00th=[27657], 10.00th=[28705], 20.00th=[28967], 00:32:00.138 | 30.00th=[29230], 40.00th=[29492], 50.00th=[29754], 60.00th=[30016], 00:32:00.138 | 70.00th=[30278], 80.00th=[30540], 90.00th=[30802], 95.00th=[31065], 00:32:00.138 | 99.00th=[47449], 99.50th=[49546], 99.90th=[51643], 99.95th=[51643], 00:32:00.138 | 99.99th=[65799] 00:32:00.138 bw ( KiB/s): min= 1971, max= 2176, per=4.25%, avg=2138.00, stdev=65.22, samples=19 00:32:00.138 iops : min= 492, max= 544, avg=534.42, stdev=16.39, samples=19 00:32:00.138 lat (msec) : 10=0.56%, 20=1.34%, 50=97.73%, 100=0.37% 00:32:00.138 cpu : usr=99.21%, sys=0.44%, ctx=104, majf=0, minf=67 00:32:00.138 IO depths : 1=3.6%, 2=9.1%, 4=22.8%, 8=55.3%, 16=9.2%, 32=0.0%, >=64=0.0% 00:32:00.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.138 complete : 0=0.0%, 4=93.7%, 8=0.8%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.138 issued rwts: total=5366,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.138 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:00.138 00:32:00.138 Run status group 0 (all jobs): 00:32:00.138 READ: bw=49.1MiB/s (51.5MB/s), 1944KiB/s-2193KiB/s (1991kB/s-2246kB/s), io=492MiB (516MB), run=10001-10019msec 00:32:00.138 20:49:16 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:32:00.138 20:49:16 -- target/dif.sh@43 -- # local sub 00:32:00.138 20:49:16 -- target/dif.sh@45 -- # for sub in "$@" 00:32:00.138 20:49:16 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:00.138 20:49:16 -- target/dif.sh@36 -- # local sub_id=0 00:32:00.138 20:49:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:00.138 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.138 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.138 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.138 20:49:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:00.138 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.138 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.138 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.138 20:49:16 -- target/dif.sh@45 -- # for sub in "$@" 00:32:00.138 20:49:16 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:00.138 20:49:16 -- target/dif.sh@36 -- # local sub_id=1 00:32:00.138 20:49:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:00.138 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.138 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.138 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.138 20:49:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:00.138 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.138 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.138 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.138 20:49:16 -- target/dif.sh@45 -- # for sub in "$@" 00:32:00.138 20:49:16 -- target/dif.sh@46 -- # destroy_subsystem 2 00:32:00.138 20:49:16 -- target/dif.sh@36 -- # local sub_id=2 00:32:00.138 20:49:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:32:00.138 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.138 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.138 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.138 20:49:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:32:00.138 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.138 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.138 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.139 20:49:16 -- target/dif.sh@115 -- # NULL_DIF=1 00:32:00.139 20:49:16 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:32:00.139 20:49:16 -- target/dif.sh@115 -- # numjobs=2 00:32:00.139 20:49:16 -- target/dif.sh@115 -- # iodepth=8 00:32:00.139 20:49:16 -- target/dif.sh@115 -- # runtime=5 00:32:00.139 20:49:16 -- target/dif.sh@115 -- # files=1 00:32:00.139 20:49:16 -- target/dif.sh@117 -- # create_subsystems 0 1 00:32:00.139 20:49:16 -- target/dif.sh@28 -- # local sub 00:32:00.139 20:49:16 -- target/dif.sh@30 -- # for sub in "$@" 00:32:00.139 20:49:16 -- target/dif.sh@31 -- # create_subsystem 0 00:32:00.139 20:49:16 -- target/dif.sh@18 -- # local sub_id=0 00:32:00.139 20:49:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:00.139 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.139 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.139 bdev_null0 00:32:00.139 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.139 20:49:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:00.139 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.139 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.139 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.139 20:49:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:00.139 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.139 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.139 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.139 20:49:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:00.139 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.139 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.139 [2024-04-26 20:49:16.581561] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:00.139 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.139 20:49:16 -- target/dif.sh@30 -- # for sub in "$@" 00:32:00.139 20:49:16 -- target/dif.sh@31 -- # create_subsystem 1 00:32:00.139 20:49:16 -- target/dif.sh@18 -- # local sub_id=1 00:32:00.139 20:49:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:00.139 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.139 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.139 bdev_null1 00:32:00.139 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.139 20:49:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:00.139 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.139 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.139 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.139 20:49:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:00.139 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.139 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.139 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.139 20:49:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:00.139 20:49:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:00.139 20:49:16 -- common/autotest_common.sh@10 -- # set +x 00:32:00.139 20:49:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:00.139 20:49:16 -- target/dif.sh@118 -- # fio /dev/fd/62 00:32:00.139 20:49:16 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:32:00.139 20:49:16 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:00.139 20:49:16 -- nvmf/common.sh@520 -- # config=() 00:32:00.139 20:49:16 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:00.139 20:49:16 -- nvmf/common.sh@520 -- # local subsystem config 00:32:00.139 20:49:16 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:00.139 20:49:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:00.139 20:49:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:00.139 { 00:32:00.139 "params": { 00:32:00.139 "name": "Nvme$subsystem", 00:32:00.139 "trtype": "$TEST_TRANSPORT", 00:32:00.139 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:00.139 "adrfam": "ipv4", 00:32:00.139 "trsvcid": "$NVMF_PORT", 00:32:00.139 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:00.139 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:00.139 "hdgst": ${hdgst:-false}, 00:32:00.139 "ddgst": ${ddgst:-false} 00:32:00.139 }, 00:32:00.139 "method": "bdev_nvme_attach_controller" 00:32:00.139 } 00:32:00.139 EOF 00:32:00.139 )") 00:32:00.139 20:49:16 -- target/dif.sh@82 -- # gen_fio_conf 00:32:00.139 20:49:16 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:32:00.139 20:49:16 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:00.139 20:49:16 -- target/dif.sh@54 -- # local file 00:32:00.139 20:49:16 -- common/autotest_common.sh@1318 -- # local sanitizers 00:32:00.139 20:49:16 -- target/dif.sh@56 -- # cat 00:32:00.139 20:49:16 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:00.139 20:49:16 -- common/autotest_common.sh@1320 -- # shift 00:32:00.139 20:49:16 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:32:00.139 20:49:16 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:00.139 20:49:16 -- nvmf/common.sh@542 -- # cat 00:32:00.139 20:49:16 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:00.139 20:49:16 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:00.139 20:49:16 -- common/autotest_common.sh@1324 -- # grep libasan 00:32:00.139 20:49:16 -- target/dif.sh@72 -- # (( file <= files )) 00:32:00.139 20:49:16 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:00.139 20:49:16 -- target/dif.sh@73 -- # cat 00:32:00.139 20:49:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:00.139 20:49:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:00.139 { 00:32:00.139 "params": { 00:32:00.139 "name": "Nvme$subsystem", 00:32:00.139 "trtype": "$TEST_TRANSPORT", 00:32:00.139 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:00.139 "adrfam": "ipv4", 00:32:00.139 "trsvcid": "$NVMF_PORT", 00:32:00.139 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:00.139 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:00.139 "hdgst": ${hdgst:-false}, 00:32:00.139 "ddgst": ${ddgst:-false} 00:32:00.139 }, 00:32:00.139 "method": "bdev_nvme_attach_controller" 00:32:00.139 } 00:32:00.139 EOF 00:32:00.139 )") 00:32:00.139 20:49:16 -- target/dif.sh@72 -- # (( file++ )) 00:32:00.139 20:49:16 -- target/dif.sh@72 -- # (( file <= files )) 00:32:00.139 20:49:16 -- nvmf/common.sh@542 -- # cat 00:32:00.139 20:49:16 -- nvmf/common.sh@544 -- # jq . 00:32:00.139 20:49:16 -- nvmf/common.sh@545 -- # IFS=, 00:32:00.139 20:49:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:00.139 "params": { 00:32:00.139 "name": "Nvme0", 00:32:00.139 "trtype": "tcp", 00:32:00.139 "traddr": "10.0.0.2", 00:32:00.139 "adrfam": "ipv4", 00:32:00.139 "trsvcid": "4420", 00:32:00.139 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:00.139 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:00.139 "hdgst": false, 00:32:00.139 "ddgst": false 00:32:00.139 }, 00:32:00.139 "method": "bdev_nvme_attach_controller" 00:32:00.139 },{ 00:32:00.139 "params": { 00:32:00.139 "name": "Nvme1", 00:32:00.139 "trtype": "tcp", 00:32:00.139 "traddr": "10.0.0.2", 00:32:00.139 "adrfam": "ipv4", 00:32:00.139 "trsvcid": "4420", 00:32:00.139 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:00.139 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:00.139 "hdgst": false, 00:32:00.139 "ddgst": false 00:32:00.139 }, 00:32:00.139 "method": "bdev_nvme_attach_controller" 00:32:00.139 }' 00:32:00.139 20:49:16 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:00.139 20:49:16 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:00.139 20:49:16 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:00.139 20:49:16 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:00.139 20:49:16 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:32:00.139 20:49:16 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:00.139 20:49:16 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:00.139 20:49:16 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:00.139 20:49:16 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:00.139 20:49:16 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:00.139 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:00.139 ... 00:32:00.139 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:00.139 ... 00:32:00.139 fio-3.35 00:32:00.139 Starting 4 threads 00:32:00.139 EAL: No free 2048 kB hugepages reported on node 1 00:32:00.139 [2024-04-26 20:49:17.588821] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:00.139 [2024-04-26 20:49:17.588865] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:05.420 00:32:05.420 filename0: (groupid=0, jobs=1): err= 0: pid=85776: Fri Apr 26 20:49:22 2024 00:32:05.420 read: IOPS=1862, BW=14.6MiB/s (15.3MB/s)(72.8MiB/5002msec) 00:32:05.420 slat (nsec): min=3759, max=32058, avg=8503.80, stdev=2119.27 00:32:05.420 clat (usec): min=2192, max=8336, avg=4271.75, stdev=715.15 00:32:05.420 lat (usec): min=2200, max=8344, avg=4280.26, stdev=715.21 00:32:05.420 clat percentiles (usec): 00:32:05.420 | 1.00th=[ 2737], 5.00th=[ 3195], 10.00th=[ 3425], 20.00th=[ 3687], 00:32:05.420 | 30.00th=[ 3916], 40.00th=[ 4047], 50.00th=[ 4228], 60.00th=[ 4359], 00:32:05.420 | 70.00th=[ 4555], 80.00th=[ 4817], 90.00th=[ 5211], 95.00th=[ 5538], 00:32:05.420 | 99.00th=[ 6259], 99.50th=[ 6521], 99.90th=[ 7046], 99.95th=[ 7504], 00:32:05.420 | 99.99th=[ 8356] 00:32:05.420 bw ( KiB/s): min=14608, max=15456, per=23.89%, avg=14922.67, stdev=255.50, samples=9 00:32:05.420 iops : min= 1826, max= 1932, avg=1865.33, stdev=31.94, samples=9 00:32:05.420 lat (msec) : 4=35.17%, 10=64.83% 00:32:05.420 cpu : usr=97.14%, sys=2.48%, ctx=39, majf=0, minf=0 00:32:05.420 IO depths : 1=0.2%, 2=1.1%, 4=68.9%, 8=29.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:05.420 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.420 complete : 0=0.0%, 4=94.2%, 8=5.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.420 issued rwts: total=9318,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.420 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:05.420 filename0: (groupid=0, jobs=1): err= 0: pid=85777: Fri Apr 26 20:49:22 2024 00:32:05.420 read: IOPS=1822, BW=14.2MiB/s (14.9MB/s)(71.2MiB/5002msec) 00:32:05.420 slat (nsec): min=5314, max=36844, avg=7787.59, stdev=2635.05 00:32:05.420 clat (usec): min=1966, max=47599, avg=4368.86, stdev=1463.19 00:32:05.420 lat (usec): min=1972, max=47629, avg=4376.65, stdev=1463.37 00:32:05.420 clat percentiles (usec): 00:32:05.420 | 1.00th=[ 2966], 5.00th=[ 3294], 10.00th=[ 3458], 20.00th=[ 3720], 00:32:05.420 | 30.00th=[ 3949], 40.00th=[ 4113], 50.00th=[ 4293], 60.00th=[ 4424], 00:32:05.420 | 70.00th=[ 4621], 80.00th=[ 4883], 90.00th=[ 5276], 95.00th=[ 5669], 00:32:05.420 | 99.00th=[ 6325], 99.50th=[ 6521], 99.90th=[ 7111], 99.95th=[47449], 00:32:05.420 | 99.99th=[47449] 00:32:05.420 bw ( KiB/s): min=13354, max=14896, per=23.30%, avg=14554.00, stdev=470.78, samples=9 00:32:05.420 iops : min= 1669, max= 1862, avg=1819.22, stdev=58.93, samples=9 00:32:05.420 lat (msec) : 2=0.01%, 4=32.34%, 10=67.56%, 50=0.09% 00:32:05.420 cpu : usr=97.46%, sys=2.26%, ctx=3, majf=0, minf=9 00:32:05.420 IO depths : 1=0.1%, 2=1.3%, 4=68.6%, 8=30.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:05.420 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.420 complete : 0=0.0%, 4=94.1%, 8=5.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.420 issued rwts: total=9116,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.420 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:05.420 filename1: (groupid=0, jobs=1): err= 0: pid=85778: Fri Apr 26 20:49:22 2024 00:32:05.420 read: IOPS=2292, BW=17.9MiB/s (18.8MB/s)(89.6MiB/5002msec) 00:32:05.420 slat (nsec): min=7756, max=34726, avg=8298.51, stdev=1391.70 00:32:05.420 clat (usec): min=1159, max=6919, avg=3465.79, stdev=596.85 00:32:05.420 lat (usec): min=1167, max=6951, avg=3474.08, stdev=596.84 00:32:05.420 clat percentiles (usec): 00:32:05.420 | 1.00th=[ 2212], 5.00th=[ 2606], 10.00th=[ 2769], 20.00th=[ 2999], 00:32:05.420 | 30.00th=[ 3163], 40.00th=[ 3294], 50.00th=[ 3425], 60.00th=[ 3556], 00:32:05.420 | 70.00th=[ 3687], 80.00th=[ 3916], 90.00th=[ 4228], 95.00th=[ 4555], 00:32:05.420 | 99.00th=[ 5211], 99.50th=[ 5407], 99.90th=[ 5800], 99.95th=[ 6063], 00:32:05.420 | 99.99th=[ 6849] 00:32:05.420 bw ( KiB/s): min=18016, max=18640, per=29.37%, avg=18344.89, stdev=167.83, samples=9 00:32:05.420 iops : min= 2252, max= 2330, avg=2293.11, stdev=20.98, samples=9 00:32:05.420 lat (msec) : 2=0.49%, 4=83.04%, 10=16.47% 00:32:05.420 cpu : usr=97.74%, sys=1.98%, ctx=8, majf=0, minf=0 00:32:05.420 IO depths : 1=0.5%, 2=4.2%, 4=66.9%, 8=28.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:05.420 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.420 complete : 0=0.0%, 4=93.1%, 8=6.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.420 issued rwts: total=11467,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.420 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:05.420 filename1: (groupid=0, jobs=1): err= 0: pid=85779: Fri Apr 26 20:49:22 2024 00:32:05.420 read: IOPS=1829, BW=14.3MiB/s (15.0MB/s)(71.5MiB/5001msec) 00:32:05.420 slat (nsec): min=5319, max=37330, avg=7849.98, stdev=2659.89 00:32:05.420 clat (usec): min=2116, max=8157, avg=4352.15, stdev=730.08 00:32:05.420 lat (usec): min=2125, max=8165, avg=4360.00, stdev=730.14 00:32:05.420 clat percentiles (usec): 00:32:05.420 | 1.00th=[ 2966], 5.00th=[ 3294], 10.00th=[ 3490], 20.00th=[ 3752], 00:32:05.420 | 30.00th=[ 3982], 40.00th=[ 4080], 50.00th=[ 4293], 60.00th=[ 4424], 00:32:05.420 | 70.00th=[ 4621], 80.00th=[ 4883], 90.00th=[ 5342], 95.00th=[ 5735], 00:32:05.420 | 99.00th=[ 6259], 99.50th=[ 6587], 99.90th=[ 7242], 99.95th=[ 7439], 00:32:05.420 | 99.99th=[ 8160] 00:32:05.420 bw ( KiB/s): min=14192, max=14896, per=23.36%, avg=14588.44, stdev=219.06, samples=9 00:32:05.420 iops : min= 1774, max= 1862, avg=1823.56, stdev=27.38, samples=9 00:32:05.420 lat (msec) : 4=32.32%, 10=67.68% 00:32:05.420 cpu : usr=97.44%, sys=2.30%, ctx=6, majf=0, minf=9 00:32:05.420 IO depths : 1=0.3%, 2=1.6%, 4=67.8%, 8=30.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:05.420 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.420 complete : 0=0.0%, 4=94.4%, 8=5.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:05.420 issued rwts: total=9150,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:05.420 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:05.420 00:32:05.420 Run status group 0 (all jobs): 00:32:05.420 READ: bw=61.0MiB/s (64.0MB/s), 14.2MiB/s-17.9MiB/s (14.9MB/s-18.8MB/s), io=305MiB (320MB), run=5001-5002msec 00:32:05.420 20:49:22 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:32:05.420 20:49:22 -- target/dif.sh@43 -- # local sub 00:32:05.420 20:49:22 -- target/dif.sh@45 -- # for sub in "$@" 00:32:05.420 20:49:22 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:05.420 20:49:22 -- target/dif.sh@36 -- # local sub_id=0 00:32:05.420 20:49:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:05.420 20:49:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:05.420 20:49:22 -- common/autotest_common.sh@10 -- # set +x 00:32:05.420 20:49:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:05.420 20:49:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:05.420 20:49:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:05.420 20:49:22 -- common/autotest_common.sh@10 -- # set +x 00:32:05.420 20:49:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:05.420 20:49:22 -- target/dif.sh@45 -- # for sub in "$@" 00:32:05.420 20:49:22 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:05.420 20:49:22 -- target/dif.sh@36 -- # local sub_id=1 00:32:05.420 20:49:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:05.420 20:49:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:05.420 20:49:22 -- common/autotest_common.sh@10 -- # set +x 00:32:05.420 20:49:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:05.420 20:49:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:05.420 20:49:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:05.420 20:49:22 -- common/autotest_common.sh@10 -- # set +x 00:32:05.420 20:49:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:05.420 00:32:05.420 real 0m24.314s 00:32:05.420 user 5m14.993s 00:32:05.420 sys 0m3.848s 00:32:05.420 20:49:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:05.420 20:49:22 -- common/autotest_common.sh@10 -- # set +x 00:32:05.420 ************************************ 00:32:05.420 END TEST fio_dif_rand_params 00:32:05.420 ************************************ 00:32:05.420 20:49:22 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:32:05.420 20:49:22 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:05.420 20:49:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:05.420 20:49:22 -- common/autotest_common.sh@10 -- # set +x 00:32:05.420 ************************************ 00:32:05.420 START TEST fio_dif_digest 00:32:05.420 ************************************ 00:32:05.420 20:49:22 -- common/autotest_common.sh@1104 -- # fio_dif_digest 00:32:05.420 20:49:22 -- target/dif.sh@123 -- # local NULL_DIF 00:32:05.420 20:49:22 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:32:05.420 20:49:22 -- target/dif.sh@125 -- # local hdgst ddgst 00:32:05.420 20:49:22 -- target/dif.sh@127 -- # NULL_DIF=3 00:32:05.420 20:49:22 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:32:05.420 20:49:22 -- target/dif.sh@127 -- # numjobs=3 00:32:05.420 20:49:22 -- target/dif.sh@127 -- # iodepth=3 00:32:05.420 20:49:22 -- target/dif.sh@127 -- # runtime=10 00:32:05.420 20:49:22 -- target/dif.sh@128 -- # hdgst=true 00:32:05.420 20:49:22 -- target/dif.sh@128 -- # ddgst=true 00:32:05.420 20:49:22 -- target/dif.sh@130 -- # create_subsystems 0 00:32:05.420 20:49:22 -- target/dif.sh@28 -- # local sub 00:32:05.420 20:49:22 -- target/dif.sh@30 -- # for sub in "$@" 00:32:05.420 20:49:22 -- target/dif.sh@31 -- # create_subsystem 0 00:32:05.420 20:49:22 -- target/dif.sh@18 -- # local sub_id=0 00:32:05.420 20:49:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:05.420 20:49:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:05.420 20:49:22 -- common/autotest_common.sh@10 -- # set +x 00:32:05.420 bdev_null0 00:32:05.420 20:49:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:05.420 20:49:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:05.420 20:49:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:05.420 20:49:22 -- common/autotest_common.sh@10 -- # set +x 00:32:05.420 20:49:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:05.420 20:49:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:05.420 20:49:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:05.420 20:49:22 -- common/autotest_common.sh@10 -- # set +x 00:32:05.421 20:49:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:05.421 20:49:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:05.421 20:49:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:05.421 20:49:22 -- common/autotest_common.sh@10 -- # set +x 00:32:05.421 [2024-04-26 20:49:22.989980] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:05.421 20:49:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:05.421 20:49:22 -- target/dif.sh@131 -- # fio /dev/fd/62 00:32:05.421 20:49:22 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:32:05.421 20:49:22 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:05.421 20:49:22 -- nvmf/common.sh@520 -- # config=() 00:32:05.421 20:49:22 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:05.421 20:49:22 -- nvmf/common.sh@520 -- # local subsystem config 00:32:05.421 20:49:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:05.421 20:49:22 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:05.421 20:49:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:05.421 { 00:32:05.421 "params": { 00:32:05.421 "name": "Nvme$subsystem", 00:32:05.421 "trtype": "$TEST_TRANSPORT", 00:32:05.421 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:05.421 "adrfam": "ipv4", 00:32:05.421 "trsvcid": "$NVMF_PORT", 00:32:05.421 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:05.421 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:05.421 "hdgst": ${hdgst:-false}, 00:32:05.421 "ddgst": ${ddgst:-false} 00:32:05.421 }, 00:32:05.421 "method": "bdev_nvme_attach_controller" 00:32:05.421 } 00:32:05.421 EOF 00:32:05.421 )") 00:32:05.421 20:49:22 -- target/dif.sh@82 -- # gen_fio_conf 00:32:05.421 20:49:22 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:32:05.421 20:49:22 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:05.421 20:49:22 -- target/dif.sh@54 -- # local file 00:32:05.421 20:49:22 -- common/autotest_common.sh@1318 -- # local sanitizers 00:32:05.421 20:49:22 -- target/dif.sh@56 -- # cat 00:32:05.421 20:49:22 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:05.421 20:49:22 -- common/autotest_common.sh@1320 -- # shift 00:32:05.421 20:49:22 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:32:05.421 20:49:22 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:05.421 20:49:22 -- nvmf/common.sh@542 -- # cat 00:32:05.421 20:49:23 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:05.421 20:49:23 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:05.421 20:49:23 -- common/autotest_common.sh@1324 -- # grep libasan 00:32:05.421 20:49:23 -- target/dif.sh@72 -- # (( file <= files )) 00:32:05.421 20:49:23 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:05.421 20:49:23 -- nvmf/common.sh@544 -- # jq . 00:32:05.421 20:49:23 -- nvmf/common.sh@545 -- # IFS=, 00:32:05.421 20:49:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:05.421 "params": { 00:32:05.421 "name": "Nvme0", 00:32:05.421 "trtype": "tcp", 00:32:05.421 "traddr": "10.0.0.2", 00:32:05.421 "adrfam": "ipv4", 00:32:05.421 "trsvcid": "4420", 00:32:05.421 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:05.421 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:05.421 "hdgst": true, 00:32:05.421 "ddgst": true 00:32:05.421 }, 00:32:05.421 "method": "bdev_nvme_attach_controller" 00:32:05.421 }' 00:32:05.421 20:49:23 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:05.421 20:49:23 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:05.421 20:49:23 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:32:05.421 20:49:23 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:05.421 20:49:23 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:32:05.421 20:49:23 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:32:05.421 20:49:23 -- common/autotest_common.sh@1324 -- # asan_lib= 00:32:05.421 20:49:23 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:32:05.421 20:49:23 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:05.421 20:49:23 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:05.421 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:05.421 ... 00:32:05.421 fio-3.35 00:32:05.421 Starting 3 threads 00:32:05.421 EAL: No free 2048 kB hugepages reported on node 1 00:32:05.681 [2024-04-26 20:49:23.845626] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:05.681 [2024-04-26 20:49:23.845665] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:15.699 00:32:15.699 filename0: (groupid=0, jobs=1): err= 0: pid=87040: Fri Apr 26 20:49:34 2024 00:32:15.699 read: IOPS=115, BW=14.4MiB/s (15.1MB/s)(145MiB/10050msec) 00:32:15.699 slat (nsec): min=5586, max=30421, avg=7473.66, stdev=1551.29 00:32:15.699 clat (msec): min=8, max=137, avg=25.92, stdev=20.46 00:32:15.699 lat (msec): min=8, max=137, avg=25.93, stdev=20.46 00:32:15.699 clat percentiles (msec): 00:32:15.699 | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], 00:32:15.699 | 30.00th=[ 14], 40.00th=[ 15], 50.00th=[ 16], 60.00th=[ 16], 00:32:15.699 | 70.00th=[ 18], 80.00th=[ 55], 90.00th=[ 57], 95.00th=[ 58], 00:32:15.700 | 99.00th=[ 97], 99.50th=[ 99], 99.90th=[ 138], 99.95th=[ 138], 00:32:15.700 | 99.99th=[ 138] 00:32:15.700 bw ( KiB/s): min= 8704, max=19712, per=27.11%, avg=14835.20, stdev=2955.81, samples=20 00:32:15.700 iops : min= 68, max= 154, avg=115.90, stdev=23.09, samples=20 00:32:15.700 lat (msec) : 10=2.50%, 20=70.80%, 50=0.17%, 100=26.36%, 250=0.17% 00:32:15.700 cpu : usr=97.10%, sys=2.64%, ctx=9, majf=0, minf=66 00:32:15.700 IO depths : 1=6.9%, 2=93.1%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:15.700 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.700 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.700 issued rwts: total=1161,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:15.700 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:15.700 filename0: (groupid=0, jobs=1): err= 0: pid=87041: Fri Apr 26 20:49:34 2024 00:32:15.700 read: IOPS=133, BW=16.6MiB/s (17.4MB/s)(167MiB/10050msec) 00:32:15.700 slat (nsec): min=5717, max=31474, avg=7265.58, stdev=1520.36 00:32:15.700 clat (usec): min=7459, max=96142, avg=22505.45, stdev=18174.56 00:32:15.700 lat (usec): min=7466, max=96148, avg=22512.71, stdev=18174.70 00:32:15.700 clat percentiles (usec): 00:32:15.700 | 1.00th=[ 7963], 5.00th=[ 8979], 10.00th=[ 9896], 20.00th=[11076], 00:32:15.700 | 30.00th=[11994], 40.00th=[13173], 50.00th=[14091], 60.00th=[15139], 00:32:15.700 | 70.00th=[16319], 80.00th=[52691], 90.00th=[55313], 95.00th=[56361], 00:32:15.700 | 99.00th=[58459], 99.50th=[60556], 99.90th=[95945], 99.95th=[95945], 00:32:15.700 | 99.99th=[95945] 00:32:15.700 bw ( KiB/s): min=11520, max=25856, per=31.23%, avg=17088.00, stdev=3879.65, samples=20 00:32:15.700 iops : min= 90, max= 202, avg=133.50, stdev=30.31, samples=20 00:32:15.700 lat (msec) : 10=11.07%, 20=66.57%, 50=0.07%, 100=22.29% 00:32:15.700 cpu : usr=96.88%, sys=2.84%, ctx=18, majf=0, minf=161 00:32:15.700 IO depths : 1=2.1%, 2=97.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:15.700 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.700 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.700 issued rwts: total=1337,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:15.700 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:15.700 filename0: (groupid=0, jobs=1): err= 0: pid=87042: Fri Apr 26 20:49:34 2024 00:32:15.700 read: IOPS=179, BW=22.5MiB/s (23.5MB/s)(225MiB/10008msec) 00:32:15.700 slat (nsec): min=5598, max=30653, avg=6327.59, stdev=883.13 00:32:15.700 clat (usec): min=6083, max=98582, avg=16688.01, stdev=16314.14 00:32:15.700 lat (usec): min=6089, max=98588, avg=16694.34, stdev=16314.19 00:32:15.700 clat percentiles (usec): 00:32:15.700 | 1.00th=[ 6783], 5.00th=[ 7308], 10.00th=[ 7832], 20.00th=[ 8717], 00:32:15.700 | 30.00th=[ 9503], 40.00th=[10159], 50.00th=[10814], 60.00th=[11731], 00:32:15.700 | 70.00th=[12649], 80.00th=[13960], 90.00th=[52167], 95.00th=[54789], 00:32:15.700 | 99.00th=[92799], 99.50th=[95945], 99.90th=[98042], 99.95th=[99091], 00:32:15.700 | 99.99th=[99091] 00:32:15.700 bw ( KiB/s): min=10496, max=40192, per=42.02%, avg=22990.45, stdev=8676.43, samples=20 00:32:15.700 iops : min= 82, max= 314, avg=179.60, stdev=67.79, samples=20 00:32:15.700 lat (msec) : 10=38.10%, 20=48.55%, 50=0.33%, 100=13.01% 00:32:15.700 cpu : usr=96.89%, sys=2.85%, ctx=15, majf=0, minf=159 00:32:15.700 IO depths : 1=0.9%, 2=99.1%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:15.700 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.700 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.700 issued rwts: total=1798,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:15.700 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:15.700 00:32:15.700 Run status group 0 (all jobs): 00:32:15.700 READ: bw=53.4MiB/s (56.0MB/s), 14.4MiB/s-22.5MiB/s (15.1MB/s-23.5MB/s), io=537MiB (563MB), run=10008-10050msec 00:32:15.960 20:49:34 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:15.960 20:49:34 -- target/dif.sh@43 -- # local sub 00:32:15.960 20:49:34 -- target/dif.sh@45 -- # for sub in "$@" 00:32:15.960 20:49:34 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:15.960 20:49:34 -- target/dif.sh@36 -- # local sub_id=0 00:32:15.960 20:49:34 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:15.960 20:49:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:15.960 20:49:34 -- common/autotest_common.sh@10 -- # set +x 00:32:15.960 20:49:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:15.960 20:49:34 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:15.960 20:49:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:15.960 20:49:34 -- common/autotest_common.sh@10 -- # set +x 00:32:15.960 20:49:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:15.960 00:32:15.960 real 0m11.228s 00:32:15.960 user 0m42.954s 00:32:15.960 sys 0m1.138s 00:32:15.960 20:49:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:15.960 20:49:34 -- common/autotest_common.sh@10 -- # set +x 00:32:15.960 ************************************ 00:32:15.960 END TEST fio_dif_digest 00:32:15.960 ************************************ 00:32:15.960 20:49:34 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:15.960 20:49:34 -- target/dif.sh@147 -- # nvmftestfini 00:32:15.960 20:49:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:15.960 20:49:34 -- nvmf/common.sh@116 -- # sync 00:32:15.960 20:49:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:15.960 20:49:34 -- nvmf/common.sh@119 -- # set +e 00:32:15.960 20:49:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:15.960 20:49:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:15.960 rmmod nvme_tcp 00:32:15.960 rmmod nvme_fabrics 00:32:15.960 rmmod nvme_keyring 00:32:15.960 20:49:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:15.960 20:49:34 -- nvmf/common.sh@123 -- # set -e 00:32:15.960 20:49:34 -- nvmf/common.sh@124 -- # return 0 00:32:15.960 20:49:34 -- nvmf/common.sh@477 -- # '[' -n 76458 ']' 00:32:15.960 20:49:34 -- nvmf/common.sh@478 -- # killprocess 76458 00:32:15.960 20:49:34 -- common/autotest_common.sh@926 -- # '[' -z 76458 ']' 00:32:15.960 20:49:34 -- common/autotest_common.sh@930 -- # kill -0 76458 00:32:15.960 20:49:34 -- common/autotest_common.sh@931 -- # uname 00:32:15.960 20:49:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:32:15.960 20:49:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 76458 00:32:16.220 20:49:34 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:32:16.220 20:49:34 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:32:16.220 20:49:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 76458' 00:32:16.220 killing process with pid 76458 00:32:16.220 20:49:34 -- common/autotest_common.sh@945 -- # kill 76458 00:32:16.220 20:49:34 -- common/autotest_common.sh@950 -- # wait 76458 00:32:16.220 20:49:34 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:16.220 20:49:34 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:19.522 Waiting for block devices as requested 00:32:19.783 0000:80:01.6 (8086 0b00): vfio-pci -> ioatdma 00:32:19.783 0000:80:01.7 (8086 0b00): vfio-pci -> ioatdma 00:32:19.783 0000:80:01.4 (8086 0b00): vfio-pci -> ioatdma 00:32:20.044 0000:80:01.5 (8086 0b00): vfio-pci -> ioatdma 00:32:20.044 0000:80:01.2 (8086 0b00): vfio-pci -> ioatdma 00:32:20.044 0000:80:01.3 (8086 0b00): vfio-pci -> ioatdma 00:32:20.305 0000:80:01.0 (8086 0b00): vfio-pci -> ioatdma 00:32:20.305 0000:80:01.1 (8086 0b00): vfio-pci -> ioatdma 00:32:20.305 0000:65:00.0 (144d a80a): vfio-pci -> nvme 00:32:20.564 0000:00:01.6 (8086 0b00): vfio-pci -> ioatdma 00:32:20.564 0000:00:01.7 (8086 0b00): vfio-pci -> ioatdma 00:32:20.564 0000:00:01.4 (8086 0b00): vfio-pci -> ioatdma 00:32:20.564 0000:00:01.5 (8086 0b00): vfio-pci -> ioatdma 00:32:20.824 0000:00:01.2 (8086 0b00): vfio-pci -> ioatdma 00:32:20.824 0000:00:01.3 (8086 0b00): vfio-pci -> ioatdma 00:32:20.824 0000:00:01.0 (8086 0b00): vfio-pci -> ioatdma 00:32:20.824 0000:00:01.1 (8086 0b00): vfio-pci -> ioatdma 00:32:21.084 20:49:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:21.084 20:49:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:21.084 20:49:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:21.084 20:49:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:21.084 20:49:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:21.084 20:49:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:21.084 20:49:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:22.991 20:49:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:22.991 00:32:22.991 real 1m16.683s 00:32:22.991 user 7m59.202s 00:32:22.991 sys 0m18.369s 00:32:22.991 20:49:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:22.991 20:49:41 -- common/autotest_common.sh@10 -- # set +x 00:32:22.991 ************************************ 00:32:22.991 END TEST nvmf_dif 00:32:22.991 ************************************ 00:32:22.991 20:49:41 -- spdk/autotest.sh@301 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:22.991 20:49:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:22.991 20:49:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:22.991 20:49:41 -- common/autotest_common.sh@10 -- # set +x 00:32:22.991 ************************************ 00:32:22.991 START TEST nvmf_abort_qd_sizes 00:32:22.991 ************************************ 00:32:22.991 20:49:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:23.252 * Looking for test storage... 00:32:23.252 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:23.252 20:49:41 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:23.252 20:49:41 -- nvmf/common.sh@7 -- # uname -s 00:32:23.252 20:49:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:23.252 20:49:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:23.252 20:49:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:23.252 20:49:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:23.252 20:49:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:23.252 20:49:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:23.252 20:49:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:23.252 20:49:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:23.252 20:49:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:23.252 20:49:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:23.252 20:49:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:32:23.252 20:49:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:32:23.252 20:49:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:23.252 20:49:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:23.252 20:49:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:23.252 20:49:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:23.252 20:49:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:23.252 20:49:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:23.252 20:49:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:23.252 20:49:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:23.252 20:49:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:23.252 20:49:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:23.252 20:49:41 -- paths/export.sh@5 -- # export PATH 00:32:23.252 20:49:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:23.252 20:49:41 -- nvmf/common.sh@46 -- # : 0 00:32:23.252 20:49:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:23.252 20:49:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:23.252 20:49:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:23.252 20:49:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:23.252 20:49:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:23.252 20:49:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:23.252 20:49:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:23.252 20:49:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:23.252 20:49:41 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:23.252 20:49:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:23.252 20:49:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:23.252 20:49:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:23.252 20:49:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:23.252 20:49:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:23.252 20:49:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:23.252 20:49:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:23.252 20:49:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:23.252 20:49:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:23.252 20:49:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:23.252 20:49:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:23.252 20:49:41 -- common/autotest_common.sh@10 -- # set +x 00:32:29.866 20:49:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:29.866 20:49:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:29.866 20:49:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:29.866 20:49:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:29.866 20:49:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:29.866 20:49:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:29.866 20:49:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:29.866 20:49:48 -- nvmf/common.sh@294 -- # net_devs=() 00:32:29.866 20:49:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:29.866 20:49:48 -- nvmf/common.sh@295 -- # e810=() 00:32:29.866 20:49:48 -- nvmf/common.sh@295 -- # local -ga e810 00:32:29.866 20:49:48 -- nvmf/common.sh@296 -- # x722=() 00:32:29.866 20:49:48 -- nvmf/common.sh@296 -- # local -ga x722 00:32:29.866 20:49:48 -- nvmf/common.sh@297 -- # mlx=() 00:32:29.866 20:49:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:29.866 20:49:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:29.866 20:49:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:29.866 20:49:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:29.866 20:49:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:29.866 20:49:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:29.866 20:49:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:29.866 20:49:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:29.866 20:49:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:29.866 20:49:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:29.866 20:49:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:29.866 20:49:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:29.866 20:49:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:29.866 20:49:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:29.866 20:49:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:29.866 20:49:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:29.866 20:49:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:29.866 20:49:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:29.866 20:49:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:29.866 20:49:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.0 (0x8086 - 0x159b)' 00:32:29.866 Found 0000:4b:00.0 (0x8086 - 0x159b) 00:32:29.866 20:49:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:29.866 20:49:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:29.866 20:49:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:29.867 20:49:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:29.867 20:49:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:29.867 20:49:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:29.867 20:49:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:4b:00.1 (0x8086 - 0x159b)' 00:32:29.867 Found 0000:4b:00.1 (0x8086 - 0x159b) 00:32:29.867 20:49:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:29.867 20:49:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:29.867 20:49:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:29.867 20:49:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:29.867 20:49:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:29.867 20:49:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:29.867 20:49:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:29.867 20:49:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:29.867 20:49:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:29.867 20:49:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:29.867 20:49:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:29.867 20:49:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:29.867 20:49:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.0: cvl_0_0' 00:32:29.867 Found net devices under 0000:4b:00.0: cvl_0_0 00:32:29.867 20:49:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:29.867 20:49:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:29.867 20:49:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:29.867 20:49:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:29.867 20:49:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:29.867 20:49:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:4b:00.1: cvl_0_1' 00:32:29.867 Found net devices under 0000:4b:00.1: cvl_0_1 00:32:29.867 20:49:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:29.867 20:49:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:29.867 20:49:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:29.867 20:49:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:29.867 20:49:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:29.867 20:49:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:29.867 20:49:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:29.867 20:49:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:29.867 20:49:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:29.867 20:49:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:29.867 20:49:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:29.867 20:49:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:29.867 20:49:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:29.867 20:49:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:29.867 20:49:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:29.867 20:49:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:29.867 20:49:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:29.867 20:49:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:29.867 20:49:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:30.128 20:49:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:30.128 20:49:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:30.128 20:49:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:30.128 20:49:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:30.128 20:49:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:30.128 20:49:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:30.128 20:49:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:30.128 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:30.128 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.701 ms 00:32:30.128 00:32:30.128 --- 10.0.0.2 ping statistics --- 00:32:30.128 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:30.128 rtt min/avg/max/mdev = 0.701/0.701/0.701/0.000 ms 00:32:30.128 20:49:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:30.128 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:30.128 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.261 ms 00:32:30.128 00:32:30.128 --- 10.0.0.1 ping statistics --- 00:32:30.128 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:30.128 rtt min/avg/max/mdev = 0.261/0.261/0.261/0.000 ms 00:32:30.128 20:49:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:30.128 20:49:48 -- nvmf/common.sh@410 -- # return 0 00:32:30.128 20:49:48 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:30.128 20:49:48 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:34.332 0000:80:01.6 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:80:01.7 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:80:01.4 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:80:01.5 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:80:01.2 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:80:01.3 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:80:01.0 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:80:01.1 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:00:01.6 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:00:01.7 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:00:01.4 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:00:01.5 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:00:01.2 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:00:01.3 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:00:01.0 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:00:01.1 (8086 0b00): ioatdma -> vfio-pci 00:32:34.332 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:32:34.332 20:49:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:34.332 20:49:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:34.332 20:49:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:34.332 20:49:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:34.332 20:49:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:34.332 20:49:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:34.332 20:49:52 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:34.332 20:49:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:34.332 20:49:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:32:34.332 20:49:52 -- common/autotest_common.sh@10 -- # set +x 00:32:34.332 20:49:52 -- nvmf/common.sh@469 -- # nvmfpid=96548 00:32:34.332 20:49:52 -- nvmf/common.sh@470 -- # waitforlisten 96548 00:32:34.332 20:49:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:34.332 20:49:52 -- common/autotest_common.sh@819 -- # '[' -z 96548 ']' 00:32:34.332 20:49:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:34.332 20:49:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:32:34.332 20:49:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:34.332 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:34.332 20:49:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:32:34.332 20:49:52 -- common/autotest_common.sh@10 -- # set +x 00:32:34.332 [2024-04-26 20:49:52.141320] Starting SPDK v24.01.1-pre git sha1 36faa8c31 / DPDK 23.11.0 initialization... 00:32:34.332 [2024-04-26 20:49:52.141381] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:34.332 EAL: No free 2048 kB hugepages reported on node 1 00:32:34.332 [2024-04-26 20:49:52.211722] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:34.332 [2024-04-26 20:49:52.285714] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:34.332 [2024-04-26 20:49:52.285845] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:34.332 [2024-04-26 20:49:52.285856] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:34.332 [2024-04-26 20:49:52.285864] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:34.332 [2024-04-26 20:49:52.285993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:34.332 [2024-04-26 20:49:52.286111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:34.332 [2024-04-26 20:49:52.286243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:34.332 [2024-04-26 20:49:52.286246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:34.591 20:49:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:32:34.591 20:49:52 -- common/autotest_common.sh@852 -- # return 0 00:32:34.591 20:49:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:34.591 20:49:52 -- common/autotest_common.sh@718 -- # xtrace_disable 00:32:34.591 20:49:52 -- common/autotest_common.sh@10 -- # set +x 00:32:34.849 20:49:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:34.849 20:49:52 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:34.849 20:49:52 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:34.849 20:49:52 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:34.849 20:49:52 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:34.849 20:49:52 -- scripts/common.sh@312 -- # local nvmes 00:32:34.849 20:49:52 -- scripts/common.sh@314 -- # [[ -n 0000:65:00.0 ]] 00:32:34.849 20:49:52 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:34.849 20:49:52 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:34.849 20:49:52 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:65:00.0 ]] 00:32:34.849 20:49:52 -- scripts/common.sh@322 -- # uname -s 00:32:34.849 20:49:52 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:34.849 20:49:52 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:34.849 20:49:52 -- scripts/common.sh@327 -- # (( 1 )) 00:32:34.849 20:49:52 -- scripts/common.sh@328 -- # printf '%s\n' 0000:65:00.0 00:32:34.849 20:49:52 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:34.849 20:49:52 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:65:00.0 00:32:34.849 20:49:52 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:34.849 20:49:52 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:34.849 20:49:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:34.849 20:49:52 -- common/autotest_common.sh@10 -- # set +x 00:32:34.849 ************************************ 00:32:34.849 START TEST spdk_target_abort 00:32:34.849 ************************************ 00:32:34.849 20:49:52 -- common/autotest_common.sh@1104 -- # spdk_target 00:32:34.849 20:49:52 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:34.849 20:49:52 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:34.849 20:49:52 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:65:00.0 -b spdk_target 00:32:34.849 20:49:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:34.849 20:49:52 -- common/autotest_common.sh@10 -- # set +x 00:32:35.121 spdk_targetn1 00:32:35.121 20:49:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:35.121 20:49:53 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:35.121 20:49:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:35.121 20:49:53 -- common/autotest_common.sh@10 -- # set +x 00:32:35.121 [2024-04-26 20:49:53.287233] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:35.122 20:49:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:35.122 20:49:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:35.122 20:49:53 -- common/autotest_common.sh@10 -- # set +x 00:32:35.122 20:49:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:35.122 20:49:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:35.122 20:49:53 -- common/autotest_common.sh@10 -- # set +x 00:32:35.122 20:49:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:35.122 20:49:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:35.122 20:49:53 -- common/autotest_common.sh@10 -- # set +x 00:32:35.122 [2024-04-26 20:49:53.327513] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:35.122 20:49:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:35.122 20:49:53 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:35.122 EAL: No free 2048 kB hugepages reported on node 1 00:32:35.382 [2024-04-26 20:49:53.604708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:189 nsid:1 lba:1008 len:8 PRP1 0x2000078be000 PRP2 0x0 00:32:35.382 [2024-04-26 20:49:53.604732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:189 cdw0:0 sqhd:007f p:1 m:0 dnr:0 00:32:35.382 [2024-04-26 20:49:53.629421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:189 nsid:1 lba:1672 len:8 PRP1 0x2000078c2000 PRP2 0x0 00:32:35.382 [2024-04-26 20:49:53.629439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:189 cdw0:0 sqhd:00d3 p:1 m:0 dnr:0 00:32:35.382 [2024-04-26 20:49:53.637646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:191 nsid:1 lba:1888 len:8 PRP1 0x2000078be000 PRP2 0x0 00:32:35.382 [2024-04-26 20:49:53.637661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:191 cdw0:0 sqhd:00ef p:1 m:0 dnr:0 00:32:35.382 [2024-04-26 20:49:53.651342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:191 nsid:1 lba:2248 len:8 PRP1 0x2000078be000 PRP2 0x0 00:32:35.382 [2024-04-26 20:49:53.651359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:191 cdw0:0 sqhd:001d p:0 m:0 dnr:0 00:32:35.382 [2024-04-26 20:49:53.666709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:191 nsid:1 lba:2616 len:8 PRP1 0x2000078c0000 PRP2 0x0 00:32:35.382 [2024-04-26 20:49:53.666724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:191 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:32:35.382 [2024-04-26 20:49:53.675701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:189 nsid:1 lba:2824 len:8 PRP1 0x2000078c2000 PRP2 0x0 00:32:35.383 [2024-04-26 20:49:53.675715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:189 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:32:35.383 [2024-04-26 20:49:53.685903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:190 nsid:1 lba:3184 len:8 PRP1 0x2000078c4000 PRP2 0x0 00:32:35.383 [2024-04-26 20:49:53.685918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:190 cdw0:0 sqhd:008f p:0 m:0 dnr:0 00:32:35.383 [2024-04-26 20:49:53.699259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:188 nsid:1 lba:3440 len:8 PRP1 0x2000078be000 PRP2 0x0 00:32:35.383 [2024-04-26 20:49:53.699274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:188 cdw0:0 sqhd:00b0 p:0 m:0 dnr:0 00:32:35.383 [2024-04-26 20:49:53.705803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:191 nsid:1 lba:3616 len:8 PRP1 0x2000078c2000 PRP2 0x0 00:32:35.383 [2024-04-26 20:49:53.705817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:191 cdw0:0 sqhd:00c6 p:0 m:0 dnr:0 00:32:38.676 Initializing NVMe Controllers 00:32:38.676 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:38.676 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:38.676 Initialization complete. Launching workers. 00:32:38.676 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 9260, failed: 9 00:32:38.676 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 3470, failed to submit 5799 00:32:38.676 success 783, unsuccess 2687, failed 0 00:32:38.676 20:49:56 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:38.676 20:49:56 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:38.676 EAL: No free 2048 kB hugepages reported on node 1 00:32:38.676 [2024-04-26 20:49:56.864511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:4 cid:173 nsid:1 lba:1056 len:8 PRP1 0x200007c4e000 PRP2 0x0 00:32:38.676 [2024-04-26 20:49:56.864557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:4 cid:173 cdw0:0 sqhd:0088 p:1 m:0 dnr:0 00:32:38.676 [2024-04-26 20:49:56.872398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:4 cid:190 nsid:1 lba:1152 len:8 PRP1 0x200007c46000 PRP2 0x0 00:32:38.676 [2024-04-26 20:49:56.872420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:4 cid:190 cdw0:0 sqhd:009c p:1 m:0 dnr:0 00:32:38.676 [2024-04-26 20:49:56.888124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:4 cid:168 nsid:1 lba:1616 len:8 PRP1 0x200007c3c000 PRP2 0x0 00:32:38.676 [2024-04-26 20:49:56.888146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:4 cid:168 cdw0:0 sqhd:00ce p:1 m:0 dnr:0 00:32:38.676 [2024-04-26 20:49:56.896476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:4 cid:185 nsid:1 lba:1728 len:8 PRP1 0x200007c4a000 PRP2 0x0 00:32:38.676 [2024-04-26 20:49:56.896497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:4 cid:185 cdw0:0 sqhd:00da p:1 m:0 dnr:0 00:32:38.676 [2024-04-26 20:49:56.904270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:4 cid:190 nsid:1 lba:1848 len:8 PRP1 0x200007c5c000 PRP2 0x0 00:32:38.676 [2024-04-26 20:49:56.904295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:4 cid:190 cdw0:0 sqhd:00ea p:1 m:0 dnr:0 00:32:38.676 [2024-04-26 20:49:56.912293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:4 cid:175 nsid:1 lba:2096 len:8 PRP1 0x200007c3a000 PRP2 0x0 00:32:38.676 [2024-04-26 20:49:56.912314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:4 cid:175 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:32:38.676 [2024-04-26 20:49:56.928378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:4 cid:183 nsid:1 lba:2408 len:8 PRP1 0x200007c3a000 PRP2 0x0 00:32:38.676 [2024-04-26 20:49:56.928399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:4 cid:183 cdw0:0 sqhd:0038 p:0 m:0 dnr:0 00:32:38.676 [2024-04-26 20:49:56.975309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:4 cid:177 nsid:1 lba:3528 len:8 PRP1 0x200007c42000 PRP2 0x0 00:32:38.676 [2024-04-26 20:49:56.975332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:4 cid:177 cdw0:0 sqhd:00c7 p:0 m:0 dnr:0 00:32:38.676 [2024-04-26 20:49:56.983393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:4 cid:188 nsid:1 lba:3744 len:8 PRP1 0x200007c3c000 PRP2 0x0 00:32:38.676 [2024-04-26 20:49:56.983414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:4 cid:188 cdw0:0 sqhd:00dd p:0 m:0 dnr:0 00:32:41.975 Initializing NVMe Controllers 00:32:41.975 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:41.975 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:41.975 Initialization complete. Launching workers. 00:32:41.975 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8573, failed: 9 00:32:41.975 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1179, failed to submit 7403 00:32:41.975 success 382, unsuccess 797, failed 0 00:32:41.975 20:49:59 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:41.975 20:49:59 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:41.975 EAL: No free 2048 kB hugepages reported on node 1 00:32:42.914 [2024-04-26 20:50:01.109285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:163 nsid:1 lba:97016 len:8 PRP1 0x20000792a000 PRP2 0x0 00:32:42.914 [2024-04-26 20:50:01.109326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:163 cdw0:0 sqhd:0096 p:0 m:0 dnr:0 00:32:44.291 [2024-04-26 20:50:02.372970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:2 cid:188 nsid:1 lba:234056 len:8 PRP1 0x2000078f8000 PRP2 0x0 00:32:44.291 [2024-04-26 20:50:02.372995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - BY REQUEST (00/07) qid:2 cid:188 cdw0:0 sqhd:008a p:1 m:0 dnr:0 00:32:45.228 Initializing NVMe Controllers 00:32:45.228 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:45.228 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:45.228 Initialization complete. Launching workers. 00:32:45.228 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 40754, failed: 2 00:32:45.228 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2558, failed to submit 38198 00:32:45.228 success 657, unsuccess 1901, failed 0 00:32:45.228 20:50:03 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:45.228 20:50:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:45.228 20:50:03 -- common/autotest_common.sh@10 -- # set +x 00:32:45.228 20:50:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:45.228 20:50:03 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:45.228 20:50:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:45.228 20:50:03 -- common/autotest_common.sh@10 -- # set +x 00:32:47.134 20:50:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:47.134 20:50:05 -- target/abort_qd_sizes.sh@62 -- # killprocess 96548 00:32:47.134 20:50:05 -- common/autotest_common.sh@926 -- # '[' -z 96548 ']' 00:32:47.134 20:50:05 -- common/autotest_common.sh@930 -- # kill -0 96548 00:32:47.134 20:50:05 -- common/autotest_common.sh@931 -- # uname 00:32:47.134 20:50:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:32:47.134 20:50:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 96548 00:32:47.134 20:50:05 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:32:47.134 20:50:05 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:32:47.134 20:50:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 96548' 00:32:47.134 killing process with pid 96548 00:32:47.134 20:50:05 -- common/autotest_common.sh@945 -- # kill 96548 00:32:47.134 20:50:05 -- common/autotest_common.sh@950 -- # wait 96548 00:32:47.134 00:32:47.134 real 0m12.311s 00:32:47.134 user 0m49.656s 00:32:47.134 sys 0m2.009s 00:32:47.134 20:50:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:47.134 20:50:05 -- common/autotest_common.sh@10 -- # set +x 00:32:47.134 ************************************ 00:32:47.134 END TEST spdk_target_abort 00:32:47.134 ************************************ 00:32:47.134 20:50:05 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:47.134 20:50:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:47.134 20:50:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:47.134 20:50:05 -- common/autotest_common.sh@10 -- # set +x 00:32:47.134 ************************************ 00:32:47.134 START TEST kernel_target_abort 00:32:47.134 ************************************ 00:32:47.134 20:50:05 -- common/autotest_common.sh@1104 -- # kernel_target 00:32:47.134 20:50:05 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:47.134 20:50:05 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:47.134 20:50:05 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:47.134 20:50:05 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:47.134 20:50:05 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:47.134 20:50:05 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:47.134 20:50:05 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:47.134 20:50:05 -- nvmf/common.sh@627 -- # local block nvme 00:32:47.134 20:50:05 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:47.134 20:50:05 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:47.134 20:50:05 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:47.135 20:50:05 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:49.680 Waiting for block devices as requested 00:32:49.680 0000:80:01.6 (8086 0b00): vfio-pci -> ioatdma 00:32:49.939 0000:80:01.7 (8086 0b00): vfio-pci -> ioatdma 00:32:49.939 0000:80:01.4 (8086 0b00): vfio-pci -> ioatdma 00:32:49.939 0000:80:01.5 (8086 0b00): vfio-pci -> ioatdma 00:32:50.199 0000:80:01.2 (8086 0b00): vfio-pci -> ioatdma 00:32:50.199 0000:80:01.3 (8086 0b00): vfio-pci -> ioatdma 00:32:50.199 0000:80:01.0 (8086 0b00): vfio-pci -> ioatdma 00:32:50.199 0000:80:01.1 (8086 0b00): vfio-pci -> ioatdma 00:32:50.460 0000:65:00.0 (144d a80a): vfio-pci -> nvme 00:32:50.460 0000:00:01.6 (8086 0b00): vfio-pci -> ioatdma 00:32:50.460 0000:00:01.7 (8086 0b00): vfio-pci -> ioatdma 00:32:50.721 0000:00:01.4 (8086 0b00): vfio-pci -> ioatdma 00:32:50.721 0000:00:01.5 (8086 0b00): vfio-pci -> ioatdma 00:32:50.721 0000:00:01.2 (8086 0b00): vfio-pci -> ioatdma 00:32:50.981 0000:00:01.3 (8086 0b00): vfio-pci -> ioatdma 00:32:50.981 0000:00:01.0 (8086 0b00): vfio-pci -> ioatdma 00:32:50.981 0000:00:01.1 (8086 0b00): vfio-pci -> ioatdma 00:32:50.981 20:50:09 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:50.981 20:50:09 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:50.981 20:50:09 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:50.981 20:50:09 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:50.981 20:50:09 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:50.981 No valid GPT data, bailing 00:32:50.981 20:50:09 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:50.981 20:50:09 -- scripts/common.sh@393 -- # pt= 00:32:50.981 20:50:09 -- scripts/common.sh@394 -- # return 1 00:32:50.981 20:50:09 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:50.981 20:50:09 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:51.241 20:50:09 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:51.241 20:50:09 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:51.241 20:50:09 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:51.241 20:50:09 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:51.241 20:50:09 -- nvmf/common.sh@654 -- # echo 1 00:32:51.241 20:50:09 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:51.241 20:50:09 -- nvmf/common.sh@656 -- # echo 1 00:32:51.241 20:50:09 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:51.241 20:50:09 -- nvmf/common.sh@663 -- # echo tcp 00:32:51.241 20:50:09 -- nvmf/common.sh@664 -- # echo 4420 00:32:51.241 20:50:09 -- nvmf/common.sh@665 -- # echo ipv4 00:32:51.241 20:50:09 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:51.241 20:50:09 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -a 10.0.0.1 -t tcp -s 4420 00:32:51.241 00:32:51.241 Discovery Log Number of Records 2, Generation counter 2 00:32:51.241 =====Discovery Log Entry 0====== 00:32:51.241 trtype: tcp 00:32:51.241 adrfam: ipv4 00:32:51.241 subtype: current discovery subsystem 00:32:51.241 treq: not specified, sq flow control disable supported 00:32:51.241 portid: 1 00:32:51.241 trsvcid: 4420 00:32:51.241 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:51.241 traddr: 10.0.0.1 00:32:51.241 eflags: none 00:32:51.241 sectype: none 00:32:51.241 =====Discovery Log Entry 1====== 00:32:51.241 trtype: tcp 00:32:51.241 adrfam: ipv4 00:32:51.241 subtype: nvme subsystem 00:32:51.241 treq: not specified, sq flow control disable supported 00:32:51.241 portid: 1 00:32:51.241 trsvcid: 4420 00:32:51.241 subnqn: kernel_target 00:32:51.241 traddr: 10.0.0.1 00:32:51.241 eflags: none 00:32:51.241 sectype: none 00:32:51.241 20:50:09 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:51.241 20:50:09 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:51.241 20:50:09 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:51.241 20:50:09 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:51.241 20:50:09 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:51.241 20:50:09 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:51.241 20:50:09 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:51.241 20:50:09 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:51.241 20:50:09 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:51.242 20:50:09 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:51.242 20:50:09 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:51.242 20:50:09 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:51.242 20:50:09 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:51.242 20:50:09 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:51.242 20:50:09 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:51.242 20:50:09 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:51.242 20:50:09 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:51.242 20:50:09 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:51.242 20:50:09 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:51.242 20:50:09 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:51.242 20:50:09 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:51.242 EAL: No free 2048 kB hugepages reported on node 1 00:32:54.536 Initializing NVMe Controllers 00:32:54.536 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:54.536 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:54.536 Initialization complete. Launching workers. 00:32:54.536 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 38686, failed: 0 00:32:54.536 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 38686, failed to submit 0 00:32:54.536 success 0, unsuccess 38686, failed 0 00:32:54.536 20:50:12 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:54.536 20:50:12 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:54.536 EAL: No free 2048 kB hugepages reported on node 1 00:32:57.823 Initializing NVMe Controllers 00:32:57.823 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:57.823 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:57.823 Initialization complete. Launching workers. 00:32:57.823 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 78786, failed: 0 00:32:57.823 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19846, failed to submit 58940 00:32:57.823 success 0, unsuccess 19846, failed 0 00:32:57.823 20:50:15 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:57.823 20:50:15 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:57.823 EAL: No free 2048 kB hugepages reported on node 1 00:33:00.355 Initializing NVMe Controllers 00:33:00.355 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:00.355 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:00.355 Initialization complete. Launching workers. 00:33:00.355 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 76247, failed: 0 00:33:00.355 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19050, failed to submit 57197 00:33:00.355 success 0, unsuccess 19050, failed 0 00:33:00.355 20:50:18 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:33:00.355 20:50:18 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:33:00.355 20:50:18 -- nvmf/common.sh@677 -- # echo 0 00:33:00.355 20:50:18 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:33:00.355 20:50:18 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:00.355 20:50:18 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:33:00.355 20:50:18 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:00.355 20:50:18 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:33:00.355 20:50:18 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:33:00.355 00:33:00.355 real 0m13.312s 00:33:00.355 user 0m5.402s 00:33:00.355 sys 0m3.411s 00:33:00.355 20:50:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:33:00.355 20:50:18 -- common/autotest_common.sh@10 -- # set +x 00:33:00.355 ************************************ 00:33:00.355 END TEST kernel_target_abort 00:33:00.355 ************************************ 00:33:00.355 20:50:18 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:33:00.355 20:50:18 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:33:00.355 20:50:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:00.355 20:50:18 -- nvmf/common.sh@116 -- # sync 00:33:00.355 20:50:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:00.355 20:50:18 -- nvmf/common.sh@119 -- # set +e 00:33:00.355 20:50:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:00.355 20:50:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:00.355 rmmod nvme_tcp 00:33:00.615 rmmod nvme_fabrics 00:33:00.615 rmmod nvme_keyring 00:33:00.615 20:50:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:00.615 20:50:18 -- nvmf/common.sh@123 -- # set -e 00:33:00.615 20:50:18 -- nvmf/common.sh@124 -- # return 0 00:33:00.615 20:50:18 -- nvmf/common.sh@477 -- # '[' -n 96548 ']' 00:33:00.615 20:50:18 -- nvmf/common.sh@478 -- # killprocess 96548 00:33:00.615 20:50:18 -- common/autotest_common.sh@926 -- # '[' -z 96548 ']' 00:33:00.615 20:50:18 -- common/autotest_common.sh@930 -- # kill -0 96548 00:33:00.615 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (96548) - No such process 00:33:00.615 20:50:18 -- common/autotest_common.sh@953 -- # echo 'Process with pid 96548 is not found' 00:33:00.615 Process with pid 96548 is not found 00:33:00.615 20:50:18 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:33:00.615 20:50:18 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:03.918 0000:80:01.6 (8086 0b00): Already using the ioatdma driver 00:33:03.918 0000:80:01.7 (8086 0b00): Already using the ioatdma driver 00:33:03.918 0000:80:01.4 (8086 0b00): Already using the ioatdma driver 00:33:03.918 0000:80:01.5 (8086 0b00): Already using the ioatdma driver 00:33:04.180 0000:80:01.2 (8086 0b00): Already using the ioatdma driver 00:33:04.180 0000:80:01.3 (8086 0b00): Already using the ioatdma driver 00:33:04.180 0000:80:01.0 (8086 0b00): Already using the ioatdma driver 00:33:04.180 0000:80:01.1 (8086 0b00): Already using the ioatdma driver 00:33:04.180 0000:65:00.0 (144d a80a): Already using the nvme driver 00:33:04.180 0000:00:01.6 (8086 0b00): Already using the ioatdma driver 00:33:04.180 0000:00:01.7 (8086 0b00): Already using the ioatdma driver 00:33:04.180 0000:00:01.4 (8086 0b00): Already using the ioatdma driver 00:33:04.180 0000:00:01.5 (8086 0b00): Already using the ioatdma driver 00:33:04.180 0000:00:01.2 (8086 0b00): Already using the ioatdma driver 00:33:04.180 0000:00:01.3 (8086 0b00): Already using the ioatdma driver 00:33:04.442 0000:00:01.0 (8086 0b00): Already using the ioatdma driver 00:33:04.442 0000:00:01.1 (8086 0b00): Already using the ioatdma driver 00:33:04.442 20:50:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:04.442 20:50:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:04.442 20:50:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:04.442 20:50:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:04.442 20:50:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:04.442 20:50:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:04.442 20:50:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:06.437 20:50:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:06.437 00:33:06.437 real 0m43.353s 00:33:06.437 user 0m59.924s 00:33:06.437 sys 0m15.772s 00:33:06.437 20:50:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:33:06.437 20:50:24 -- common/autotest_common.sh@10 -- # set +x 00:33:06.437 ************************************ 00:33:06.437 END TEST nvmf_abort_qd_sizes 00:33:06.437 ************************************ 00:33:06.437 20:50:24 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:33:06.437 20:50:24 -- spdk/autotest.sh@315 -- # '[' 0 -eq 1 ']' 00:33:06.437 20:50:24 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:33:06.437 20:50:24 -- spdk/autotest.sh@324 -- # '[' 0 -eq 1 ']' 00:33:06.437 20:50:24 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:06.437 20:50:24 -- spdk/autotest.sh@338 -- # '[' 0 -eq 1 ']' 00:33:06.437 20:50:24 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:33:06.437 20:50:24 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:33:06.437 20:50:24 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:33:06.437 20:50:24 -- spdk/autotest.sh@355 -- # '[' 0 -eq 1 ']' 00:33:06.437 20:50:24 -- spdk/autotest.sh@359 -- # '[' 0 -eq 1 ']' 00:33:06.437 20:50:24 -- spdk/autotest.sh@366 -- # [[ 0 -eq 1 ]] 00:33:06.437 20:50:24 -- spdk/autotest.sh@370 -- # [[ 0 -eq 1 ]] 00:33:06.437 20:50:24 -- spdk/autotest.sh@374 -- # [[ 0 -eq 1 ]] 00:33:06.437 20:50:24 -- spdk/autotest.sh@378 -- # [[ 0 -eq 1 ]] 00:33:06.437 20:50:24 -- spdk/autotest.sh@383 -- # trap - SIGINT SIGTERM EXIT 00:33:06.437 20:50:24 -- spdk/autotest.sh@385 -- # timing_enter post_cleanup 00:33:06.437 20:50:24 -- common/autotest_common.sh@712 -- # xtrace_disable 00:33:06.437 20:50:24 -- common/autotest_common.sh@10 -- # set +x 00:33:06.437 20:50:24 -- spdk/autotest.sh@386 -- # autotest_cleanup 00:33:06.437 20:50:24 -- common/autotest_common.sh@1371 -- # local autotest_es=0 00:33:06.437 20:50:24 -- common/autotest_common.sh@1372 -- # xtrace_disable 00:33:06.437 20:50:24 -- common/autotest_common.sh@10 -- # set +x 00:33:14.589 INFO: APP EXITING 00:33:14.589 INFO: killing all VMs 00:33:14.589 INFO: killing vhost app 00:33:14.589 WARN: no vhost pid file found 00:33:14.589 INFO: EXIT DONE 00:33:17.142 0000:80:01.6 (8086 0b00): Already using the ioatdma driver 00:33:17.142 0000:80:01.7 (8086 0b00): Already using the ioatdma driver 00:33:17.142 0000:80:01.4 (8086 0b00): Already using the ioatdma driver 00:33:17.142 0000:80:01.5 (8086 0b00): Already using the ioatdma driver 00:33:17.142 0000:80:01.2 (8086 0b00): Already using the ioatdma driver 00:33:17.142 0000:80:01.3 (8086 0b00): Already using the ioatdma driver 00:33:17.142 0000:80:01.0 (8086 0b00): Already using the ioatdma driver 00:33:17.142 0000:80:01.1 (8086 0b00): Already using the ioatdma driver 00:33:17.142 0000:65:00.0 (144d a80a): Already using the nvme driver 00:33:17.142 0000:00:01.6 (8086 0b00): Already using the ioatdma driver 00:33:17.142 0000:00:01.7 (8086 0b00): Already using the ioatdma driver 00:33:17.142 0000:00:01.4 (8086 0b00): Already using the ioatdma driver 00:33:17.142 0000:00:01.5 (8086 0b00): Already using the ioatdma driver 00:33:17.402 0000:00:01.2 (8086 0b00): Already using the ioatdma driver 00:33:17.402 0000:00:01.3 (8086 0b00): Already using the ioatdma driver 00:33:17.402 0000:00:01.0 (8086 0b00): Already using the ioatdma driver 00:33:17.402 0000:00:01.1 (8086 0b00): Already using the ioatdma driver 00:33:20.706 Cleaning 00:33:20.706 Removing: /var/run/dpdk/spdk0/config 00:33:20.706 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:20.968 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:20.968 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:20.968 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:20.968 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:20.968 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:20.968 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:20.968 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:20.968 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:20.968 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:20.968 Removing: /var/run/dpdk/spdk1/config 00:33:20.968 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:20.968 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:20.968 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:20.968 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:20.968 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:20.968 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:20.968 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:20.968 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:20.968 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:20.968 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:20.968 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:20.968 Removing: /var/run/dpdk/spdk2/config 00:33:20.968 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:20.968 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:20.968 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:20.968 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:20.968 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:20.968 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:20.968 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:20.968 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:20.968 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:20.968 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:20.968 Removing: /var/run/dpdk/spdk3/config 00:33:20.968 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:20.968 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:20.968 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:20.968 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:20.968 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:20.968 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:20.968 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:20.968 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:20.968 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:20.968 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:20.968 Removing: /var/run/dpdk/spdk4/config 00:33:20.968 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:20.968 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:20.968 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:20.968 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:20.968 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:20.968 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:20.968 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:20.968 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:20.968 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:20.968 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:20.968 Removing: /dev/shm/bdev_svc_trace.1 00:33:20.968 Removing: /dev/shm/nvmf_trace.0 00:33:20.968 Removing: /dev/shm/spdk_tgt_trace.pid3829859 00:33:21.230 Removing: /var/run/dpdk/spdk0 00:33:21.230 Removing: /var/run/dpdk/spdk1 00:33:21.230 Removing: /var/run/dpdk/spdk2 00:33:21.230 Removing: /var/run/dpdk/spdk3 00:33:21.230 Removing: /var/run/dpdk/spdk4 00:33:21.230 Removing: /var/run/dpdk/spdk_pid100895 00:33:21.230 Removing: /var/run/dpdk/spdk_pid101367 00:33:21.230 Removing: /var/run/dpdk/spdk_pid101929 00:33:21.230 Removing: /var/run/dpdk/spdk_pid10253 00:33:21.230 Removing: /var/run/dpdk/spdk_pid11131 00:33:21.230 Removing: /var/run/dpdk/spdk_pid12053 00:33:21.230 Removing: /var/run/dpdk/spdk_pid18598 00:33:21.230 Removing: /var/run/dpdk/spdk_pid2048 00:33:21.230 Removing: /var/run/dpdk/spdk_pid21952 00:33:21.230 Removing: /var/run/dpdk/spdk_pid28546 00:33:21.230 Removing: /var/run/dpdk/spdk_pid35222 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3828310 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3829859 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3830666 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3831665 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3832275 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3832653 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3833042 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3833447 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3833824 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3833965 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3834224 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3834606 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3836009 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3839317 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3839663 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3840025 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3840245 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3840739 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3840781 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3841441 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3841468 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3841831 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3841970 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3842215 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3842405 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3842984 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3843130 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3843409 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3843778 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3843803 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3844005 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3844192 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3844550 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3844884 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3845196 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3845335 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3845611 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3845946 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3846295 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3846531 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3846708 00:33:21.230 Removing: /var/run/dpdk/spdk_pid3847007 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3847357 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3847699 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3847902 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3848071 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3848422 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3848763 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3849066 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3849220 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3849487 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3849824 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3850175 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3850376 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3850571 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3850879 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3851231 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3851548 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3851733 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3851941 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3852292 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3852633 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3852915 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3853058 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3853364 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3853704 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3854059 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3854253 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3854451 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3854767 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3855120 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3855189 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3855591 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3860056 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3958086 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3963148 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3973774 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3980191 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3985190 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3985917 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3996068 00:33:21.492 Removing: /var/run/dpdk/spdk_pid3996424 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4001506 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4008369 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4011952 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4024204 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4034905 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4036931 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4038162 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4058349 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4063045 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4068258 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4070746 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4073108 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4073243 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4073473 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4073813 00:33:21.492 Removing: /var/run/dpdk/spdk_pid4074416 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4076584 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4077678 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4078383 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4084849 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4091548 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4097607 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4143085 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4147899 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4155183 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4156819 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4158561 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4164128 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4168866 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4177967 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4177969 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4183041 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4183229 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4183412 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4184066 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4184071 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4185439 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4187456 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4189418 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4191443 00:33:21.753 Removing: /var/run/dpdk/spdk_pid4193470 00:33:21.753 Removing: /var/run/dpdk/spdk_pid42265 00:33:21.753 Removing: /var/run/dpdk/spdk_pid42962 00:33:21.753 Removing: /var/run/dpdk/spdk_pid43655 00:33:21.753 Removing: /var/run/dpdk/spdk_pid44363 00:33:21.753 Removing: /var/run/dpdk/spdk_pid45409 00:33:21.753 Removing: /var/run/dpdk/spdk_pid46107 00:33:21.753 Removing: /var/run/dpdk/spdk_pid46892 00:33:21.753 Removing: /var/run/dpdk/spdk_pid47710 00:33:21.753 Removing: /var/run/dpdk/spdk_pid52847 00:33:21.753 Removing: /var/run/dpdk/spdk_pid53058 00:33:21.753 Removing: /var/run/dpdk/spdk_pid60295 00:33:21.753 Removing: /var/run/dpdk/spdk_pid60464 00:33:21.753 Removing: /var/run/dpdk/spdk_pid63193 00:33:21.753 Removing: /var/run/dpdk/spdk_pid70915 00:33:21.753 Removing: /var/run/dpdk/spdk_pid70926 00:33:21.753 Removing: /var/run/dpdk/spdk_pid76838 00:33:21.753 Removing: /var/run/dpdk/spdk_pid79065 00:33:21.753 Removing: /var/run/dpdk/spdk_pid81602 00:33:21.754 Removing: /var/run/dpdk/spdk_pid82864 00:33:21.754 Removing: /var/run/dpdk/spdk_pid85347 00:33:21.754 Removing: /var/run/dpdk/spdk_pid86881 00:33:21.754 Removing: /var/run/dpdk/spdk_pid9416 00:33:21.754 Removing: /var/run/dpdk/spdk_pid96861 00:33:21.754 Removing: /var/run/dpdk/spdk_pid97433 00:33:21.754 Removing: /var/run/dpdk/spdk_pid98001 00:33:21.754 Clean 00:33:22.015 killing process with pid 3773037 00:33:32.018 killing process with pid 3773034 00:33:32.018 killing process with pid 3773036 00:33:32.018 killing process with pid 3773035 00:33:32.018 20:50:49 -- common/autotest_common.sh@1436 -- # return 0 00:33:32.018 20:50:49 -- spdk/autotest.sh@387 -- # timing_exit post_cleanup 00:33:32.018 20:50:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:33:32.018 20:50:49 -- common/autotest_common.sh@10 -- # set +x 00:33:32.018 20:50:49 -- spdk/autotest.sh@389 -- # timing_exit autotest 00:33:32.018 20:50:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:33:32.018 20:50:49 -- common/autotest_common.sh@10 -- # set +x 00:33:32.018 20:50:49 -- spdk/autotest.sh@390 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:32.018 20:50:49 -- spdk/autotest.sh@392 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:32.018 20:50:49 -- spdk/autotest.sh@392 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:32.018 20:50:49 -- spdk/autotest.sh@394 -- # hash lcov 00:33:32.018 20:50:49 -- spdk/autotest.sh@394 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:33:32.018 20:50:49 -- spdk/autotest.sh@396 -- # hostname 00:33:32.018 20:50:49 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-cyp-09 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:32.018 geninfo: WARNING: invalid characters removed from testname! 00:33:53.984 20:51:11 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:56.549 20:51:14 -- spdk/autotest.sh@398 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:57.933 20:51:15 -- spdk/autotest.sh@399 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:59.317 20:51:17 -- spdk/autotest.sh@400 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:00.702 20:51:18 -- spdk/autotest.sh@401 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:02.616 20:51:20 -- spdk/autotest.sh@402 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:04.549 20:51:22 -- spdk/autotest.sh@403 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:04.819 20:51:22 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:04.819 20:51:22 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:04.819 20:51:22 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:04.819 20:51:22 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:04.819 20:51:22 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:04.819 20:51:22 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:04.819 20:51:22 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:04.819 20:51:22 -- paths/export.sh@5 -- $ export PATH 00:34:04.819 20:51:22 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:04.819 20:51:22 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:34:04.819 20:51:22 -- common/autobuild_common.sh@435 -- $ date +%s 00:34:04.819 20:51:22 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714157482.XXXXXX 00:34:04.819 20:51:22 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714157482.IoLGBB 00:34:04.819 20:51:22 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:34:04.819 20:51:22 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:34:04.819 20:51:22 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:34:04.819 20:51:22 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:04.819 20:51:22 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:04.819 20:51:22 -- common/autobuild_common.sh@451 -- $ get_config_params 00:34:04.819 20:51:22 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:34:04.819 20:51:22 -- common/autotest_common.sh@10 -- $ set +x 00:34:04.819 20:51:22 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:34:04.819 20:51:22 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j144 00:34:04.819 20:51:22 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:04.819 20:51:22 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:04.819 20:51:22 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:04.819 20:51:22 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:04.819 20:51:22 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:04.819 20:51:22 -- common/autotest_common.sh@724 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:04.819 20:51:22 -- common/autotest_common.sh@725 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:04.819 20:51:22 -- common/autotest_common.sh@727 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:04.819 20:51:22 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:04.819 + [[ -n 3730713 ]] 00:34:04.819 + sudo kill 3730713 00:34:04.830 [Pipeline] } 00:34:04.848 [Pipeline] // stage 00:34:04.853 [Pipeline] } 00:34:04.870 [Pipeline] // timeout 00:34:04.875 [Pipeline] } 00:34:04.893 [Pipeline] // catchError 00:34:04.897 [Pipeline] } 00:34:04.916 [Pipeline] // wrap 00:34:04.922 [Pipeline] } 00:34:04.940 [Pipeline] // catchError 00:34:04.949 [Pipeline] stage 00:34:04.951 [Pipeline] { (Epilogue) 00:34:04.965 [Pipeline] catchError 00:34:04.967 [Pipeline] { 00:34:04.978 [Pipeline] echo 00:34:04.980 Cleanup processes 00:34:04.986 [Pipeline] sh 00:34:05.305 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:05.305 118677 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:05.321 [Pipeline] sh 00:34:05.610 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:05.610 ++ grep -v 'sudo pgrep' 00:34:05.610 ++ awk '{print $1}' 00:34:05.610 + sudo kill -9 00:34:05.610 + true 00:34:05.624 [Pipeline] sh 00:34:05.912 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:18.161 [Pipeline] sh 00:34:18.452 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:18.452 Artifacts sizes are good 00:34:18.469 [Pipeline] archiveArtifacts 00:34:18.478 Archiving artifacts 00:34:18.718 [Pipeline] sh 00:34:19.005 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:19.022 [Pipeline] cleanWs 00:34:19.032 [WS-CLEANUP] Deleting project workspace... 00:34:19.032 [WS-CLEANUP] Deferred wipeout is used... 00:34:19.039 [WS-CLEANUP] done 00:34:19.041 [Pipeline] } 00:34:19.063 [Pipeline] // catchError 00:34:19.077 [Pipeline] sh 00:34:19.398 + logger -p user.info -t JENKINS-CI 00:34:19.410 [Pipeline] } 00:34:19.426 [Pipeline] // stage 00:34:19.432 [Pipeline] } 00:34:19.450 [Pipeline] // node 00:34:19.455 [Pipeline] End of Pipeline 00:34:19.486 Finished: SUCCESS